51 to 75 of 86 Apache Jobs in the UK

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that ...

cloud data AWS Aurora PostgreSQL AWS Database Migration Service (DMS) Snowflake Azure Google Cloud Platform (GCP) Data integration and engineering Informatica Talend Apache Airflow Python for data processing and automation Data warehouse design and optimisation APIs and event-driven architecture REST APIs GraphQL Apache Kafka Event-driven architectures ...

that are unstructured or semi-structured. Proficiency in statistics and exploratory data analysis methods. Familiarity with data processing frameworks such as Spark, Ray, or Apache Beam. Ability to communicate technical findings clearly to research and product teams. Software Engineering IC4 - The typical base pay range for this role across ...

other genome browser Experience working in a multi-person team delivering production services Experience with large-scale biological datasets Experience working with the Apache Parquet file format Experience implementing AI/ML approaches for quality control and/or genome annotation Behaviours we value in our team: You bring ...

business. Key Responsibilities: Design, build and enhance a secure, scalable and reliable Databricks platformDevelop and maintain batch and real-time data pipelines using Databricks, Apache Spark and Delta LakeContribute to platform architecture, engineering standards and best practices across the data estateWork with Product, Analytics and Data Science teams … contribute to continuous improvement across the engineering teamJob Requirements: Significant experience building and supporting scalable, production-grade data platformsStrong hands-on expertise with Databricks, Apache Spark, Delta Lake, Python and SQLGood understanding of cloud-based data engineering, ideally within Microsoft Azure environmentsExperience with Infrastructure as Code tools such ...

related disciplines within enterprise environments 4+ years of hands-on experience designing and implementing solutions on the Databricks Lakehouse Platform Strong expertise in Apache Spark, SQL, Python, Delta Lake, and modern data engineering practices Experience building and optimizing Extract, Transform, Load and Extract, Load, Transform data pipelines for scalable … solutions on the Databricks Lakehouse Platform. Design and implement scalable data and analytics solutions leveraging Databricks technologies Build, maintain, and optimize data pipelines using Apache Spark, SQL, Python, and Delta Lake Develop governed datasets and data products that support reporting, analytics, and artificial intelligence initiatives Partner with business stakeholders ...

Management Stakeholder Collaboration Leadership & Mentorship Technology Stack The successful candidate will have experience working with some or all of the following technologies: Data Processing: Apache Spark/PySpark Workflow Orchestration: Apache Airflow Containerisation: Kubernetes Cloud Platform: Microsoft Azure Data APIs & Semantic Layer: CubeJS Programming Languages: Python, SQL Essential ...

Management Stakeholder Collaboration Leadership & Mentorship Technology Stack The successful candidate will have experience working with some or all of the following technologies: Data Processing: Apache Spark/PySpark Workflow Orchestration: Apache Airflow Containerisation: Kubernetes Cloud Platform: Microsoft Azure Data APIs & Semantic Layer: CubeJS Programming Languages: Python, SQL Essential ...

hybrid work from home policy. Qualifications Commercial experience with web client or server-side development Proficiency with Golang, TypeScript, React, SQL, Kafka or Apache Flink Background delivering software in continuous change environments Familiarity with AI tools to enhance developer productivity Clear technical communication with cross-functional stakeholders Proven grasp ...

Java and related technologies. Document code and processes to support knowledge sharing within the team. Profile Must haves: 2+ years industry experience Java Linux Apache Mongo/Postgres AI - prompt engineering or AI-assisted development (Claude, Cursor etc) Worked on a broker platform or similar industry experience a huge ...

something new, this is it. What you'll be doing Designing and building Real Time streaming pipelines on Kafka Architecting a lakehouse platform using Apache Iceberg Building high-performance analytics over large-scale and temporal (time-series) data Developing knowledge graphs, semantic models and ontologies to give the data ...

specific area or have broad knowledge across the systems engineering lifecycle, your skills matter. Your Impact Protecting RAF aircraft like Typhoon and Apache Advancing next-gen air combat with Team Tempest and GCAP Developing future electronic warfare systems Harnessing AI/ML to unlock intelligence from vast data What ...

data exchange platform. This is a hands-on engineering and architecture role, combining the design of reusable, reliable data pipelines with practical development using Apache NiFi, RDF, SPARQL, Python and Java. The platform will use open-source, cloud-agnostic technologies to ingest, transform, validate and exchange data securely between … systems. Skills and Experience: Proven experience designing and delivering data integration or ETL solutions using Apache NiFi. Practical project experience with RDF triples, SPARQL and semantic data modelling. Hands-on development experience in both Python and Java. Experience designing reusable pipelines across APIs, databases, files and other data sources. ...

Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data modelling and lakehouse design (bronze, silver, gold) Terraform, CI/CD and pipeline orchestration A track record of setting … pairing and design sessions Confidence communicating with technical and non-technical stakeholders, and challenging constructively Desirable: SQL Server or on-prem to cloud migration, Apache Flink, regulated industry experience If you'd rather shape a platform than inherit a finished one, and want a seat at the table while ...

maintaining new Local and Virtual Linux Server Environments Coding and maintenance of internal and external websites utilising standard LAMP stack or IIS, Apache, PHP, HTML, CSS, WordPress, Node Maintenance of MySQL and PostgreSQL databases both locally and remotely Helping staff with Windows 11 and application related enquiries Understanding network ...

first point of escalation for technical issues within your products Candidates will have proven hands-on experience with LAMP stack (Linux, Apache, MySQL, PHP) and experience in maintaining and developing transactional, web-based platforms. Experience or capability of leading, mentoring or supporting a small development team. Good understanding ...

needs, entrepreneurial spiritExcellent verbal and written communication skillsBS or MS degree in Computer Science or equivalentExperience in distributed computing frameworks like - Hive/Hadoop, Apache SparkExperience in developing Finance or HR related applicationsExperience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache, LambdaWorking … experience with TerraformExperience in creating workflows for Apache Airflow#LI-GL1What's Roku's approach to hybrid working? Roku fosters an inclusive and collaborative environment where teams generally work in the office Monday through Thursday. Fridays are generally flexible for remote work, except for employees whose specific roles or assigned ...

Data Engineer 6 Month Contract Location: Hereford (Onsite 4 days a week) Rate: £700 - £800 per day (INSIDE IR35) Skills: Python, Azure, Kubernetes, Apache Airflow, Apache Spark, DV Clearance We are looking to recruit a DV Cleared Data Engineer for a leading technology consultancy click apply for full ...

Data Engineer/Architect - Apache Airflow - Astronomer Location: London - 3 days a week onsite (non-negotiable) Duration: 6 Months Rate: £700-£800 per day Inside IR35 The Role We're supporting a highly reputable client in the Financial Services industry who are seeking an experienced Data Engineer to support … them through a period of significant change across their Technology Delivery function. The team are in the early stages of adopting Apache Airflow and Astronomer as their core orchestration platform/tooling for their DBT projects. To move forward with the process and maximise the tooling, the team require ...

Terraform, CloudBees/JenkinsHands-on experience with cloud databases such as Amazon DynamoDB, Aurora, or SnowflakeExperience building data streaming and event-driven architectures with Apache Kafka or Apache FlinkExperience or strong interest in AI-assisted software development and agentic engineering practicesAI-assisted engineering: Our engineers are expected ...

robust data models, ETL pipelines, metadata frameworks, and modern data warehousing solutions. Design and optimise large-scale streaming data platforms using technologies such as Apache Flink and other real-time processing frameworks. Ensure all solutions comply with industry best practices, governance frameworks, and regulatory requirements, maintaining the highest standards … Lambda, Redshift , and related data services. Proven experience designing secure architectures within sensitive or highly regulated environments. Hands-on experience with Apache Flink and real-time data processing architectures. Strong understanding of data modelling methodologies, architectural patterns, and industry standards. Expertise across ETL processes, data integration, data warehousing, distributed ...

data models, ETL pipelines, metadata frameworks, and modern data warehousing solutions. \n Design and optimise large-scale streaming data platforms using technologies such as Apache Flink and other real-time processing frameworks. \n Ensure all solutions comply with industry best practices, governance frameworks, and regulatory requirements, maintaining the highest … Lambda, Redshift , and related data services. \n Proven experience designing secure architectures within sensitive or highly regulated environments. \n Hands-on experience with Apache Flink and real-time data processing architectures. \n Strong understanding of data modelling methodologies, architectural patterns, and industry standards. \n Expertise across ETL processes, data ...

Scala programming to develop robust, scalable, and high-performance data processing applications. Build and optimise large-scale data processing and analytics pipelines using Apache Spark. Develop and maintain end-to-end data pipelines for both batch and real-time data processing. Apply solid understanding of data engineering concepts, including … business stakeholders. Skills & Experience: Proven experience as a Software Engineer with a strong focus on Scala development. Extensive hands-on experience with OpenShift and Apache Spark. In-depth understanding of data engineering principles and practises. Experience in developing and maintaining scalable data pipelines for batch and real-time processing. ...

developers, engineers, architects, and platform specialists, contributing to both business-as-usual services and innovative technology initiatives. The role offers exposure to Kubernetes, OpenShift, Apache NiFi, Identity Platforms, DevOps tooling, and open-source technologies. Key Responsibilities As an IdAM Application Developer, you will: Design, develop, test, and deploy data … enhance in-house Kubernetes clusters supporting application delivery across multiple environments. Develop and maintain Ansible automation roles, enabling users to independently deploy and manage Apache NiFi clusters. Provide technical guidance, support, and training on Apache NiFi and related technologies. Collaborate with engineering teams to deliver secure, scalable ...

developers, engineers, architects, and platform specialists, contributing to both business-as-usual services and innovative technology initiatives. The role offers exposure to Kubernetes, OpenShift, Apache NiFi, Identity Platforms, DevOps tooling, and open-source technologies. Key Responsibilities As an IdAM Application Developer, you will: Design, develop, test, and deploy data … enhance in-house Kubernetes clusters supporting application delivery across multiple environments. Develop and maintain Ansible automation roles, enabling users to independently deploy and manage Apache NiFi clusters. Provide technical guidance, support, and training on Apache NiFi and related technologies. Collaborate with engineering teams to deliver secure, scalable ...