51 to 75 of 360 Apache Jobs

Data Engineer

Location
Blandford Forum, England, United Kingdom
Snowflake and Databricks, Python and SQL, ETL development and data modelling. Experience with cloud-based data platforms and data governance. Nice to have: Apache Airflow, Spark, AWS/Azure, data visualisation and experience delivering solutions within Defence or secure Government environments. Clearance: Due to the sensitive nature ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent written and verbal English skills Last ...

Principal Data Engineer

Location
Manchester, England, United Kingdom
analytics and AI/ML at enterprise scale.* Develop and optimise batch and streaming ETL/ELT pipelines using Azure Data Factory, PySpark, SQL, Apache Spark and Airflow, integrated with modern tooling like dbt and Git-based CI/CD.* Implement data cataloguing, lineage tracking and governance frameworks through ...

Data Engineer d/f/m

Location
England, United Kingdom
efficiency. Job requirements and experience Strong data engineering experience using Python and SQL to build reliable pipelines and transformations. Hands-on experience with Databricks, Apache Spark and AWS data services such as S3. Experience integrating diverse data sources through APIs, batch processing or streaming. Sound understanding of data modelling ...

Data Engineer (early career)

Location
City of Edinburgh, Scotland, United Kingdom
cloud platforms such as AWS, Azure or GCP is desirable. Basic understanding of relational databases and SQL queries. Awareness of tools such as Airflow, Apache NiFi or Talend is helpful. Foundations in data warehousing, modelling and schema design, with an interest in building dashboards using Power BI, QlikView ...

Lead Data Engineer

Location
Greater London, England, United Kingdom
skills and a solid understanding of data modelling, software engineering and production support. You'll have experience with distributed processing frameworks such as Apache Spark, cloud platforms such as AWS, GCP or Azure, and modern development practices including testing, CI/CD, Linux and containerisation. You're an experienced ...

Enterprise Architect - AI

Location
Greater London, England, United Kingdom
Ansible for repeatable, automated provisioning of GPU clusters and AI platform environments; GitOps (ArgoCD) for continuous, declarative platform delivery. Pipeline orchestration: Kubeflow Pipelines, Apache Airflow, or Argo Workflows to orchestrate multi-stage training, fine-tuning, and inference pipelines. Cluster & workload scheduling: Slurm, Run:ai, and NVIDIA Base Command Manager ...

Data Engineer

Location
Newcastle upon Tyne, England, United Kingdom
United Kingdom A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well … complex, cloud-based data programme - designing, building, and maintaining data pipelines that process large volumes of data across a modern AWS-native stack. Using Apache Spark and PySpark for distributed data processing, Apache Airflow for orchestration, and a range of AWS services for storage, compute, and analytics ...

Data Engineer - Databricks

Location
Bristol, England, United Kingdom
engineering or business intelligence solutions. Strong proven commercial experience with Databricks. Strong experience developing ETL/ELT pipelines and data integration solutions. Experience using Apache Spark, PySpark, and Spark SQL. Strong SQL development and optimisation skills. Experience working with large and complex datasets from multiple source systems. Knowledge ...

Principal Machine Learning Engineer

Location
West of England, England, United Kingdom
agent frameworks. Inference and edge: TensorRT, ONNX Runtime, vLLM, Nvidia Triton Inference Server, KServe, Nvidia Jetson (e.g. Jetson Thor). Data and platforms: Databricks, Apache Spark, MLflow, SQL, AWS, GCP, Docker. Working at Rowden We are committed to building a flexible, inclusive, and enabling company. ...

Data Engineer

Location
Greater London, England, United Kingdom
into actionable insights, and power high-impact trading and AI decisions. Ideal Candidate: 5+ years of experience in data engineering with MPP databases or Apache Spark Strong skills in Python and SQL, with solid data modeling experience Extensive knowledge of AWS/cloud services (ECS, EKS, Lambda, Kinesis, DynamoDB ...

Data Engineer

Location
Greater London, England, United Kingdom
adhere to the D.R.Y principle, minimising manual intervention and promote automation. We're looking for these essential skills Hands‐on experience with DBT and Apache Airflow, building scalable data transformations and DAGs to orchestrate complex, reliable data pipelines. Manage task dependencies, automated retries and error handling to ensure reliable ...

Software Engineer III - Cloud Data Platform (AWS/Databricks, Terraform)

Hiring Organisation
Hackajob Ltd
Location
Glasgow, Scotland, United Kingdom
Employment Type
Permanent Contract, On-site
inputs/outputs, and adherence to resiliency and security expectations Preferred qualifications, capabilities, and skills Experience with data lakehouse architectures using Delta Lake, Apache Spark, or similar open-source frameworks Familiarity with AWS-native data services such as Glue, Lake Formation, Redshift, or Athena Exposure to data governance practices ...

Senior Engineer Digital Distribution

Hiring Organisation
Invesco
Location
Atlanta, Georgia, United States
Employment Type
Permanent
Salary
USD Annual
experience of Amazon cloud (AWS)- S3, RDS, Lambda, Glue, SNS, Terraform etc. 5-7 years of experience in building data pipelines in tools using Apache Airflow, Airbyte Good understanding of ETL/ELT experience and good knowledge of SQL and query optimization techniques (ie DBT) 3-5 years ...

Principal DevOps Engineer

Location
West of England, England, United Kingdom
with monitoring/logging tools (ELK stack, Prometheus, Splunk) Familiarity with service mesh and modern networking (Istio, Envoy) Exposure to data engineering and integration (Apache ecosystem, SQL, Python) Recognised technical certifications (AWS/Azure Architect, Kubernetes CKA/CKAD, Terraform) Experience in influencing technical standards, best practices, or contributing ...

Principal DevOps Engineer

Location
Bristol, England, United Kingdom
with monitoring/logging tools (ELK stack, Prometheus, Splunk) Familiarity with service mesh and modern networking (Istio, Envoy) Exposure to data engineering and integration (Apache ecosystem, SQL, Python) Recognised technical certifications (AWS/Azure Architect, Kubernetes CKA/CKAD, Terraform) Experience in influencing technical standards, best practices, or contributing ...

Data Engineer

Hiring Organisation
AECOM
Location
London, England, United Kingdom
methodologies (dimensional modelling, star/snowflake schemas, data vault, etc.).Experience designing and operating ETL/ELT pipelines and modern workflow orchestration tools (e.g., Apache Airflow, Azure Data Factory, Azure Functions).Professional experience in delivering cloud-based data engineering solutions at scale, with strong client-facing, stakeholder management, communication ...

Senior Data Engineer

Hiring Organisation
AECOM
Location
London, England, United Kingdom
methodologies (dimensional modelling, star/snowflake schemas, data vault, etc.).Experience designing and operating ETL/ELT pipelines and modern workflow orchestration tools (e.g., Apache Airflow, Azure Data Factory, Azure Functions).Professional experience in delivering cloud-based data engineering solutions at scale, with strong client-facing, stakeholder management, communication ...

Lead Data Engineer

Location
United Kingdom
resolve complex data and platform issues. Strong commercial experience designing and implementing real‐time streaming data platforms. Hands‐on experience with technologies such as Apache Kafka, AWS Kinesis, Apache Flink, Spark Streaming, Apache Pulsar, or similar event‐driven technologies. Experience building high‐volume, low‐latency, resilient data ...

Data Engineer

Location
Greater London, England, United Kingdom
data security and privacy standards, ideally within a healthcare or public sector context Nice to have: Experience with big data processing frameworks like Apache Spark SOME THINGS YOU’LL BE WORKING ON Design, construct and maintain robust data pipelines to support the NHS App Ensure the secure and compliant ...

Software Engineer III - Cloud Data Platform Engineering (AWS , Terraform & Databricks)

Location
Greater London, England, United Kingdom
inputs/outputs, and adherence to resiliency and security expectations Preferred qualifications, capabilities, and skills Experience with data lakehouse architectures using Delta Lake, Apache Spark, or similar open‐source frameworks Familiarity with AWS‐native data services such as Glue, Lake Formation, Redshift, or Athena Exposure to data governance practices ...

Data Engineer

Location
Greater London, England, United Kingdom
adhere to the D.R.Y principle, minimising manual intervention and promote automation. **We're looking for these essential skills** * Hands-on experience with DBT and Apache Airflow, building scalable data transformations and DAGs to orchestrate complex, reliable data pipelines.* Manage task dependencies, automated retries and error handling to ensure reliable ...

Client-Facing Data Engineer

Location
Greater London, England, United Kingdom
legal advisors to ensure holistic solutions Your areas of knowledge and expertise Proven experience designing and implementing data lakehouse architectures (Databricks, Delta Lake, Apache Flink, or similar technologies) Strong, hands-on AWS cloud experience including services such as S3, Glue, Lake Formation, Athena, and Redshift Demonstrated expertise ...

Databricks Lakehouse Platform Engineer (Hybrid, UK)

Location
Greater London, England, United Kingdom
internal knowledge Competencies and Behaviours: 3+ years experience in data platform engineering, cloud engineering, or similar roles Strong hands-on experience with Databricks, including Apache Spark, Delta Lake, Workflows Proven experience designing and deploying data platforms on AWS and/or Azure (e.g. ADLS, S3, VNet/ ...

Senior Data Analytics Engineer

Location
England, United Kingdom
technologies such as Databricks, Redshift, BigQuery or Snowflake. You’ll be comfortable using Git and workflow‐orchestration tools such as Apache Airflow, integrating data from APIs, databases and third‐party systems, and applying rigorous validation and monitoring throughout the pipeline. Just as importantly, you’ll be a strong problem ...