18 of 18 Contract Apache Airflow Jobs in England

support data needs Optimise data storage and retrieval for performance Work with batch and real-time processing frameworks Implement and manage ETL processes Use tools like Python, SQL, Spark, Airflow, Kafka, dbt, Snowflake, Redshift, BigQuery Requirements Bachelors degree in Computer Science, Engineering, or a related field 1+ year in a Data Engineer or similar role Proficiency in SQL and More ❯

support data needs Optimise data storage and retrieval for performance Work with batch and real-time processing frameworks Implement and manage ETL processes Use tools like Python, SQL, Spark, Airflow, Kafka, dbt, Snowflake, Redshift, BigQuery Requirements Bachelors degree in Computer Science, Engineering, or a related field 1+ year in a Data Engineer or similar role Proficiency in SQL and More ❯

development. Solid understanding of data processing and engineering workflows. Experience building APIs or services to support data or ML applications. Familiarity with ML model lifecycle and tooling (e.g. MLflow, Airflow, Docker). Strong problem-solving skills and the ability to work autonomously in a dynamic environment. DESIRABLE SKILLS Experience supporting LLM training or retrieval-augmented generation (RAG). Familiarity More ❯

Microsoft Azure ecosystem and cloud-native data services Experience with CI/CD practices, Git-based workflows, and Infrastructure as Code Knowledge of data orchestration tools (Azure Data Factory, Airflow, or similar) Understanding of Azure security best practices, RBAC, and data encryption Streaming & Real-Time Processing Knowledge of real-time data processing using Azure Event Hubs, Kafka, and Spark More ❯

systems and APIs (RESTful/GraphQL), with solid experience in microservices and databases (SQL/NoSQL). You know your way around big data tools (Spark, Dask) and orchestration (Airflow, DBT). You understand NLP and have experience working with Large Language Models. You're cloud-savvy (AWS, GCP, or Azure) and comfortable with containerization (Docker, Kubernetes). You More ❯

Required Skills and Qualifications: Proven experience as an Apache Airflow SME or Lead Developer in a production-grade environment. Strong understanding of Airflow internals, including scheduler, executor types (Celery, Kubernetes), and plugin development. Experience with workload orchestration and autoscaling using KEDA (Kubernetes-based Event Driven Autoscaler), and familiarity with Celery for distributed task execution and background job More ❯

prototypes, predictive models and proof of concepts. Technical Skills Required: SQL (5+ years) Python (5+ years) Data Modelling, visualization - Tableau, micro strategy etc and integration tools : Azure data factory , airflow ect. - (5+ years) Skills: Ability to work as part of a team, as well as work independently or with minimal direction. Excellent written, presentation, and verbal communication skills. Collaborate More ❯

and Jenkins Proficient in Python and shell scripting Experience with Delta Lake table formats Strong data engineering background Proven experience working with large datasets Nice to Have : Familiarity with Airflow Background in full stack development Team & Culture : Join a collaborative team of 10 professionals Friendly, delivery-focused environment Replacing two outgoing contractors - the handover will ensure a smooth start More ❯

and Jenkins Proficient in Python and shell scripting Experience with Delta Lake table formats Strong data engineering background Proven experience working with large datasets Nice to Have : Familiarity with Airflow Background in full stack development Team & Culture : Join a collaborative team of 10 professionals Friendly, delivery-focused environment Replacing two outgoing contractors - the handover will ensure a smooth start More ❯

knowledge. A key part of your role will be setting up monitoring and alerting across the platform. Experience Required: Hands-on with Data Platform tools: Snowflake (Must Have), dbt, Airflow, and Fivetran Experience implementing DataOps best practices: CI/CD, modular pipelines, automated testing, code promoting Access management using Azure Active Directory (Entra ID) Proven experience setting up monitoring More ❯

knowledge. A key part of your role will be setting up monitoring and alerting across the platform. Experience Required: Hands-on with Data Platform tools: Snowflake (Must Have), dbt, Airflow, and Fivetran Experience implementing DataOps best practices: CI/CD, modular pipelines, automated testing, code promoting Access management using Azure Active Directory (Entra ID) Proven experience setting up monitoring More ❯

cloud-native environment. Strong understanding of programmatic advertising, attribution modelling, campaign measurement, and media mix optimisation. Familiarity with cloud platforms (especially GCP) and tools like BigQuery, Vertex AI, Dataflow, Airflow, and dbt. Excellent communication and stakeholder management skills, with the ability to align cross-functional teams around a shared vision. If you are interested in this opportunity, please apply More ❯

cloud-native environment. Strong understanding of programmatic advertising, attribution modeling, campaign measurement, and media mix optimization. Familiarity with cloud platforms (especially GCP) and tools like BigQuery, Vertex AI, Dataflow, Airflow, and dbt. Excellent communication and stakeholder management skills, with the ability to align cross-functional teams around a shared vision. Please send in latest CV LA International is a More ❯

to our bespoke data pipeline and associated API services. Key Requirements 5+ years of Python experience with frameworks like Flask, FastAPI, and Django. Strong command orchestration tools (e.g. Prefect, Airflow), Docker, and AWS infrastructure (CDK, Terraform). Solid understanding of API services, authentication methods (JWT, SSO), and clear, pragmatic communication skills. Maintain, upgrade, and improve existing systems and custom More ❯

with cloud platforms (AWS, Azure) and container orchestration (Kubernetes, Docker). Familiarity with GitLab CI/CD, Infrastructure as Code (IaC), and automated deployment pipelines. Knowledge of scheduling tools - Airflow Strong documentation and communication skills. Ability to work collaboratively across multidisciplinary teams. The successful candidate will also need to be SC Vetted. More ❯

with cloud platforms (AWS, Azure) and container orchestration (Kubernetes, Docker). Familiarity with GitLab CI/CD, Infrastructure as Code (IaC), and automated deployment pipelines. Knowledge of scheduling tools - Airflow Strong documentation and communication skills. Ability to work collaboratively across multidisciplinary teams. The successful candidate will also need to be SC Vetted. If you are interested in this position More ❯

with cloud platforms (AWS, Azure) and container orchestration (Kubernetes, Docker). Familiarity with GitLab CI/CD, Infrastructure as Code (IaC), and automated deployment pipelines. Knowledge of scheduling tools - Airflow Strong documentation and communication skills. Ability to work collaboratively across multidisciplinary teams. Due to the nature and urgency of this post, candidates holding or who have held high level More ❯

orchestration initiatives for one of our leading telecom clients based in London. This role requires deep expertise in data pipeline development and data modeling, using tools such as DBT, Airflow, Fivetran, and Erwin. We need with minimum 8+ years of experience Key Responsibilities: Design, build, and maintain scalable and robust data pipelines using Airflow, Fivetran, and DBT. Develop … Data Modeler. Collaborate with business stakeholders and data analysts to understand data requirements and translate them into efficient engineering solutions. Optimize data flows and manage orchestration and scheduling using Apache Airflow. Ensure data integrity, accuracy, and consistency across systems. Implement CI/CD pipelines and monitor job performance and failures. Support data governance, data quality, and compliance initiatives. Required … and Experience: Proven experience as a Data Engineer in a fast-paced, enterprise-level environment. Strong hands-on experience with: DBT (Data Build Tool) for transforming and modeling data Airflow for orchestrating workflows Fivetran for data extraction and integration Erwin for data modeling and documentation Strong understanding of relational databases and SQL (PostgreSQL, Snowflake, BigQuery, etc.). Familiarity with More ❯