1 to 25 of 94 Apache Airflow Jobs in England

industry. Strong full-stack experience with Python , Java (Spring Boot) , React , SQL, and relational databases. Hands-on experience with modern data engineering tools (e.g. Airflow, Spark, Kafka, dbt, Snowflake or similar). Experience with cloud platforms , containerisation (Docker/Kubernetes) , and CI/CD pipelines . Solid understanding ...

governance, security, and regulatory compliance . Ability to work closely with technical and business teams to deliver impactful solutions. Nice-to-Haves: Orchestration tools (Airflow, dbt, Prefect) or streaming frameworks (Kafka, Kinesis). CI/CD experience and DevOps practices for data workflows. Exposure to data visualisation platforms (PowerBI ...

governance, security, and regulatory compliance . Ability to work closely with technical and business teams to deliver impactful solutions. Nice-to-Haves: Orchestration tools (Airflow, dbt, Prefect) or streaming frameworks (Kafka, Kinesis). CI/CD experience and DevOps practices for data workflows. Exposure to data visualisation platforms (PowerBI ...

architecture, modelling, pipelines) (please be clear on years and/or projects) Strong Python and SQL Experience with orchestration and transformation frameworks such as Airflow, dbt, Dagster , or similar Experience designing and delivering data platforms or lakehouse-style architectures Solid understanding of CI/CD for data engineering (e.g. ...

Ability to communicate complex technical concepts to non-technical stakeholders Nice to Have Experience with MLflow, DVC, SageMaker Workflow orchestration tools (Dagster/Airflow) Containerisation (Docker, ECS) Domain experience in transportation, airlines, operations, or network optimisation Qualifications Master’s degree in Data Science, ML, Operational Research OR 2+ years ...

Snowflake, Databricks, or BigQuery. Familiarity with streaming technologies (e.g., Kafka, Spark Streaming, Flink) is an advantage. Experience with orchestration and infrastructure tools such as Airflow, dbt, Prefect, CI/CD pipelines, and Terraform. What you get in return: Up to £60,000 per annum + benefits Hybrid working ...

pipelines Proficiency with at least one cloud platform: Amazon Web Services (AWS) Microsoft Azure (Azure) Google Cloud Platform (GCP) Experience with orchestration tools (e.g., Apache Airflow) Experience with version control (e.g., Git) Solid understanding of data warehousing concepts and dimensional modeling To apply for this role please submit ...

data modelling Python preferred, or similar, for automation and pipeline development Cloud exposure across AWS, Azure, or GCP Familiarity with tools like dbt, Airflow, or equivalents Good habits around governance, security, documentation, Git, and CI/CD You’ll thrive if you’re Curious, motivated, and pragmatic, you care ...

data modelling Python preferred, or similar, for automation and pipeline development Cloud exposure across AWS, Azure, or GCP Familiarity with tools like dbt, Airflow, or equivalents Good habits around governance, security, documentation, Git, and CI/CD You’ll thrive if you’re Curious, motivated, and pragmatic, you care ...

data modelling Python preferred, or similar, for automation and pipeline development Cloud exposure across AWS, Azure, or GCP Familiarity with tools like dbt, Airflow, or equivalents Good habits around governance, security, documentation, Git, and CI/CD You’ll thrive if you’re Curious, motivated, and pragmatic, you care ...

data modelling Python preferred, or similar, for automation and pipeline development Cloud exposure across AWS, Azure, or GCP Familiarity with tools like dbt, Airflow, or equivalents Good habits around governance, security, documentation, Git, and CI/CD You’ll thrive if you’re Curious, motivated, and pragmatic, you care ...

Python (and ideally C#) programming skills You have experience with data modelling, ETL pipelines and data integration You have a good knowledge of Dagster, Airflow or similar orchestration tool You're collaborative and pragmatic with great stakeholder communication skills What's in it for you: Salary to £120k Pension ...

with a strong focus on ETL/ELT.• Advanced SQL and Python development skills.• Hands-on experience with DBT, GIT, Terraform, Docker, IAM, and Airflow (Composer).• Proven experience working on cloud platforms – ideally GCP (BigQuery), but Azure or AWS also considered.• Strong understanding of Data Mesh, Test Driven ...

Data Engineer: Experience with Databricks , Kafka , or Kinesis for real-time data streaming Knowledge of containerisation (Docker, ECS) and modern orchestration tools such as Airflow Familiarity with machine learning model deployment pipelines or data lakehouse architectures Data Engineer, AWS Data Engineer ...

experience in cloud-based data services. Proficiency in SQL and Python for data manipulation and transformation. Experience with modern data engineering tools, including Apache Spark, Kafka, and Airflow. Strong understanding of data modelling, schema design, and data warehousing concepts. Familiarity with data governance, privacy, and compliance frameworks (e.g., GDPR ...

tooling Good scripting skills (Python/SQL/Bash) Strong understanding of AWS security, IAM, and networking Comfortable operating in Agile, delivery-led environments Apache Airflow for DAG Date-Led Platform/Cloud Engineering Key requirements: Active SC Clearance (essential) Permanent role Ideally you will be based around ...

onsite in Edinburgh or London 3 days/week Nice to Have Exposure to ML/AI data workflows Experience with orchestration tools (e.g., Airflow or similar) Cloud platform experience (AWS, Azure, or GCP) Please include: Availability start date Hourly rate A brief 2–3 line summary ...

Cassandra) Expertise in building and maintaining ETL pipelines and data workflows Familiarity with cloud data platforms (AWS, Azure, GCP) and data pipeline orchestration tools (Airflow, Prefect, etc.) Understanding of data modelling, schema design, and performance optimisation Experience with agile development methodologies, including Scrum and Kanban Familiarity with version control ...

working in fast-paced environments and able to contribute quickly without extensive onboarding. Nice to Have Experience with modern data stack tools (e.g., dbt, Airflow, etc.). Understanding of CI/CD pipelines and data infrastructure automation. Familiarity with data governance, security, and best practices in a cloud environment. ...

such as React or Next.js . Experience creating and maintaining APIs, working with relational/non‐relational databases. Familiarity with data orchestration tools (e.g. Airflow ) and data warehouse/lake design. Practical knowledge of AWS or Azure cloud environments. Strong understanding of Git , CI/CD , and modern deployment ...

able to apply this expertise to business problems to generate value. We currently work in an AWS, Snowflake, dbt, Looker, Python, Kinesis and Airflow stack and are building out our real-time data streaming capabilities using Kafka. You should be comfortable with these or comparable technologies. As an individual ...

MLflow) Experience with cloud-based ML tools (e.g. SageMaker), data and model versioning (e.g. DVC), CI/CD (e.g. GitHub Actions), workflow orchestration (e.g. Airflow/Dagster) and containerised solutions (e.g. Docker, ECS) nice to have Experience in code testing (unit, integration, end-to-end tests) Strong data engineering ...

Linux systems administration and performance optimisation experience p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Hands-on with Python orchestration frameworks (Dagster, Apache Airflow) Cloud & Infrastructure : p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Serverless AWS experience (Lambda, Step Functions, Athena, Glue ...

EXPERIENCE The successful Lead Data Engineer will have the following skills and experience: Strong Python and SQL skills AWS or GCP Orchestration, ideally with Airflow or Dagsta but open to others Data warehousing - Snowflake, Redshift, BigQuery (NOT Databricks) Terraform or Palumi BENEFITS The successful Lead Data Engineer will receive ...

EXPERIENCE The successful Lead Data Engineer will have the following skills and experience: Strong Python and SQL skills AWS or GCP Orchestration, ideally with Airflow or Dagsta but open to others Data warehousing - Snowflake, Redshift, BigQuery (NOT Databricks) Terraform or Palumi BENEFITS The successful Lead Data Engineer will receive ...