76 to 100 of 339 Apache Airflow Jobs in England

Senior BI Analytics Engineer

Location
City of Westminster, England, United Kingdom
ability to work with non-technical stakeholders NICE TO HAVE Hands-on experience with Google Cloud Platform, especially BigQuery Experience with orchestration tools (e.g. Airflow ) Knowledge of data governance and data quality frameworks Exposure to reverse ETL tools (e.g. Hightouch ) Familiarity with AI coding assistants and a habit ...

AI Engineer

Location
Greater London, England, United Kingdom
relational databases (e.g., PostgreSQL, DuckDB). Experience with the modern data stack, building data ingestion pipelines and working with ETL and orchestration tools (e.g., Airflow, Luigi, Argo, dbt), big data technologies (Spark, Kafka, Parquet), and web frameworks for model serving (e.g. Flask or FastAPI). Data Science: Familiarity ...

Senior Engineering Manager (Data Platform)

Location
Greater London, England, United Kingdom
safe to challenge ideas, learn, and grow. Nice to have Hands-on familiarity with the modern data stack — for example, Spark, Flink, Kafka, Debezium, Airflow, dbt, or similar — and with cloud platforms (AWS/GCP or equivalent) and modern DevOps practices. Experience leading teams that built data platforms used ...

GCP Senior Data Engineer

Location
Greater London, England, United Kingdom
experience with BigQuery . Experience building and supporting production data pipelines. Experience developing transformation layers using dbt . Experience with orchestration tools such as Apache Airflow or Cloud Composer . Strong SQL and Python development skills. Experience designing scalable data models and data warehouse solutions. Strong stakeholder engagement … independently and taking ownership of delivery. Why Join? Be part of a growing Data Engineering team. Work with modern technologies including GCP, BigQuery, dbt, Airflow, Terraform and cloud-native services . Help shape a strategic cloud data platform. Join a business investing heavily in its data capability. Enjoy real ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent written and verbal English skills ...

Senior Data Engineer

Hiring Organisation
Data Idols
Location
London, United Kingdom
Employment Type
Permanent
Salary
£80000 - £95000/annum
with reverse ETL and moving data between warehouses and operational systems Strong understanding of APIs Familiarity with modern data engineering tools such as dbt, Airflow, Fivetran or Census Excellent stakeholder management skills If you're an experienced Senior Data Engineer who enjoys solving complex integration challenges, working with modern ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
data modeling, and data integrationSkilled in data manipulation, processing, and orchestration frameworksHands-on experience with Data Factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, and PyTestProficiency with GitHub, GitHub Actions, and Azure DevOpsStrong communication and collaboration skills to align technical and business stakeholdersProven ability ...

Data Engineer - SC Cleared

Hiring Organisation
NSD
Location
Newcastle Upon Tyne, North East, United Kingdom
Employment Type
Permanent Contract, On-site
pipelines Strong programming skills in Python and SQL or similar Experience with technologies such as Spark, Databricks, AWS, Azure, GCP and/or Airflow Strong focus on data quality, testing and reliability Solid software engineering fundamentals and high engineering standards Strong communication and collaborative skills Comfortable working with ambiguity ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
maintaining data pipelines at scale Experience with a modern data stack (e.g. Snowflake, dbt, Fivetran, Debezium or similar) Experience with orchestration tools such as Airflow, Dagster or Prefect Proficiency in Python for building production data workflows Familiarity with data warehousing concepts and modelling patterns Experience working with cloud platforms ...

Financial Crime Data Engineering Lead (snowflake, dbt)

Location
Greater London, England, United Kingdom
Data Vault, dimensional modelling or complex entity resolution. Building data foundations for machine learning, anomaly detection or GenAI applications. Experience with Azure Data Factory, Airflow or similar orchestration technologies. Why consider it? This is an opportunity to take genuine technical ownership of an important data engineering capability, rather than ...

Senior Snowflake Consultant - Data & AI Engineering

Location
Greater London, England, United Kingdom
contributors to deliver outcomesStrong commercial awareness, including experience contributing to scoping, estimation and proposal developmentNice to haveSnowflake ecosystem experience with tools such as dbt, Airflow/Dagster, Matillion/Fivetran, Kafka/Kinesis/Event Hubs or similarExperience with Snowflake capabilities such as Snowpark, Streams & Tasks, Dynamic Tables, Data ...

Lead Data Engineer

Location
City Of London, England, United Kingdom
ADLS, and Azure Functions. Proven track record of designing and implementing metadata‐driven data pipelines. Deep expertise in orchestration and data workflow automation e.g. Airflow, DBT. Strong understanding of CI/CD practices for data engineering. Experience with infrastructure as code (Terraform, Bicep, or ARM templates) (preferred). Solid ...

Senior Data Engineer

Location
City Of London, England, United Kingdom
including ADF, ADLS, and Azure Functions. Proven experience designing and implementing metadata-driven data pipelines. Strong understanding of orchestration and data workflow automation, e.g. Airflow, DBT, Spark Declarative Pipelines. Strong understanding and practical application of CI/CD practices for data engineering. Experience contributing to technical design discussions ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
data services, including ADF, ADLS, and Azure Functions.Proven experience designing and implementing metadata-driven data pipelines.Strong understanding of orchestration and data workflow automation, e.g. Airflow, DBT, Spark Declarative Pipelines.Strong understanding and practical application of CI/CD practices for data engineering.Experience contributing to technical design discussions and architectural decisions.Good ...

Senior Developer (Python)

Location
Greater London, England, United Kingdom
content operations, or omnichannel marketing technology Experience with cloud platforms (AWS, Azure, GCP) and containerization (Docker, Kubernetes) Knowledge of data engineering tools: pandas, PySpark, Airflow, or equivalent pipeline frameworks Exposure to ML frameworks or LLM APIs (Anthropic, OpenAI, Hugging Face) for applied use cases Experience in pharmaceutical, life sciences ...

Compute Platform Engineer II

Location
Greater London, England, United Kingdom
common CI/CD stack (e.g., Jenkins, CircleCI, GitLab, Azure DevOps) Experience in workflow orchestration with tools such as Argo Workflow, Airflow, and scientific workflow tools such as Nextflow, Snakemake, VisTrails, or Cromwell Experience with application performance tuning and optimization, including in parallel and distributed computing paradigms and communication ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
Microsoft Data Stack (Azure Data Factory, Data Lake Storage, Fabric or Synapse Analytics) Expert-level proficiency in PySpark/Python Applied experience of DBT, AirFlow, or similar for data transformation and orchestration Deep understanding of data modeling, warehousing concepts, and the Medallion (Bronze/Silver/Gold) architecture Excellent ...

Data Engineer

Location
Greater London, England, United Kingdom
looking for in you: 3+ years of experience You have an understanding of developing ETL pipelines using Python frameworks such as luigi or airflow; You have experience with the development of Python-based REST APIs/services and their integration with databases (e.g. Postgres); You are familiar with ...

Compute Platform Engineer II

Hiring Organisation
GSK
Location
Greater London, United Kingdom
Employment Type
Full Time
common CI/CD stack (e.g., Jenkins, CircleCI, GitLab, Azure DevOps) Experience in workflow orchestration with tools such as Argo Workflow, Airflow, and scientific workflow tools such as Nextflow, Snakemake, VisTrails, or Cromwell Experience with application performance tuning and optimization, including in parallel and distributed computing paradigms and communication ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
related field. Solid programming skills in both Python and SQL. Proven work experience in Google Cloud Platform or other clouds, developing batch (Apache Airflow) and streaming (Dataflow) scalable data pipelines. Passion for processing large datasets at scale (BigQuery, Apache Druid, Elasticsearch) Familiarity with Terraform, DBT & Looker … core company values and remind them that they're all in this together to drive positive change in our industry. SKILLS AND CERTIFICATIONS Airflow Python SQL GCP BigQuery CANDIDATE DETAILS 5+ to 7 years experience Seniority Level - Mid-Senior Management Experience Required - No Minimum Education - Bachelor's Degree Willingness ...

Senior Data Scientist (UK)

Location
Sale, England, United Kingdom
client communication, presentations), Expertise in at least one of the following domains: Experience with TensorFlow, PyTorch, XGBoost, LightGBM, Proficiency with Git, Linux, Docker, MLflow, Airflow, AWS/GCP/Azure, Solid SQL and data visualization skills. Additional Information Nice to have: Proven experience leading projects and managing teams, Experience ...

Data Engineer

Location
Cambridge, England, United Kingdom
Including familiarity with data related AWS technologies (e.g. Redshift). Strong programming skills and substantial experience designing and building data pipelines (e.g. Python, SQL, Airflow). Experience in data standardisation and QA techniques. Experience working with data observability tools. Experience integrating data with visualisation and business intelligence tools (e.g. ...

ML Engineer

Hiring Organisation
Global
Location
Greater London, United Kingdom
Employment Type
Full Time
production, detect model and data drift, and put safeguards in place to defend against it. Orchestration: Familiarity with workflow orchestration tools such as Airflow or similar, and an understanding of how to schedule, monitor and maintain dependable data and model pipelines. Real-time ML & reproducibility: A good understanding ...

Data Foundation Lead

Location
City Of London, England, United Kingdom
next. Cloud: AWS, GCP, Azure Ingestion: Fivetran, Airbyte, ... Warehouse and lakehouse: Snowflake, Databricks, BigQuery, Microsoft Fabric Transformation: dbt Orchestration: Airflow, Dagster, Prefect, ... BI and semantic layers: Power BI, Looker, Tableau, ... Activation and CDPs: Hightouch, Census, Segment, ... Nice to have Building the data side of agentic ...

Senior Machine Learning Engineer

Location
City Of London, England, United Kingdom
production (not just training models in notebooks), including familiarity with serving patterns (e.g., REST APIs, batch inference, event-driven) Experience with orchestration tools (e.g., Airflow, Dagster) and cloud-native ML platforms (e.g., AWS SageMaker, GCP Vertex AI) Ability to influence decision-making regarding infrastructure and tooling, balancing 'build vs. ...