126 to 150 of 339 Apache Airflow Jobs in England

Senior Machine Learning Engineer, Ranking

Location
Greater London, England, United Kingdom
Spark and Databricks AWS services (e.g. IAM, S3, Redis, ECS) CI/CD tooling and best practices Streaming and batch data systems (e.g. Kafka, Airflow, RabbitMQ) Additional Information Health + Mental Wellbeing PMI and cash plan healthcare access with Bupa Subsidised counselling and coaching with Self Space Cycle ...

Senior Manager, Data Analytics

Location
Greater London, England, United Kingdom
quantitative or technical discipline* Experience deploying AI/ML solutions at scale (recommendation engines, demand forecasting, etc.)* Familiarity with automation/orchestration platforms (Airflow, Prefect) and MLOps tooling* Prior success influencing global data‐culture change and promoting data‐centric decision makingPlease be advised that we are unable to provide ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
experience as a Data Engineer or Senior Data Engineer Expert-level Python development skills Extensive hands-on experience with Databricks in enterprise environments Strong Apache Spark and PySpark expertise Advanced SQL development and optimisation skills Experience designing and building large-scale ETL and data integration solutions Strong understanding … environments Exposure to risk, trading, treasury or regulatory data domains Experience with Kafka, streaming technologies or real-time data processing Databricks certifications Experience with Airflow, Databricks Workflows or similar orchestration tools CI/CD pipeline development and DevOps practices Docker and Kubernetes Experience supporting data science or machine learning ...

Data Engineer London

Location
Greater London, England, United Kingdom
environments. Technical Skills: Experience building and operating ETL/ELT pipelines. Hands-on experience with modern data stacks — our tech includes Python, SQL, Snowflake, Apache Iceberg, AWS S3, PostgresDB, Airflow, dbt, and Apache Spark, deployed via AWS, Docker, and Terraform (experience with some of these or similar ...

Senior Python Software Engineer

Location
Greater London, England, United Kingdom
Familiarity with PostgreSQL and Snowflake Preferred: Familiarity with Web Frameworks such as Django, Flask or FastAPI Preferred: Familiarity with event streaming platforms such as Apache Kafka Preferred: Familiarity with data pipeline platforms such as Apache Airflow Preferred: Familiarity with Java Preferred: Experience in one or more relevant ...

Senior Software Engineer, Full-Stack Applications (Python)

Location
Manchester, England, United Kingdom
concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications Advanced Data Management – Strong SQL design, query optimization, and database architecture expertise Observability ...

Senior Software Engineer, Full-Stack Applications (Python)

Hiring Organisation
Fitch Group
Location
Manchester, United Kingdom
Employment Type
Full Time
concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications • Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications • Advanced Data Management – Strong SQL design, query optimization, and database architecture expertise • Observability ...

Lead Data Engineer

Hiring Organisation
Tria
Location
London, United Kingdom
Employment Type
Permanent
Salary
£90000 - £95000/annum
solution design responsibility. You'll ideally have: Strong commercial experience with Python & Snowflake Experience mentoring or technically leading other engineers Experience with dbt, Airflow or similar data engineering tooling A good understanding of data modelling and modern data platform architecture Experience working with AWS (ideally) or another major cloud ...

AWS Data Engineer - PySpark/AI

Location
City Of London, England, United Kingdom
documentation Experience required: Strong SQL skills for transforming, cleaning and loading data Commercial Python, PySpark and Pandas experience Experience with orchestration tools such as Airflow, Dagster or Celery Practical experience with Spark and EMRHands-on knowledge of AWS services, including Lambda, RDS and S3 Experience using Claude Code ...

Data Scientist

Location
Greater London, England, United Kingdom
join our dynamic, expanding team. Over the last few years we’ve built a solid data foundation using best in class technologies (dbt, BigQuery, Airflow) and are just at the start of our journey to leverage this data in a more sophisticated way. About Zapp: Zapp is London ...

Data Developers

Location
Newcastle upon Tyne, England, United Kingdom
pipelines. Proficiency in SQL, Python, AWS, and other modern data engineering technologies. Experience with version control tools (e.g., Git) and workflow orchestration platforms (e.g., Airflow). Proven ability to test, troubleshoot, and improve data platforms, ensuring high levels of reliability and data quality. Strong interpersonal and communication skills with ...

Data Engineer

Location
Luton, England, United Kingdom
development tasks as needed What you bring to the team Strong Python and SQL skills Experience building or maintaining ETL/ELT pipelines — dbt, Airflow, Dagster, AWS Glue or similar Experience working with cloud data platforms (AWS, Azure or GCP) A solid understanding of data modelling principles The ability ...

Quantitative Software Engineer (DV Commodities) London

Location
Greater London, England, United Kingdom
algorithms, design patterns, and OOP; Java or C++ is a plus Experience working in a Unix environment and git Familiarity with Kafka, Docker, Airflow, or Luigi Strong communication skills in verbal and written English, with the ability to work closely with traders Domain knowledge in energy markets, futures ...

Newcastle - Data Engineer (All Levels) Newcastle

Location
Newcastle upon Tyne, England, United Kingdom
building data pipelines Proficient in SQL, Python, AWS and other data management technologies Familiarity with version control systems like Git and orchestration tools like Airflow Ability to test and troubleshoot data platforms reliably. A track record of improving data reliability and quality Excellent communication skills and the ability ...

Principal Architect, Data

Location
Greater London, England, United Kingdom
data ecosystem, particularly BigQuery. Advanced SQL skills and strong experience with Python. Strong experience with modern data engineering and orchestration technologies such as dbt, Airflow/Cloud Composer, and related tools. Experience designing scalable data platforms, pipelines, data models, and integration patterns. Strong understanding of data governance, security, quality ...

Full Stack Engineer (Investment Platform)

Hiring Organisation
St. James's Place
Location
Gloucestershire, United Kingdom
Employment Type
Full Time
development (React/JavaScript or similar) and web framework (Flask/Django/FastAPI) Highly capable in data pipelining using tools like Airflow & DBT, and data extraction, manipulation and reporting using Python & SQL. Experience with code versioning, optimisation and associated best practices, including Git, pull requests, unit testing ...

Machine Learning Engineer

Location
Greater London, England, United Kingdom
model serving via REST/gRPC APIs, Docker and Kubernetes or equivalent AWS experience (e.g. S3, compute, managed ML services) Data pipelines and orchestration (Airflow or similar), including third-party API integration CI/CD, infrastructure-as-code and observability tooling Experience in high-availability environments where outages affect ...

Finance Data Manager

Location
Greater London, England, United Kingdom
data modelling Databricks as our datalake platform Kubernetes for data services Orchestra for task orchestration Terraform for infrastructure Lightdash for data applications Airflow and Astronomer for job scheduling and tracking Circle CI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Spark for data ...

Lead Data Scientist - Receive Risk

Hiring Organisation
Wise
Location
Greater London, United Kingdom
Employment Type
Full Time
help refine problem statements and figure out how to solve them Some extra skills that are great (but not essential): Experience with MLOps tools: Airflow, MLflow, AWS SageMaker, AWS S3, AWS EMR, CI/CD Prior experience in the fraud domain and a strong understanding of fraud detection techniques ...

Lead Data Scientist Digital & IT London, UK Support Office View Role

Location
Greater London, England, United Kingdom
standards: version control, model registry, documentation and governance Work with Data Engineering to put models into production on our stack (GCP, Snowflake, Airflow), with reliable scoring pipelines and outputs that downstream tools and teams can use Build monitoring and observability for model accuracy in production (tracked against agreed thresholds ...

Quantitative Software Engineer (DV Commodities)

Location
Greater London, England, United Kingdom
algorithms, design patterns, and OOP; Java or C++ is a plus Experience working in a Unix environment and git Familiarity with Kafka, Docker, Airflow, or Luigi Strong communication skills in verbal and written English, with the ability to work closely with traders Domain knowledge in energy markets, futures ...

Lead Data Scientist - Receive Risk

Location
Greater London, England, United Kingdom
help refine problem statements and figure out how to solve them Some extra skills that are great (but not essential): Experience with MLOps tools: Airflow, MLflow, AWS SageMaker, AWS S3, AWS EMR, CI/CD Prior experience in the fraud domain and a strong understanding of fraud detection techniques ...

Senior Analytics Engineer

Location
Greater London, England, United Kingdom
stakeholders to the right data solutions Familiarity with using AI tools to accelerate your workflow Nice to Have Experience with orchestration tools like Dagster, Airflow, or similar Experience building real-time or near-real-time data pipelines Familiarity with machine learning workflows and feature engineering Experience embedded in teams ...

Full Stack Engineer (Investment Platform)

Location
Greater London, England, United Kingdom
delivering real business value. Experienced in building & maintaining applications to support internal business processes and workflows. Highly capable in data pipelining using tools like Airflow & DBT, and data extraction, manipulation and reporting using Python & SQL. Experience with code versioning, optimisation and associated best practices, including Git, pull requests, unit ...

Applied AI, Frontier Data Engineering, Staff

Hiring Organisation
Mistral AI
Location
London, England, United Kingdom
experience building and running production data-intensive pipelines with distributed processing (for example Spark, Ray, Beam, or Dask) and orchestration tools (for example Airflow, Dagster, or Prefect) with structured and unstructured data. You have experience with retrieval-augmented generation, agentic use cases, or LLM evaluation, and a clear view ...