101 to 125 of 339 Apache Airflow Jobs in England

Senior Platform Engineer

Location
Greater London, England, United Kingdom
hands‐on experience in at least one data area and one platform area below. Data experience Orchestration: operating pipelines with tools such as Airflow, Dagster or Prefect, including dependencies, retries, backfills, reruns or schema changes. Storage and modelling: designing schemas and storage for relational databases, warehouses or lakehouses ...

Principal - Cloud Data Architect

Location
Greater London, England, United Kingdom
implementation of modern data architectures and concepts such as cloud services (e.g., AWS, Azure, GCP), real-time data distribution (e.g., Kafka, Kinesis, DataFlow, Airflow), NoSQL (e.g., MongoDB, DynamoDB, HBase, CosmosDB), GraphQL and modern data warehouse tools including Snowflake and DataBricks Ability to think strategically and relate architectural decisions ...

Head of Data Platform Engineering

Location
Greater London, England, United Kingdom
engineering teams and managers. Hands‐on coding: Production‐level SQL, Python, and Terraform. Modern Cloud Data Stack: Deep expertise in BigQuery, Cloud Composer/Airflow, and Pub/Sub, Dataflow, or Kafka. Platform & DevOps: Experience with Terraform, Kubernetes, Docker, CI/CD, and observability. Data Architecture: Strong background ...

Software Development Engineer III

Location
Greater London, England, United Kingdom
assistants as part of the software development lifecycle.* Experience designing, building, and operating data pipelines and ETL/ELT workflows using Databricks, dbt, and Apache Airflow.**Preferred Skills & Experience*** Experience with frameworks like ReactJS, Angular, or Vue.js to build interactive and responsive user interface.* Experience building or designing scalable ...

Forward Deployed Solution Engineer – AppliedAI FDE

Location
Royal Borough of Greenwich, England, United Kingdom
Python, Node.js, Java), frontend (React, Angular), APIs (REST/GraphQL) Machine Learning: Foundations of MLflow, Weights & Biases, LoRA, PEFT, SageMaker, Vertex AI, AzureML, Kubeflow, Airflow, Prefect, TorchServe, Triton, vLLM, SHAP, LIME, pandas, Spark, SQL LLM tooling: Familiarity with LangChain, Semantic Kernel, prompt chaining, vector search, and context management Performance ...

AI Software Engineer

Location
Colchester, England, United Kingdom
analytics Model and manage data across data warehouses and lakes and operational databases Build batch and streaming workflows, orchestrated with tools such as Airflow, Prefect, Dagster, or dbt Own data quality, validation, lineage, and observability ensuring the data feeding our models is accurate, timely, and trustworthy Engineer features … similar) Technical Skills Python (essential) – pandas, NumPy, and the modern data/ML ecosystem SQL – advanced querying, modelling, and optimisation Data pipelines & orchestration – Airflow, Prefect, Dagster, or dbt Data warehouses/lakes – BigQuery, Snowflake, Redshift, or Databricks ML frameworks – PyTorch, TensorFlow, or scikit‐learn LLM & AI tooling – OpenAI, Anthropic ...

Senior Data Engineer London

Location
Greater London, England, United Kingdom
operating ETL/ELT pipelines and large-scale data architectures. Hands-on experience with modern data stacks — our tech includes Python, SQL, Snowflake, Apache Iceberg, AWS S3, PostgresDB, Airflow, dbt, and Apache Spark, deployed via AWS, Docker, and Terraform (experience with similar technologies is essential). Ability ...

MLOps Engineer

Location
Greater London, England, United Kingdom
scripts and CI/CD automationWorking knowledge of modern MLOps stacks including experiment tracking and artifact managementHands-on experience with orchestration tools (e.g., Kubeflow, Apache Airflow, Metaflow or Prefect)Demonstrated skills with Docker, Kubernetes and distributed deploymentsPractical knowledge of Infrastructure-as-Code (Terraform) and a major cloud provider ...

FinTech MLOps Engineer

Location
Greater London, England, United Kingdom
Strong experience with ML infrastructure — you've deployed and operated models in production. Comfortable with Python and the modern ML tooling ecosystem (MLflow, Kubeflow, Airflow, or similar). Deep understanding of containerization and orchestration (Docker, Kubernetes). Experience with cloud platforms (AWS, GCP, or Azure) and infrastructure-as-code. ...

Machine Learning Engineer

Location
Havant, England, United Kingdom
Docker e Kubernetes Esperienza con MLOps e strumenti di model monitoring Familiarità con framework NLP e soluzioni Generative AI Esperienza con orchestrazione pipeline (Airflow, MLFlow, Azure ML, ecc.) Conoscenza di pratiche DevOps e Infrastructure as Code Esperienza in ambienti Agile/Scrum Buone capacità comunicative e di collaborazione cross ...

Data Engineer

Location
Greater London, England, United Kingdom
large tables. Python for data transformation and pipeline orchestration. Experience with a distributed query engine (Presto, Spark, Hive or similar) and a workflowscheduler (Airflow or similar). Comfortable working in a code review based workflow with Git. Ability to work as part of a team, as well as work ...

AI Architect

Location
Greater London, England, United Kingdom
solution design, enterprise architecture, or technical consulting. Desirable Skills Experience with LangChain, LlamaIndex, Azure OpenAI, AI Foundry, GPT-4, Claude, LLaMA, Hugging Face, MLflow, Airflow, KServe, FAISS, Chroma, or similar technologies. Experience designing multi-agent workflows and autonomous LLM integrations. Knowledge of AI governance, responsible AI, explainability, auditability ...

Senior Data Engineer, Proprietary Research

Location
Greater London, England, United Kingdom
Experience with cloud platforms and services for data storage and compute (for example AWS, Google Cloud Platform, or Azure) Experience with orchestration technologies like Airflow Knowledge of/experience with langraph/langchain or similar frameworks, embedding models, vector, graph databases is a plus A strong drive to staying ...

Director, Data Platforms & AI Strategy

Location
Greater London, England, United Kingdom
systems, orchestration, governance, and scalable data product design - Experience with technologies and ecosystems such as GCP, AWS, Azure, Databricks, Snowflake, Kafka, Spark, dbt, Kubernetes, Airflow, ML/AI enablement, or similar modern platform tooling - Strong commercial acumen and ability to engage credibly with senior technical and business stakeholders - Experience ...

Senior Analytics Engineer

Location
Greater London, England, United Kingdom
scalable data assets that can be used in BI and other user facing tools. Experience working with data pipeline orchestration tools like Prefect or Airflow and comfortable working with Python for data orchestration. Ability to communicate clearly with both technical and non-technical stakeholders, translating data into business value. ...

Data Engineer

Hiring Organisation
Step 2 Recruitment
Location
London, United Kingdom
Employment Type
Permanent
Salary
£50000 - £80000/annum
orchestration It would be nice if you could bring (desirables): Professional experience with PySpark, MySQL, Docker, Kubernetes Experience with best-practice pipeline orchestration software (Airflow, Dagster). Experience migrating code from prototype notebooks to .py, while maintaining logic and transparency of underlying code Owned a project across a whole ...

Senior Software Engineer (AI/Data)

Location
Greater London, England, United Kingdom
tests, and you leave things tidier than you found them. Depth in at least one of SQL, Spark, Databricks/Delta Lake, Dagster/Airflow/Temporal or dbt. Bonus if you’ve shaped any of them into something a model can query, through a metrics layer, metric views ...

Data Scientists London, England, United Kingdom

Location
Greater London, England, United Kingdom
MLflow) Experience with cloud‐based ML tools (e.g., SageMaker), data and model versioning (e.g., DVC), CI/CD (e.g., GitHub Actions), workflow orchestration (e.g., Airflow/Dagster) and containerised solutions (e.g., Docker, ECS) nice to have Experience in code testing (unit, integration, end‐to‐end tests) Strong data engineering ...

Data Scientist - QuantumBlack, AI by McKinsey

Location
Greater London, England, United Kingdom
environments is a plus While we advocate using the right tech for the right task, we often leverage: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open‐source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such as AWS, GCP, and Azure Familiarity with ...

Senior ML Engineer

Location
Manchester, England, United Kingdom
practical experience. Preferred Skills Experience with gradient-boosted tree models, neural networks, and optimization solvers in production. Familiarity with data orchestration tools (e.g., Prefect, Airflow, dbt) and modern data lake architectures. Experience working closely with data scientists to operationalize research code. Multi-cloud experience across AWS, GCP, and Azure. ...

Senior MLOps Engineer

Location
Greater London, England, United Kingdom
Bedrock AgentCore or similar Experience with managed or self-hosted ML infrastructure, such as Amazon SageMaker, feature stores (e.g. Feast) and DAG tooling (e.g. Airflow, Metaflow, or similar) Experience with model experiment tracking, ideally MLflow or Weights & Biases, and with monitoring tools such as EvidentlyAI, CometML, Grafana ...

Senior Analytics Engineer

Location
Manchester, England, United Kingdom
infrastructure Databricks Delta Lake for data lake and warehouse storage and querying dbt(TM) for data modelling and transformations Python as main scripting language Airflow for task scheduling Kubernetes for orchestration Github and Circle CI for version control, deployment and monitoring What you'll do: Become a subject matter ...

Senior Analytics Engineer

Location
Greater London, England, United Kingdom
infrastructure Databricks Delta Lake for data lake and warehouse storage and querying dbt(TM) for data modelling and transformations Python as main scripting language Airflow for task scheduling Kubernetes for orchestration Github and Circle CI for version control, deployment and monitoring What you'll do: Become a subject matter ...

Analytics Engineering Manager

Location
Greater London, England, United Kingdom
metrics layers. Experience applying AI to Analytics Engineering workflows or developing AI-ready data products. Knowledge of orchestration and ingestion tools such as Airflow,DagsterorFivetran. Python experience for automation or data engineering tasks. Experience working in regulated financial services or another highly data-driven organisation. Snowflake experience, given ...