76 to 100 of 191 Apache Airflow Jobs in England

tools such as Streamlit, FastAPI, or Flask, enabling business stakeholders to interact directly with model outputs.Experience with orchestration or transformation tooling such as dbt, Airflow, or Prefect, demonstrating an ability to build reproducible and maintainable pipelines.A tech-agnostic mindset, open to selecting the right tool for each problem — whether ...

tools such as Streamlit, FastAPI, or Flask, enabling business stakeholders to interact directly with model outputs.Experience with orchestration or transformation tooling such as dbt, Airflow, or Prefect, demonstrating an ability to build reproducible and maintainable pipelines.A tech-agnostic mindset, open to selecting the right tool for each problem — whether ...

common CI/CD stack (e.g., Jenkins, CircleCI, GitLab, Azure DevOps) Experience in workflow orchestration with tools such as Argo Workflow, Airflow, and scientific workflow tools such as Nextflow, Snakemake, VisTrails, or Cromwell Experience with application performance tuning and optimization, including in parallel and distributed computing paradigms and communication ...

concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications • Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications • Advanced Data Management – Strong SQL design, query optimization, and database architecture expertise • Observability ...

/SD/PP etc.) required for December cutover. Build scalable ingestion pipelines using Delta Lake/Parquet and modern orchestration tools (ADF, dbx, Airflow, etc.). Collaborate with SAP functional teams to validate business logic, deltas, and data quality. Implement CI/CD and DevOps practices for data ...

with experience handling large datasets Experience building and maintaining ETL/ELT pipelines in production environments Hands-on experience with workflow orchestration tools (e.g. Airflow ...

preferred) or similar platforms: Snowflake, BigQuery, Redshift, Synapse, or equivalent Strong proficiency with: SQL (advanced level) Spark/PySpark Data pipeline orchestration tools (e.g., Airflow, ADF, etc.) Data Modelling Extensive experience designing: Fact and dimension tables Star and snowflake schemas Aggregation layers and semantic models Data Migration & Mapping Demonstrated ...

operating production data systems Strong SQL and Python skills with expertise in large-scale data processing Hands-on experience with modern data stack tools — Airflow, dbt, ClickHouse, BigQuery, Snowflake, or similar Experience with event-driven, real-time or near real-time architectures A first-class approach to data correctness ...

with Snowflake. Knowledge of MongoDB or other NoSQL databases. Experience working within AWS or other cloud environments. Familiarity with workflow orchestration tools such as Airflow, Prefect or Dagster. Experience with market data providers such as Bloomberg, Refinitiv or ICE. Exposure to enterprise data management platforms. Knowledge of Kafka ...

implementing batch and stream data processing systems. Experience with Datadog, SQL, Terraform, Docker, AWS (ECS, Kinesis, SQS, CloudWatch), GCP (BigQuery). Knowledge of Airflow, Kafka, Flink, dbt, Kubernetes is highly beneficial. Good understanding of AI platforms, experience building infrastructure for LLM orchestration (e.g., vector databases, RAG pipelines, GPU scaling ...

with Snowflake. Knowledge of MongoDB or other NoSQL databases. Experience working within AWS or other cloud environments. Familiarity with workflow orchestration tools such as Airflow, Prefect or Dagster. Experience with market data providers such as Bloomberg, Refinitiv or ICE. Exposure to enterprise data management platforms. Knowledge of Kafka ...

Strong hands‐on background with modern cloud data platforms (AWS/GCP/Azure) Expertise across Python, SQL and data orchestration tools such as Airflow Experience building scalable data pipelines and data platforms in a fast‐paced fintech or technology environment A collaborative leadership style with the ability ...

Strong hands-on background with modern cloud data platforms (AWS/GCP/Azure) Expertise across Python, SQL and data orchestration tools such as Airflow Experience building scalable data pipelines and data platforms in a fast-paced fintech or technology environment A collaborative leadership style with the ability ...

Experience with CI/CD, microservices, TDD/BDD. Knowledge of secure system design. Desirable (AI & Data) Vector DBs: Milvus, Weaviate, Pinecone Data orchestration: Airflow, Prefect, Dagster Search: ElasticSearch/OpenSearch AI frameworks: LangChain, Hugging Face MLOps: MLflow, Kubeflow If you are looking for an opportunity to work ...

working as a Data Engineer Strong understanding of data engineering principles, ETL processes and data warehousing concepts Experience using workflow orchestration tools such as Airflow to schedule, monitor and manage data pipelines Experience working with at least one major cloud data platform, preferably Azure Strong data modelling skills, including ...

Python and SQL, familiarity with Scala or R advantageous Experience with data orchestration and workflow management tooling such as Azure Data Factory or Airflow Please see full job description attached. What you can expect from us We believe doing your best work starts with feeling supported both professionally ...

platforms and pipelines (batch and real-time ingestion). Hands-on familiarity with: Snowflake (or equivalent cloud data warehouse), Looker (or other BI tools), Airflow, Pub/Sub, or similar orchestration and ingestion frameworks. Experience with data infrastructure monitoring and optimization. Strong communication skills. Ability to translate business goals ...

improvements What will set you apart Hands-on experience with the modern data stack, for example Iceberg or Delta, Snowflake or Databricks, dbt or Airflow Experience with a data migration or re-platforming project, on either the product or the engineering side Experience in financial services or another regulated ...

Kubernetes and modern containerised deployment patterns Strong experience with CI/CD pipelines, infrastructure-as-code and workflow orchestration Experience with tools such as Airflow or similar platform and orchestration technologies Good understanding of model observability, data quality, feature pipelines, lineage and reproducibility Experience designing scalable infrastructure ...

working across cloud-based data systems (GCP), building and deploying data pipelines and production ML workflows. Experience with orchestration tools (e.g. Airflow or similar), CI/CD, and model deployment practices is beneficial. The salary on offer for this role is £65000- £75000 depending on experience. We also offer ...

working across cloud-based data systems (GCP), building and deploying data pipelines and production ML workflows. Experience with orchestration tools (e.g. Airflow or similar), CI/CD, and model deployment practices is beneficial. The salary on offer for this role is £65000- £75000 depending on experience. We also offer ...

Cloud Run), AWS (Bedrock, SageMaker) Experience building and automating AI/ML pipelines using tools such as MLflow, Kubeflow, Azure ML, Vertex Pipelines, Airflow or Google ADK Hands-on experience with Generative and Agentic AI frameworks such as LangChain, LlamaIndex, CrewAI, Autogen, Google ADK, or similar. Ability to design ...

Kubernetes and modern containerised deployment patterns Strong experience with CI/CD pipelines, infrastructure-as-code and workflow orchestration Experience with tools such as Airflow or similar platform and orchestration technologies Good understanding of model observability, data quality, feature pipelines, lineage and reproducibility Experience designing scalable infrastructure ...

Kubernetes and modern containerised deployment patterns Strong experience with CI/CD pipelines, infrastructure-as-code and workflow orchestration Experience with tools such as Airflow or similar platform and orchestration technologies Good understanding of model observability, data quality, feature pipelines, lineage and reproducibility Experience designing scalable infrastructure ...

Kubernetes and modern containerised deployment patterns Strong experience with CI/CD pipelines, infrastructure-as-code and workflow orchestration Experience with tools such as Airflow or similar platform and orchestration technologies Good understanding of model observability, data quality, feature pipelines, lineage and reproducibility Experience designing scalable infrastructure ...