76 to 100 of 141 Apache Airflow Jobs in England

will shape what modern data infrastructure looks like in this space. You’ll take full ownership of the backend, building custom data pipelines, orchestrating Airflow‐style workflows, and turning messy real‐world inputs into structured data ready for downstream AI models. You’ll design APIs, optimise low‐latency queries ...

cloud‐native architectures, with experience shaping technical direction across teams and stakeholders Solid expertise in relevant technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg or similar table formats ...

abstraction layers Model the cost, feasibility and risk of different LLMs and implementation approaches THE STACK AWS, Bedrock, LangGraph, LangChain, Python, FastAPI, PostgreSQL, Snowflake, Airflow, React, Next.js, Kubernetes. YOUR EXPERIENCE 15+ years in enterprise software engineering with a background in product engineering organisations or technology companies Deeply technical: recent ...

tools like Looker, Grafana, Lightdash, or Superset Ability to build and manage data pipelines that are modularised and scalable, using tools like DBT and Airflow Some experience with Python/data transformation (DBT, etc.) This is not a data engineering role, depth in pipelines is less important than impact ...

cloud-native architectures, with experience shaping technical direction across teams and stakeholders Solid expertise in relevant technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg or similar table formats ...

similar databases. Experience designing data models, schemas and transformation layers for complex datasets. Experience with directed acyclic graph-based orchestration tools such as Airflow, Dagster, Prefect or similar systems. Familiarity with data warehouses, object storage, queues, APIs and cloud infrastructure. Experience with data quality testing, lineage, observability, versioning ...

platforms and pipelines (batch and real-time ingestion). Hands-on familiarity with: Snowflake (or equivalent cloud data warehouse), Looker (or other BI tools), Airflow, Pub/Sub, or similar orchestration and ingestion frameworks. Experience with data infrastructure monitoring and optimization. Strong communication skills. Ability to translate business goals ...

environments and know how to bring out the best in people. Technically strong: You're comfortable with modern data stacks like Databricks, Spark, Airflow, SQL and Python - and you can go deep when needed. Cloud-savvy: You understand distributed systems and cloud platforms, and how to make them work ...

management. Data Center Optimization Collaborate with facilities and operations teams to optimize infrastructure deployments based on available rack space, power draw, thermal dynamics, and airflow efficiency. Contribute to the planning and provisioning of data center resources, ensuring support for both traditional workloads and AI‐intensive environments. Evaluate emerging technologies ...

visualisation languages and libraries (SQL, python, matplotlib, etc.) as well as some of the supporting tools and platforms (e.g. git, MLFlow, Kubernetes, Kubeflow, Trino, AirFlow). A strong understanding of statistical concepts (hypothesis testing, sampling, probability distributions). Excellent communication and collaboration skills to effectively bridge the gap between ...

tools like Looker, Grafana, Lightdash, or Superset Ability to build and manage data pipelines that are modularised and scalable, using tools like DBT and Airflow Familiarity with observability/reliability concepts (SLIs, SLOs, incidents) Some experience with Python/data transformation (DBT, etc.) is helpful This ...

APIs can be exposed to LLM-based agents. Experience with search relevance & recommendation systems - ranking algorithms, semantic search, personalisation. Hands-on with Snowflake, Databricks, Airflow, Kafka . Why Join Us Work on firm-wide platforms used by thousands of data scientists, ML engineers, and analysts across JPMC Shape ...

specialist consultancy renowned for delivering mission-critical solutions, working with modern technologies in a secure, cutting-edge environment Key Skills required: - PyTorch - TensorFlow - SciKit - Airflow or Prefect - ML flow (really nice to have) - Python - SQL - Data Modelling This role will require an active SC Clearance and British Citizenship ...

Python, Bash, Ansible, Puppet) Familiarity with containerisation (Docker, Kubernetes) Nice to have: Experience with CI/CD pipelines (GitLab, Jenkins) Exposure to data tooling (Airflow, NiFi, Elasticsearch) Experience with Cloudera/Hadoop ecosystems (Spark, Hive, HDFS) Why join? Work on modern data platforms at scale Collaborate with data scientists ...

Looking For Strong experience designing and building scalable data pipelines Proficiency in SQL, Python, Databricks or Azure Experience with tools such as Git and Airflow Proven ability to test, troubleshoot and improve data platforms Experience delivering high-quality, reliable data solutions Strong communication skills and ability to work ...

production Solid software engineering skills (Python, APIs, systems) Good understanding of MLOps stack (CI/CD, monitoring, pipelines) Familiarity with tools like MLflow, Airflow, Evidently, DVC, Docker, Kubernetes. Cloud experience (AWS/GCP/Azure) Some mentoring/leadership experience + desire to grow into management Nice to have ...

turning that into product improvements Hands-on experience with the modern data stack, for example Iceberg or Delta, Snowflake or Databricks, dbt or Airflow Experience with a data migration or re-platforming project, on either the product or the engineering side Experience in financial services or another regulated industry ...

building data pipelines Proficient in SQL, Python, AWS and other data management technologies Familiarity with version control systems like Git and orchestration tools like Airflow Ability to test and troubleshoot data platforms reliably. A track record of improving data reliability and quality Excellent communication skills and the ability ...

happens next. Technical Mastery : You bring expert-level SQL skills and are fully comfortable building and maintaining your own robust data pipelines using dbt, Airflow, and Snowflake. Beyond querying, you use Python for advanced automation and forecasting, and you apply statistical rigor (e.g., Bayesian statistics, causal inference) to solve ...

individual model work. Strong software engineering fundamentals - you build reliable, well‐tested, maintainable systems. Python, Kotlin/Java, SQL. Experience with ML orchestration (Airflow, Kubeflow, or equivalent), model registries (MLflow or similar), and container‐based deployment End‐to‐end understanding of the ML lifecycle - data ingestion through training, packaging ...

treasury or liquidity management domains. You are proficient with SQL and know your way around data pipeline management tools such as Snowflake, dbt, Git, Airflow, Python, and Lightdash. You're comfortable owning analytics from data transformation through to delivering actionable insights. Able to translate your analysis into impact ...

individual model work. Strong software engineering fundamentals - you build reliable, well-tested, maintainable systems. Python, Kotlin/Java, SQL. Experience with ML orchestration (Airflow, Kubeflow, or equivalent), model registries (MLflow or similar), and container-based deployment End-to-end understanding of the ML lifecycle - data ingestion through training, packaging ...

forecasting, and statistical modeling in a product environment. Expertise in Python or R, fluency in SQL, and experience with large‐scale data tech (Databricks, Airflow, dBT a plus). Experience with FinTech, payments, crypto, or blockchain data is a strong plus. Advanced degree (MS, PhD) in a quantitative field ...

PostgreSQL (or similar relational databases) and NoSQL databases. Experience with vector databases such as Qdrant, Milvus or pgvector . Familiarity with technologies such as Apache Spark, Airflow, Kafka, Elasticsearch/OpenSearch, Pandas and Polars . Strong understanding of data modelling, storage architecture and performance optimisation. Desirable Experience working ...

love to see: Knowledge of Database Systems and trade offs in the distributed systems Familiarity with API Designs Familiarity with Orchestration Frameworks such as Apache Airflow, Argo Workflows, Dagster etc. Experience working with and designing systems utilizing AWS If indicated, please note that years of experience ...