151 to 175 of 339 Apache Airflow Jobs in England

Senior Analytics Engineer

Location
Greater London, England, United Kingdom
scale: incremental versus full refresh, clustering, and a lag target a consumer needs. Orchestration. You have scheduled, monitored, and repaired a pipeline in Airflow, Dagster, or an equivalent. CI/CD and deployment management. You have run a project where a pull request builds the changed models and their ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools andtechnologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such asrelational, non-relational, or cloud-based. Working collaboratively with the client …/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving ...

Senior Data Engineer - Security Cleared

Hiring Organisation
Hackajob Ltd
Location
South West London, South East, United Kingdom
Employment Type
Permanent Contract, On-site
schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the client …/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving ...

Secure Data Engineer

Location
Newcastle upon Tyne, England, United Kingdom
will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations.We are looking … relational or analytical storage technologies. Examples include Kafka, Spark, PostgreSQL.* **Orchestration** Experience defining and running data workflows using modern orchestration frameworks. Examples include Airflow, Dagster or Prefect.* **Data Quality and Lineage** Familiarity with tools and techniques for data testing, documentation and lineage. Examples include Great Expectations or dbt. ...

Lead Data Engineer

Location
Greater London, England, United Kingdom
Experience Platform, etc.), spanning both traditional data engineering and marketing technology ecosystems. Implementation : Ensure correct adoption of modern data stacks using dbt, orchestration tools (Airflow), infrastructure-as-code (Terraform), and ELT/ETL frameworks, with a focus on analytics‐ready data models. Serve as the final technical escalation resource … data engineering experience building production data pipelines and data warehouses. Management experience of data teams Deep expertise in the modern data stack : dbt, Airflow, Terraform, and cloud data platforms (GCP BigQuery, Snowflake). Strong architectural skills with a deep understanding of data modeling, quality, and governance. Proficiency ...

AI Infrastructure Architect

Location
Greater London, England, United Kingdom
preferred knowledge of AI infrastructure. Proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Proven experience ...

Systems Integration Specialist

Location
Greater London, England, United Kingdom
Experience with Slack, Jira, GitHub or equivalent version control, Google Platform or equivalent cloud platforms. Nice to have Experience of using tools such as Apache Airflow, Mode Analytics, Terraform. Experience of New Product Introduction (NPI) processes or onboarding new products and features into a delivery pipeline. Experience with ...

Supply Chain and Ops AI infrastructure Architect

Location
City Of London, England, United Kingdom
preferred knowledge of AI infrastructure. Proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Professional experience ...

AI Infrastructure Lead Architect

Location
City Of London, England, United Kingdom
knowledge of AI infrastructure. Good proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem‐solving skills and ability to work in a fast‐paced environment. Excellent communication and collaboration skills. Significant experience ...

Senior Data Engineer - Cloud Pipelines & Analytics

Location
Greater London, England, United Kingdom
driven initiatives. The ideal candidate has strong Python and SQL, hands‐on GCP/BigQuery experience, and familiarity with modern tools like dbt, Airflow and Fivetran. Excellent stakeholder collaboration is essential. #J-18808-Ljbffr ...

Data Scientist (UK)

Location
Sale, England, United Kingdom
Fluent English – for international communication and collaboration. Additional Information Nice to have: Experience with LLMs, or Time Series, Familiarity with tools like Docker, MLflow, Airflow, AWS/GCP/Azure, Background in research or R&D, Experience working in cross-functional or international teams. Soft Skills: Curiosity and problem ...

Lead Software Engineering - Java/Python - Risk Data Platform & Strategy

Location
Greater London, England, United Kingdom
database querying languages Experience in large‐scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal) Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, code review, test acceleration ...

Finance Analytics Engineer | FP&A

Location
Greater London, England, United Kingdom
with regulatory or external reporting Exposure to reconciliations, treasury or general ledger data Experience with BI tools (Metabase, Looker, Power BI) and orchestration tools (Airflow or similar) Experience maintaining production code: code review, testing, CI/CD Spanish or Portuguese proficiency Competitive salary and benefits Stock options ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
with Postgres plus a warehouse or analytics store such as BigQuery or ClickHouse. Experience with streaming (Kafka, Pub/Sub or similar) and orchestration (Airflow, Dagster or similar). Data modelling for audit trails, lineage and multi-tenant isolation. Security-minded handling of sensitive data. Nice to have Data ...

Senior Data Engineer New London

Location
Greater London, England, United Kingdom
Required Skills, Knowledge and Expertise Experience building and operating data pipelines, including ingestion, preparation, data quality checks, backfills and orchestration. Working knowledge of Kubernetes, Airflow, SQL and Spark. A practical approach to delivering work, with reliability and consistency in how you maintain systems and work with others. The ability ...

MLOps Engineer

Location
Greater London, England, United Kingdom
time inference. LLM and agent infrastructure (MCP, retrieval-augmented generation, vector stores). Feature stores, model registries and drift detection. AWS experience, particularly managed Airflow (MWAA). (Don't self-select out because you don't tick every box. We'd rather meet you.) What you get Competitive salary ...

Senior Python Engineer (Data)

Location
Greater London, England, United Kingdom
data scientists in the "PyData" ecosystem (Numpy, Pandas) is desirable. Familiarity with some of the other tools in our stack is desirable: Redis Postgres Airflow Spark This is a hybrid role based in London, UK. About Arrive Arrive, including brands like EasyPark, Flowbird, RingGo, ParkMobile and Parkopedia ...

AVP Data Science

Location
Greater London, England, United Kingdom
systems Excellent communication skills, able to explain complex technical systems to commercial, operations and senior leadership teams. Experience with Google Cloud, Docker, Kafka, Spark, Airflow, ElasticSearch, ClickHouse or similar production infrastructure Experience owning product roadmaps, release governance or cross-functional delivery across distributed teams and time zones. What ...

AVP Data Science: AI & Production ML Leader (Hybrid)

Location
Greater London, England, United Kingdom
systems Excellent communication skills, able to explain complex technical systems to commercial, operations and senior leadership teams. Experience with Google Cloud, Docker, Kafka, Spark, Airflow, ElasticSearch, ClickHouse or similar production infrastructure Experience owning product roadmaps, release governance or cross-functional delivery across distributed teams and time zones. Experience leading ...

Senior Product Analyst - WISE Platform - Send for Partners

Location
Greater London, England, United Kingdom
products, and correspondent banking You are proficient with SQL and know your way around data pipeline management tools such as Snowflake, dbt, Git, Airflow, Python, and Lightdash. You're comfortable owning analytics from data transformation through to delivering actionable insights. You are commercially minded. Able to translate your analysis ...

Machine Learning Engineer III, Routing Cost

Location
Greater London, England, United Kingdom
experienceExtensive hands-on### experienceshowcasing expertise and a strong track record in the engineering field. Technical knowledge: Extensive### experiencewith Python, distributed processing pipelines (Hadoop, Spark, Airflow, Dask), and very large datasets – statistical analysis, data quality control, optimizing storage. Cloud proficiency: Extensive### experiencewith cloud and infrastructure services, including, as well ...

Lead Machine Learning Engineer (London)

Hiring Organisation
Fitch Group
Location
Greater London, United Kingdom
Employment Type
Full Time
necessary infrastructure, resources, and interfaces to enable data loading and LLM workflows. Use Python/Java and large-scale data workflow orchestration platforms e.g. Airflow to construct software artifacts for ETL, interfacing with diverse data formats and storage technologies, and incorporate them into robust data workflows and dynamic systems ...

Commercial Analytics Leader — UK & Global

Location
Greater London, England, United Kingdom
scripting dbt and Databricks data platform with Delta Lake Lightdash as our BI tool and semantic layer Streamlit for interactive data applications Airflow/Orchestra for orchestration Kubernetes for application deployment CI/CD with GitHub and CircleCI Infrastructure on AWS, deployed with Terraform/Spacelift Why else ...

Senior Analytics Manager - WISE Platform

Location
Greater London, England, United Kingdom
forecasting, prioritisation and scenario modelling. You’re proficient in SQL and know your way around data pipeline management tools such as Snowflake, dbt, Git, Airflow, Python and Lightdash. You’re comfortable owning analytics from data transformation through to actionable insights. You’re an expert at crafting dashboards and visualisations ...

Senior Product Analytics Manager - Online Platforms

Hiring Organisation
Wise
Location
Greater London, United Kingdom
Employment Type
Full Time
Salary
105000 to 150000 GBP Annually
forecasting, prioritisation and scenario modelling. You’re proficient in SQL and know your way around data pipeline management tools such as Snowflake, dbt, Git, Airflow, Python and Lightdash. You’re comfortable owning analytics from data transformation through to actionable insights. You’re an expert at crafting dashboards and visualisations ...