76 to 100 of 115 Apache Airflow Jobs in the UK

programming skills in Python; experience with ML libraries such as Snowpark, PySpark or PyTorch. Experience with containerization tools like Docker and orchestration tools like Airflow or Astronomer. Familiarity with cloud platforms (AWS, Azure) and ML services (e.g., SageMaker, Vertex AI). Experience with CI/CD pipelines and automation ...

with analytics, architecture, and delivery stakeholders. Balance operational leadership with longer-term planning and strategy. YOUR SKILLS & EXPERIENCE Essential: Strong experience with Snowflake, AWS, Airflow, and dbt. Proven background leading data engineers in production environments. Experience supporting data platform migrations or major transformations. Confident making technical trade-offs ...

product". Ability to influence senior stakeholders and collaborate effectively with technology architects. Familiarity with contemporary data engineering tooling (e.g. Snowflake-centric stacks, DBT, Airflow, Fivetran). If you'd like to learn more, please contact Jacob Ferdinand ...

product'. Ability to influence senior stakeholders and collaborate effectively with technology architects. Familiarity with contemporary data engineering tooling (e.g. Snowflake-centric stacks, DBT, Airflow, Fivetran). If you'd like to learn more, please contact Jacob Ferdinand ...

cases are developed in a scalable and sustainable way Communicate complex technical decisions clearly to non-technical stakeholders Technical Environment Strong experience required: Snowflake Airflow dbt Nice to have: AWS (lower priority) Ideal Background Senior or Lead Data Engineer who has progressed into a management/technical leadership role ...

engineering and product teams to support evolving data requirements Requirements: SQL Server T-SQL DBA Skills Power BI ETL (SSIS or other, such as Airflow) MySQL would be useful but certainly not essential. Apply Now! If you have a range of experience in Data Engineering and you are looking ...

Tech Lead Manager in a data, platform or backend context · Background in data or backend engineering (e.g. AWS, Python/Scala, Spark/EMR, Airflow or similar) – enough to challenge designs and make informed decisions · Experience owning or supporting analytics/data/reporting products for internal or external ...

Tech Lead Manager in a data, platform or backend context · Background in data or backend engineering (e.g. AWS, Python/Scala, Spark/EMR, Airflow or similar) – enough to challenge designs and make informed decisions · Experience owning or supporting analytics/data/reporting products for internal or external ...

likely happen. What you’ll do: Build and configure production-ready AI workflows Work with Python, AWS, CI pipelines Get involved in workflow orchestration (Airflow/Temporal) Work with analytics databases (ClickHouse/SQL) Collaborate closely with an implementation team, guided by a staff engineer Requirements: Strong Python skills ...

monitoring. Experience building robust backend systems and APIs to serve ML models at scale. Strong understanding of big data technologies and data orchestration tools (Airflow, DBT). Familiarity with LLM integration and optimisation in production environments. Excellent problem-solving, analytical, and communication skills. Experience fine-tuning LLMs (e.g. Unsloth ...

mission. Technologies used on the team include: Languages: Go, Python, Scala Frameworks: Spark, Thrift, Kafka Data stores: Postgres, BigQuery, Redis, Druid Tools: Kubernetes, Airflow, Docker Job responsibilities: You will work with the existing engineering team and help contribute to the direction of the project and team Collaborate with cross ...

experience with Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol ...

Tech Lead Manager in a data, platform or backend environment A background in data or backend engineering, such as AWS, Python or Scala, Spark, Airflow or similar Experience owning or supporting analytics, data or reporting products Strong people leadership skills including hiring, coaching and performance management A track record ...

healthcare, fintech, or other regulated environments Exposure to LLM infrastructure, model serving, or agentic AI frameworks in production Familiarity with data platforms (BigQuery, Airflow, data pipelines) Experience with CI/CD pipelines (GitHub Actions, Cloud Build) and policy-as-code tools Exposure to observability stacks (OpenTelemetry, Prometheus, Cloud Monitoring ...

Python and SQL. Strong experience building ETL pipelines and distributed data systems. Solid cloud experience — ideally AWS (open to GCP). Orchestration experience (Dagster, Airflow, or similar). Experience with modern data warehouses such as Snowflake, Redshift, or BigQuery. Infrastructure‐as‐code experience (Terraform or Pulumi). Strong data … development is highly desirable. Experience in high‐growth or smaller technology environments. Nice‐to‐haves Snowflake experience. Experience with dbt, Fivetran, AWS Glue, or Apache Iceberg. Prior leadership or mentoring experience (team lead/tech lead). What They Offer The opportunity to influence architecture, tooling, and engineering standards ...

including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range of databases and storage technologies ...

AI. Comfortable working in a fast-paced, agile environment. Excellent communication and collaboration skills. Nice to Have Experience with workflow orchestration tools (e.g., Temporal, Airflow). Familiarity with vector databases or semantic search tools. Experience building internal tooling or developer productivity enhancements using AI. Exposure to customer support ...

Quantitative Developer, to come onto the desk and build trading tools and signal generation frameworks for the investment professionals. Stack: Python, Linux, Airflow The team has some excellent analysts and researchers, and they need an equally talented developer to come and build an array of tools and applications ...

What you'll be doing: Design, develop, and maintain scalable data architectures and ETL pipelines Build and manage data models and data warehouse solutions (Airflow, dbt, and Redshift) Write clean, efficient Python and SQL code for data processing and transformation Integrate data from internal and third-party APIs … principles Ability to optimise data pipelines for performance and maintainability Strong collaboration skills and a proactive, problem-solving mindset Bonus Points For Experience with Airflow and/or dbt Experience working in Agile environments (Scrum/Kanban) Exposure to DevOps practices or CI/CD pipelines You'll join ...

Senior Data Engineer (AWS, Airflow, Python) Based at client locations, working remotely, or based in our Godalming or Milton Keynes offices. Salary up to £65k plus company benefits. About Us Triad Group Plc is an award-winning digital, data, and solutions consultancy with over 35 years' experience primarily serving … maintain cloud data solutions. Maintain modular Terraform based IaC for reliable provisioning of AWS infrastructure. Develop, optimise and maintain robust data pipelines using Apache Airflow. Implement data transformation processes using Python to clean, preprocess, and enrich data for analytical use. Collaborate with data analysts, data scientists, developers, and other ...

e.g. AWS, GCP, Azure), infrastructure-as-code, and scalable architecture patterns Hands-on experience with SQL, Python, and modern data integration frameworks such as Apache Kafka, airflow or dbt Proven ability to deliver enterprise-grade customer data solutions, including customer data platforms and or API based integration Excellent ...

deliver reliable, high-performance data solutions using Databricks and modern cloud technologies. Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, and Delta Lake Build and optimize ETL/ELT workflows for batch and streaming data Develop data models to support analytics, reporting, and machine … data pipelines, architectures, and best practices Required Qualifications 3+ years of experience in data engineering or a similar role Strong experience with Databricks and Apache Spark Proficiency in Python and SQL Experience with Delta Lake, data modeling, and performance tuning Hands-on experience with cloud platforms (AWS, Azure ...

looking for Extensive experience in data engineering, including time in a lead role Strong Python and SQL skills Experience with orchestration tools (Airflow, Dagster, Prefect) Hands-on dbt , AWS, and modern data warehouses Strong data modelling and architectural capability Background scaling data platforms in high-growth environments Nice … have Snowflake or Apache Iceberg Infrastructure-as-Code (Terraform) Observability-driven data systems Package & Benefits Salary up to £120,000 Fully remote working Home-office setup Private healthcare and income protection 25 days holiday + enhanced parental leave Strong learning and development budget ...

with engineers, architects, and product managers on data solutions. Support deployment, testing, and documentation of data products. Work with cloud-based tools, including BigQuery, Airflow, Terraform, DBT, and GIT. Continuously learn new tools and technologies, contributing to team knowledge and best practices. Key Skills & Experience: 1–3 years’ experience … roles. Strong SQL and Python skills. Exposure to cloud platforms (GCP preferred; Azure/AWS acceptable) . Familiarity with data tooling: DBT, GIT, Terraform, Airflow, Docker (nice to have). Good problem-solving skills, attention to detail, and collaborative mindset. Interested in Agile practices, Test-Driven Design, and modern ...

with engineers, architects, and product managers on data solutions. Support deployment, testing, and documentation of data products. Work with cloud-based tools, including BigQuery, Airflow, Terraform, DBT, and GIT. Continuously learn new tools and technologies, contributing to team knowledge and best practices. Key Skills & Experience: 1–3 years' experience … roles. Strong SQL and Python skills. Exposure to cloud platforms (GCP preferred; Azure/AWS acceptable) . Familiarity with data tooling: DBT, GIT, Terraform, Airflow, Docker (nice to have). Good problem-solving skills, attention to detail, and collaborative mindset. Interested in Agile practices, Test-Driven Design, and modern ...