51 to 75 of 146 Apache Airflow Jobs in the UK

Transformers , PyTorch , YOLO , OpenCV , and Pillow Designing and deploying AI services via FastAPI , AWS Lambda , EKS/ECS , and S3 Creating scalable data pipelines with Pandas , NumPy , SQLAlchemy , and Airflow Supporting real-time model inference, edge deployments, and API integrations Working closely with a technical lead in a service-based and serverless architecture Essential Python Engineer skills and experience More ❯

ideally within consumer tech, logistics, or e-commerce. Strong proficiency in Python, SQL, and machine learning frameworks. Experience with cloud platforms (Azure, AWS, GCP) and tools like Databricks, DBT, Airflow, or Terraform. Familiarity with AI/ML applications and modern analytics tooling. Excellent communication skills and ability to work independently in a fast-paced environment. Why Join? Be part More ❯

role 60% hands-on technically/40% hands-off leadership and strategy Proven experience designing scalable data architectures and pipelines Strong Python, SQL, and experience with tools such as Airflow, dbt, and Spark Cloud expertise (AWS preferred), with Docker/Terraform A track record of delivering in fast-paced, scale-up environments Nice to have: Experience with streaming pipelines More ❯

in data leadership – ideally within fintech, SaaS, or regulated tech environments. Technical depth across data engineering, analytics, or data science. Hands-on familiarity with modern data stacks – SQL, dbt, Airflow, Snowflake, Looker/Power BI. Understanding of the AI/ML lifecycle – including tooling (Python, MLflow) and best-practice MLOps. Comfortable working across finance, risk, and commercial functions. Experience More ❯

in data leadership – ideally within fintech, SaaS, or regulated tech environments. Technical depth across data engineering, analytics, or data science. Hands-on familiarity with modern data stacks – SQL, dbt, Airflow, Snowflake, Looker/Power BI. Understanding of the AI/ML lifecycle – including tooling (Python, MLflow) and best-practice MLOps. Comfortable working across finance, risk, and commercial functions. Experience More ❯

As a Senior Data Engineer you will take ownership of the data platform, optimising it for scalability to ensure successful client onboarding. You'll use modern tools (such as Airflow, Prefect, Dagster or AWS Step Functions) for ETL design and orchestration, work on transformation logic to clean, validate and enrich data (including handling missing values, standardising formats and duplication More ❯

As a Senior Data Engineer you will take ownership of the data platform, optimising it for scalability to ensure successful client onboarding. You'll use modern tools (such as Airflow, Prefect, Dagster or AWS Step Functions) for ETL design and orchestration, work on transformation logic to clean, validate and enrich data (including handling missing values, standardising formats and duplication More ❯

architecture. GraphQL (Working) - queries, mutations, schema awareness. SQL (PostgreSQL) (Working) - schema design, queries, migrations. JavaScript (Working) - legacy code and Jest tests. Go (Awareness) - infrastructure tooling and services. Python (Awareness) - Airflow DAGs and automation scripts. Infrastructure & Cloud AWS (EKS, S3, IAM) Kubernetes fundamentals (pods, services, ingress, Istio, Traefik). Containerization with Docker/containerd.Observability Collaboration Tools Jira, Confluence, Slack, Figma. More ❯

e.g., Erwin, Lucidchart). Strong grasp of data governance, metadata management, and compliance frameworks (e.g., GDPR). Hands-on understanding of Python, SQL, and modern data engineering tools (e.g., Airflow, DBT, Atlan). Exceptional consulting and stakeholder management skills. Career experience within leading consultancies or SIs (e.g., IBM, Thoughtworks, EY, Capgemini). What's on Offer More ❯

Preferred Qualifications: AWS certifications (e.g., Solutions Architect Associate/Professional, DevOps Engineer). Experience deploying and maintaining data processing and machine learning workloads. Familiarity with MLOps tools (e.g., MLflow, Airflow, BentoML). Knowledge of distributed systems, caching strategies, content delivery networks (CDNs), and load balancing. Understanding of Zero Trust Network (ZTN) concepts using Cloudflare. Basic experience with database administration More ❯

projects Support talent acquisition and continuous learning initiatives Knowledge and Experience Knowledge of ML model development and deployment frameworks (MLFlow, Kubeflow Advanced data querying (SQL) and data engineering pipelines (Airflow Extensive experience with comprehensive unit testing, integration testing, and test coverage strategies Experience working with Product Management teams and ability to translate complex technical concepts for non-technical stakeholders More ❯

EMIR). Expert in Python and SQL; strong experience with data engineering libraries (e.g., Pandas, PySpark, Dask). Deep knowledge of ETL/ELT frameworks and orchestration tools (e.g., Airflow, Azure Data Factory, Dagster). Proficient in cloud platforms (preferably Azure) and services such as Data Lake, Synapse, Event Hubs, and Functions. Authoring reports and dashboards with either open More ❯

experience in data engineering roles, preferably for a customer facing data product Expertise in designing and implementing large-scale data processing systems with data tooling such as Spark, Kafka, Airflow, dbt, Snowflake, Databricks, or similar Strong programming skills in languages such as SQL, Python, Go or Scala Demonstrable use and an understanding of effective use of AI tooling in More ❯

development efficiency and deployment effectiveness, including Azure DevOps or GitHub Considerable experience designing and building operationally efficient pipelines, utilising core Cloud components, such as Azure Data Factory, Big Query, AirFlow, Google Cloud Composer and Pyspark etc Proven experience in modelling data through a medallion-based architecture, with curated dimensional models in the gold layer built for analytical use Strong More ❯

large scale bioinformatics datasets. Experience using Nextflow pipelines. Knowledge of NLP techniques and experience of processing unstructured data, using vector stores, and approximate retrieval. Familiarity with orchestration tooling (e.g. Airflow or Google Workflows). Experience with AI/ML powered applications. Experience with Docker or containerized applications. Why GSK? Uniting science, technology and talent to get ahead of disease More ❯

large scale bioinformatics datasets. Experience using Nextflow pipelines. Knowledge of NLP techniques and experience of processing unstructured data, using vector stores, and approximate retrieval. Familiarity with orchestration tooling (e.g. Airflow or Google Workflows). Experience with AI/ML powered applications. Experience with Docker or containerized applications. Why GSK? Uniting science, technology and talent to get ahead of disease More ❯

large scale bioinformatics datasets. Experience using Nextflow pipelines. Knowledge of NLP techniques and experience of processing unstructured data, using vector stores, and approximate retrieval. Familiarity with orchestration tooling (e.g. Airflow or Google Workflows). Experience with AI/ML powered applications. Experience with Docker or containerized applications. Why GSK? Uniting science, technology and talent to get ahead of disease More ❯

VMWare General/Usage Technical Leadership & Design DevSecOps tooling and practices Application Security Testing SAFe (scaled agile) Processes Data Integration Focused Data Pipeline Orchestration, and ELT tooling such as Apache Airflow, Apark, NiFi, Airbyte and Singer. Message Brokers, streaming data processors, such as Apache Kafka Object Storage, such as S3, MinIO, LakeFS CI/CD Pipeline, Integration More ❯

VMWare General/Usage Technical Leadership & Design DevSecOps tooling and practices Application Security Testing SAFe (scaled agile) Processes Data Integration Focused Data Pipeline Orchestration, and ELT tooling such as Apache Airflow, Apark, NiFi, Airbyte and Singer. Message Brokers, streaming data processors, such as Apache Kafka Object Storage, such as S3, MinIO, LakeFS CI/CD Pipeline, Integration More ❯

set of ML and NLP models - Build and maintain batch and real-time feature computation pipelines capable of processing complex structured and unstructured data using technologies such as Spark, Apache Airflow, AWS SageMaker etc. - Contribute to the implementation of foundational ML infrastructure such as feature storage and engineering, asynchronous (batch) inference and evaluation - Apply your keen product mindset More ❯

b2c who you will have heard of/used, who are seeking 2x Data Engineers to join them asap on an initial 6 months contract. Python, SQL, AWS, dbt, Airflow (spark/scala a bonus) 6 months Outside IR35 (ltd company) £500-600 per day Asap start More ❯

b2c who you will have heard of/used, who are seeking 2x Data Engineers to join them asap on an initial 6 months contract. Python, SQL, AWS, dbt, Airflow (spark/scala a bonus) 6 months Outside IR35 (ltd company) £500-600 per day Asap start More ❯

in AWS environments* Deep understanding of cloud-native data services: S3, Redshift, Glue, Athena, EMR, Kinesis, Lambda* Strong hands-on expertise in data modelling, distributed systems, and pipeline orchestration (Airflow, Step Functions)* Background in energy, trading, or financial markets is a strong plus* Excellent knowledge of Python, SQL, and data governance frameworks* Experience working with stakeholders in fast-paced More ❯

Data Engineer who enjoys coaching & mentoring others, and knowledge sharing. You’ll bring: Strong industry experience within Data Engineering & Cloud Experience with these tools, or familiar: Python, SQL, Kafka, Airflow, Azure, AWS DevOps experience would be a plus (desirable) Formal OR informal Training or Coaching experience (Coach/Mentor/Trainer/Instructor/Tutor/Lecturer etc.) Resilience More ❯

Cloud Platform (GCP) and cloud data tools Background in CRM systems and customer data structures Understanding of data warehousing concepts and cloud architecture Experience with ETL tools and frameworks Airflow, Git, CI/CD pipeline Data Insights reporting experience Competent with real-time data processing and streaming technologies Proficiency in Tableau or other data visualisation tools is desirable ** PLEASE More ❯