26 to 50 of 52 Apache Airflow Jobs in the South East

Databricks experience, including Unity Catalog. Strong skills in Python, Spark, SQL and experience with SQL databases. Terraform experience for cloud infrastructure as code. Experience with Azure and workflow tools (Airflow, ADF). Excellent problem-solving ability, communication skills, and attention to detail. Experience across Waterfall and Agile methodologies. Curious, inclusive, and committed to continuous learning. To apply for this More ❯

contexts. Bonus Experience (Nice to Have) Exposure to large language models (LLMs) or foundational model adaptation. Previous work in cybersecurity, anomaly detection, or behavioural analytics. Familiarity with orchestration frameworks (Airflow or similar). Experience with scalable ML systems, pipelines, or real-time data processing. Advanced degree or equivalent experience in ML/AI research or applied science. Cloud platform More ❯

Python and SQL fundamentals The ability to get to grips with new technologies quickly What's Nice to Have** Experience in dashboarding tools, Typescript and API development Familiarity with Airflow, DBT, Databricks Experience working with Enterprise Resource Planning (e.g. Oracle, SAP) and CRM systems Benefits Become part of a category-defining startup which transforms transforming how industrial companies operate More ❯

and PySpark Exposure to generative AI platforms or a passion for building AI-powered solutions Ability to lead client delivery in dynamic, fast-paced environments Familiarity with tools like Airflow, Databricks or DBT is a plus What's on offer: Salary up to £75,000 Bonus and equity options Hybrid working: 3 days in a vibrant central London office More ❯

TO HAVE: Experience integrating AI models into production systems using GCP, AWS, or Azure. Familiarity with vector databases, embedding models, or retrieval-augmented generation (RAG). Knowledge of Docker, Airflow, or MLOps pipelines. Strong understanding of AI ethics, data privacy, and responsible model deployment. TO BE CONSIDERED... Please either apply online or email me directly at .By applying for More ❯

influence business performance. Ability to operate effectively in a fast-paced, scaling organisation. Excellent communication skills and a collaborative approach. Desirable Skills Experience with analytics engineering tools (e.g., dbt, Airflow). Familiarity with experimentation frameworks and A/B testing platforms. Exposure to cloud-based data environments (e.g., Google Cloud Platform). Experience within digital consumer businesses or online More ❯

code. Implement TMS (Tealium IQ, Adobe Analytics, GTM and Adobe Dynamic Tag Manager) changes. Integrate data sources via web and REST APIs. Data pipping and modelling using SQL, DBT, Airflow, ETL, Data Warehousing, Redshift and Python. Transfer knowledge of the business processes and requirements to the development teams. Collaborate with Product, Marketing and Development teams to collect business requirements More ❯

code. Implement TMS (Tealium IQ, Adobe Analytics, GTM and Adobe Dynamic Tag Manager) changes. Integrate data sources via web and REST APIs. Data pipping and modelling using SQL, DBT, Airflow, ETL, Data Warehousing, Redshift and Python. Transfer knowledge of the business processes and requirements to the development teams. Collaborate with Product, Marketing and Development teams to collect business requirements More ❯

of building performant, maintainable, and testable systems Solid background in microservices architecture Proficiency with Postgres & MongoDB (relational + non-relational) Experience with event-driven architectures and asynchronous workflows (Kafka, Airflow, etc.) Solid coding practices (clean, testable, automated) The mindset of a builder: thrives in fast-paced startup environments, takes ownership, solves complex challenges Bonus points if you’ve worked More ❯

enterprise-grade SaaS applications in a high-growth B2B environment Strong technical depth across: Backend: Node js, Typescript Frontend: React, Typescript Database: MySQL Cloud/Infra: AWS, ECS, K8s, Airflow, Kafka, Serverless Solid understanding of SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally, exposure to cybersecurity platforms More ❯

enterprise-grade SaaS applications in a high-growth B2B environment Strong technical depth across: Backend: Node js, Typescript Frontend: React, Typescript Database: MySQL Cloud/Infra: AWS, ECS, K8s, Airflow, Kafka, Serverless Solid understanding of SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally, exposure to cybersecurity platforms More ❯

and leadership with collaborators across Marketing, Product, and Engineering, including influencing senior and executive partners. Nice to have: Experience with marketing tech stacks, event-level data, Spark/Databricks, Airflow, generative AI for CRM applications, or two-sided marketplace environments. #LI-ML1 Please see the Talent Privacy Notice for information regarding how eBay handles your personal data collected when More ❯

early-stage B2B SaaS (ideally cybersecurity, threat intelligence, or offensive security tools). Deep technical expertise across: Cloud: AWS, Azure IaC: Terraform, Ansible Platforms: Kubernetes (EKS), ECS, Docker, Lambda, Airflow Observability: EFK, Prometheus, Grafana, Jaeger/OpenTelemetry Persistence: MySQL, PostgreSQL, MongoDB, Redis, Elasticsearch, Kafka Pipelines: GitHub Actions, AWS CodeBuild Runtimes: Python, Node.js, Golang Strong networking fundamentals, especially OSI layer More ❯

data infrastructure for the organisation. What you'll be doing: Design, develop, and maintain scalable data architectures and ETL pipelines Build and manage data models and data warehouse solutions (Airflow, dbt, and Redshift) Write clean, efficient Python and SQL code for data processing and transformation Integrate data from internal and third-party APIs and services Optimise data pipelines for … data security, privacy, and compliance principles Ability to optimise data pipelines for performance and maintainability Strong collaboration skills and a proactive, problem-solving mindset Bonus Points For Experience with Airflow and/or dbt Experience working in Agile environments (Scrum/Kanban) Exposure to DevOps practices or CI/CD pipelines You'll join a business that values innovation More ❯

when needed). The Role Build and optimise scalable data pipelines for a new Data Lake Work with Python, SQL, Spark, AWS, Docker, CI/CD Orchestrate workflows using Airflow, Prefect, or Dagster Support ETL, API integrations, and high-quality data validation Translate business needs into technical solutions with full ownership What You Need STEM degree (Computer Science, Engineering … etc.) 2+ years in data engineering/analytics/software Strong Python + SQL 2+ years ETL, APIs, CI/CD, Docker, AWS Ideally but not essential experience with Airflow/Prefect/Dagster Background in Financial Services, FinTech, Insurance, PE/VC, or Banking Package & Benefits High performance bonus 25 days holiday Pension & private healthcare Join at inception More ❯

excellent career progression opportunities for the right individual. You will play a pivotal role in evolving the company's data stack, working with modern tools such as DBT and Airflow, and developing scalable, high-quality data pipelines and infrastructure. Key Responsibilities: Lead the evolution of the company's data stack, with a focus on automation and scalability. Design, build … SQL and Python. Proven experience in managing complex data estates and developing automated data pipelines. Good understanding of testing principles and deployment processes. Experience with technologies such as Redshift, Airflow, DBT, and AWS. Strong grasp of data modelling, database architecture, and governance principles. Hands-on experience with Git and modern development workflows. Excellent problem-solving skills, resilience, and a More ❯

Design and build data models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the client and cross-functional teams to … relational databases (e.g. MS SQL/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for More ❯

self-organising, fast-paced environment. Nice-to-Have Skills: ·Experience with GCP/BigQuery or other cloud data warehouses (e.g., Snowflake, Redshift). ·Familiarity with data orchestration tools (e.g., Airflow). ·Experience with data visualisation platforms (such as Preset.io/Apache Superset or other). ·Exposure to CI/CD pipelines, ideally using GitLab CI. ·Background working with More ❯

a scaling startup in the AI and Healthcare technology sector Salary up to £150k + Equity Paddington-based (4-5 days per week in-office) Tech environment: Python | SQL | Airflow | dbt | GCP | AWS | Data Architecture | Kafka If you wish to keep your CV/data private, feel free to WhatsApp your details/CV to me, Dan - WHO WE … Senior or Lead Data Engineer , Data Manager, or similar leadership role. Strong proficiency in Python (or Scala/Java) and SQL . Hands-on experience with data orchestration tools (Airflow, dbt, Dagster, or Prefect). Solid understanding of cloud data platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery, Redshift). Experience with streaming technologies (Kafka, Kinesis, or … are giving express consent for us to process (subject to required skills) your application to our client in conjunction with this vacancy only. KEY SKILLS: Data Management | Python | SQL | Airflow | dbt | GCP | AWS | Data Architecture | Kafka | Governance | Data Quality | Cloud Data Platforms More ❯

be doing: Managing and maintaining a Python-based data warehouse , ensuring reliable data ingestion and transformation. Developing and monitoring data pipelines using Meltano and orchestration tools like Dagster or Airflow . Designing and optimising SQL transformations (DBT experience a plus). Working within Azure cloud infrastructure following Infrastructure-as-Code (IaC) principles. Managing Power BI semantic models , DAX measures … data stack for ETL/ELT processes and data warehousing. Strong SQL and Python skills, with an understanding of Kimball-style data modelling . Experience with DBT, Dagster, or Airflow for transformation and orchestration. Hands-on experience with Azure (preferred), or other cloud environments (GCP/AWS). Familiarity with Git-based version control , CI/CD, and DevOps More ❯

Machine Learning Engineer Machine Learning Engineer - AI for Advanced Materials - Oxford/Remote (UK) (Tech stack: Python, PyTorch, TensorFlow, Scikit-learn, MLflow, Airflow, Docker, Kubernetes, AWS, Azure, GCP, Pandas, NumPy, SciPy, CI/CD, MLOps, Data Visualization, Bayesian Modelling, Probabilistic Programming, Terraform) We're looking for a Machine Learning Engineer to join a rapidly scaling deep-tech company that … Our client is seeking Machine Learning Engineers with experience in some or all of the following (full training provided to fill any gaps): Python, PyTorch, TensorFlow, Scikit-learn, MLflow, Airflow, Docker, Kubernetes, Pandas, NumPy, SciPy, CI/CD, Data Visualization, Bayesian Modelling, Probabilistic Programming, Terraform, Azure, AWS, GCP, Git, and Agile methodologies. Join a team that's fusing AI More ❯

contributing to how data is used to drive commercial decisions - particularly around pricing, revenue, and customer insight. Key responsibilities include: Manage and maintain the company's data warehouse (Python, Airflow, DBT, Kimball) Ensure data pipelines are robust, accurate, and performant Maintain and develop cloud infrastructure using Infrastructure as Code (Terraform) Identify opportunities to improve data processes, architecture, and efficiency … and data during the ongoing merger YOUR SKILLS AND EXPERIENCE: A successful Data Engineer will bring: Strong SQL and Python skills Experience managing or building data warehouses Familiarity with Airflow and modern data engineering workflows Interest in cloud infrastructure and IaC principles Proactive mindset - not just maintaining systems, but improving them THE BENEFITS: You will receive a salary of More ❯

customers, by leveraging data to improve the OTM users and agents experience. This role would be suited to an individual with a background in Python, SQL, AWS, Looker, PyTorch, Airflow and Redshift/Postgres. The candidate must be able to exhibit proficiency in working with large volumes of data, automating data loads, and the ability to understand end user … requirements with the goal of building a solution to provide high quality data processing and analysis as well as building APIs. RESPONSIBILITIES D evelop data pipelines using Python and Airflow Data warehousing (Redshift/Spectrum) Develop data solutions to address business needs Maintain existing reports and improve their performance QUALIFICATIONS Bachelors degree in Computer Science, Data Science, Mathematics, Engineering … warehouses such as Amazon Redshift, and Google BigQuery. Building visualizations using tools such as Looker studio or equivalent Experience in designing ETL/ELT solutions, preferably using tools like Airflow or AWS Glue Solid analytical and technical skills Good communications skills both verbally and written; this role will be working closely with business users. NICE TO HAVE Development & Deployment More ❯

to support model adoption and scale. In this role, you will: Build robust ML and MLOps pipelines for scalable, reproducible model development, deployment, and monitoring. Use tools such as Airflow for workflow orchestration and MLflow for experiment tracking, model registry, and lifecycle management. Work within an agile development environment and help prioritise high-value opportunities for rapid delivery. Essential … a STEM field Strong Python development skills Hands-on experience developing ML and/or deep learning models for scientific or engineering problems Experience with MLOps tools such as Airflow, MLflow, and containerisation (e.g., Docker) Strong data-visualisation and storytelling skills Interest in materials discovery, computer vision, big data, or optimisation Collaborative communicator, organised, proactive, and curious Desired Skills More ❯

streamline data workflows, optimize performance, and ensure reliability across cloud platforms-while guiding teams with strong technical leadership.Key Responsibilities* Pipeline Automation: Build and orchestrate data workflows using tools like Airflow, Prefect, or Dagster.* Containerization: Package and deploy data applications using Docker and Kubernetes (including EKS and AKS).* CI/CD for Data: Implement and maintain automated pipelines for … Use Terraform and Ansible to provision and manage data infrastructure.* Performance Optimization: Enhance data processing for speed, scalability, and reliability.What We're Looking For* Strong experience with orchestration tools (Airflow, Prefect, Dagster).* Expertise in Docker and Kubernetes.* Solid understanding of CI/CD principles and tooling.* Familiarity with open-source data technologies (Spark, Kafka, PostgreSQL).* Knowledge of … your application with you before presenting it to any potential employer.Please note we are on the client's supplier list for this position.KeywordsLead DataOps Engineer, DataOps, Data Pipeline Automation, Airflow, Prefect, Dagster, Docker, Kubernetes, EKS, AKS, CI/CD, Terraform, Ansible, Grafana, Prometheus, Spark, Kafka, PostgreSQL, Infrastructure as Code, Cloud Data Engineering, Hybrid Working, Security Clearance, Leadership, DevOps, Observability More ❯