276 to 300 of 365 Apache Airflow Jobs

Lead Data Engineer | Python, DBT, Airflow, Terraform, GCP/AWS | London (Hybrid 1-2 Days) | £120K-£140K OB is partnered with an exciting Unicorn FinTech that are on a mission to transform lending with a central focus on data. As a Lead Engineer, you will set the technical direction for our data platform and shape how data enables every … you Have 7+ years in data or backend engineering, including 2+ years in a lead or technical decision-making role. Are fluent in the modern data stack: DBT, BigQuery, Airflow, Terraform, GCP or AWS. Bring strong software engineering skills: Python, SQL, CI/CD, DevOps mindset. Understand data warehousing, ETL/ELT, orchestration, and streaming pipelines. Thrive in cross … functional product squads and collaborative work. If you are interested in this role, please send your CV to jonah.brookes@oliverbernard.com Lead Data Engineer | Python, DBT, Airflow, Terraform, GCP/AWS | London (Hybrid 1-2 Days) | £120K-£140K More ❯

Lead Data Engineer | Python, DBT, Airflow, Terraform, GCP/AWS | London (Hybrid 1-2 Days) | £120K-£140K OB is partnered with an exciting Unicorn FinTech that are on a mission to transform lending with a central focus on data. As a Lead Engineer, you will set the technical direction for our data platform and shape how data enables every … you Have 7+ years in data or backend engineering, including 2+ years in a lead or technical decision-making role. Are fluent in the modern data stack: DBT, BigQuery, Airflow, Terraform, GCP or AWS. Bring strong software engineering skills: Python, SQL, CI/CD, DevOps mindset. Understand data warehousing, ETL/ELT, orchestration, and streaming pipelines. Thrive in cross … functional product squads and collaborative work. If you are interested in this role, please send your CV to jonah.brookes@oliverbernard.com Lead Data Engineer | Python, DBT, Airflow, Terraform, GCP/AWS | London (Hybrid 1-2 Days) | £120K-£140K More ❯

Deep understanding of data modelling, ETL/ELT processes, and distributed data systems . Hands-on experience with SQL/NoSQL databases , and data frameworks like Pandas, PySpark, or Airflow . Cloud experience with GCP, Azure, or AWS (BigQuery, Dataflow, ADF, Glue, or similar). Comfortable working autonomously in a fast-moving environment, with the curiosity and initiative to … workflows is a plus. Knowledge of financial services, compliance, or regulatory data is beneficial but not essential. Tech Stack Languages: Python (FastAPI, Pandas, PySpark) Databases: MongoDB, PostgreSQL Data Processing: Airflow, Redis, GCP BigQuery/Azure Data Factory Cloud: Azure (migrating to GCP; AWS potential) Frontend: Next.js/React (for internal tools) What We Offer Flexible remote working, with an More ❯

ELT pipelines to support analytics, ML models, and business intelligence Develop scalable batch and streaming data pipelines to process millions of events and transactions daily Implement workflow orchestration using Airflow, Dagster, or similar tools Build data validation and quality monitoring frameworks to ensure data accuracy and reliability Collaborate cross-functionally with Software, ML, and Analytics teams to deliver production … Python and SQL skills (Pandas, PySpark, query optimisation) Cloud experience (AWS preferred) including S3, Redshift, Glue, Lambda Familiarity with data warehousing (Redshift, Snowflake, BigQuery) Experience with workflow orchestration tools (Airflow, Dagster, Prefect) Understanding of distributed systems, batch and streaming data (Kafka, Kinesis) Knowledge of IaC (Terraform, CloudFormation) and containerisation (Docker, Kubernetes) Nice to have: Experience with dbt, feature stores More ❯

ELT pipelines to support analytics, ML models, and business intelligence Develop scalable batch and streaming data pipelines to process millions of events and transactions daily Implement workflow orchestration using Airflow, Dagster, or similar tools Build data validation and quality monitoring frameworks to ensure data accuracy and reliability Collaborate cross-functionally with Software, ML, and Analytics teams to deliver production … Python and SQL skills (Pandas, PySpark, query optimisation) Cloud experience (AWS preferred) including S3, Redshift, Glue, Lambda Familiarity with data warehousing (Redshift, Snowflake, BigQuery) Experience with workflow orchestration tools (Airflow, Dagster, Prefect) Understanding of distributed systems, batch and streaming data (Kafka, Kinesis) Knowledge of IaC (Terraform, CloudFormation) and containerisation (Docker, Kubernetes) Nice to have: Experience with dbt, feature stores More ❯

semi-structured, and streaming data Design and improve data models to support analytics and machine learning use cases Develop and support real-time data workflows using technologies such as Apache Kafka Monitor and ensure data quality, reliability, and security across the stack Contribute to the evolution of data engineering practices, tooling, and automation Collaborate with analytics, product, and data … patterns Experience with version control (Git), testing, and code review practices Familiarity with cloud-based data environments (e.g. AWS, GCP, or Azure) Exposure to modern data tools such as Airflow, dbt, or Snowflake Experience or strong interest in streaming technologies like Apache Kafka Interest in MLOps and modern data engineering best practices Why join: You’ll be part More ❯

semi-structured, and streaming data Design and improve data models to support analytics and machine learning use cases Develop and support real-time data workflows using technologies such as Apache Kafka Monitor and ensure data quality, reliability, and security across the stack Contribute to the evolution of data engineering practices, tooling, and automation Collaborate with analytics, product, and data … patterns Experience with version control (Git), testing, and code review practices Familiarity with cloud-based data environments (e.g. AWS, GCP, or Azure) Exposure to modern data tools such as Airflow, dbt, or Snowflake Experience or strong interest in streaming technologies like Apache Kafka Interest in MLOps and modern data engineering best practices Why join: You’ll be part More ❯

Role : Build and operate data pipelines and analytics platforms in the cloud. Work with engineers and analysts to design, implement, and maintain reliable, observable ETL/ELT workflows using Airflow and managed cloud services. Focus on Python-first implementations, high-quality SQL, Airflow orchestration, and query engines such as Athena, Trino, or ClickHouse. Required Skills: Hands-on software More ❯

Role : Build and operate data pipelines and analytics platforms in the cloud. Work with engineers and analysts to design, implement, and maintain reliable, observable ETL/ELT workflows using Airflow and managed cloud services. Focus on Python-first implementations, high-quality SQL, Airflow orchestration, and query engines such as Athena, Trino, or ClickHouse. Required Skills: Hands-on software More ❯

across multiple sources. Integrate services via RESTful APIs and manage structured/unstructured data formats. Data Visualisation & Automation Build interactive dashboards in BI tools such as Power BI or Apache Superset. Automate KPI tracking and reporting to streamline workflows. Partner with teams to identify opportunities for process optimisation. Apply best visualisation principles for clarity and impact. Ensure dashboard performance … tools such as Power BI, Superset, or Tableau. Experience with AWS data tools and governance. Strong analytical mindset with a focus on business outcomes. Nice-to-Have Python or Airflow experience for automation. Knowledge of data warehouse best practices (Snowflake, BigQuery, Redshift). Experience with MS Business Central or similar ERP systems. eCommerce or omni-channel retail background. Exposure More ❯

and strengthen the organisation’s data engineering and analytics capability within its AWS-based environment. We’re ideally looking for someone with strong hands-on experience across AWS services, Airflow, Python, and SQL. You’ll play a key role in designing, building, and maintaining modern data infrastructure that powers insight-led decision-making across the business. Working within a … and key stakeholders to deliver practical, scalable solutions that make a real impact. Key Responsibilities Design, build, and maintain robust, scalable ETL/ELT pipelines using tools such as Airflow and AWS services (S3, Redshift, Glue, Lambda, Athena). Integrate new data sources and continuously optimise performance and cost efficiency. Ensure data quality, integrity, and security across all systems. … with new tools and trends in data engineering, particularly within the AWS ecosystem. Skills & Experience Strong hands-on experience with AWS (S3, Redshift, Glue, Lambda, Athena). Skilled in Airflow for workflow orchestration. Advanced SQL and proficient in Python for data engineering. Experience with data modelling (e.g. dimensional) and familiarity with NoSQL databases (e.g. Elasticsearch). Confident using Git More ❯

Senior Data Engineer | Hybrid (1-2 Days) | Up to £115K | Python, DBT, Airflow, BigQuery, GCP/AWS OB is partnered with a Unicorn FinTech that is building a world-class data platform to improve lending, and we’re looking for senior engineers who love solving real problems with clean, scalable engineering. If you’re passionate about data, backend systems … squads over time as your skills and interests evolve You may be a good fit if you Have strong experience with modern data engineering tools and patterns (DBT, BigQuery, Airflow, Terraform, GCP/AWS) Write high-quality software with Python and SQL Understand ETL/ELT, orchestration, warehousing, and streaming data flows Bring a DevOps mindset: CI/CD … learning from peers If you are interested in this role, please send your CV to jonah.brookes@oliverbernard.com Senior Data Engineer | Hybrid (1-2 Days) | Up to £115K | Python, DBT, Airflow, BigQuery, GCP/AWS More ❯

Senior Data Engineer | Hybrid (1-2 Days) | Up to £115K | Python, DBT, Airflow, BigQuery, GCP/AWS OB is partnered with a Unicorn FinTech that is building a world-class data platform to improve lending, and we’re looking for senior engineers who love solving real problems with clean, scalable engineering. If you’re passionate about data, backend systems … squads over time as your skills and interests evolve You may be a good fit if you Have strong experience with modern data engineering tools and patterns (DBT, BigQuery, Airflow, Terraform, GCP/AWS) Write high-quality software with Python and SQL Understand ETL/ELT, orchestration, warehousing, and streaming data flows Bring a DevOps mindset: CI/CD … learning from peers If you are interested in this role, please send your CV to jonah.brookes@oliverbernard.com Senior Data Engineer | Hybrid (1-2 Days) | Up to £115K | Python, DBT, Airflow, BigQuery, GCP/AWS More ❯

a scaling startup in the AI and Healthcare technology sector Salary up to £150k + Equity Paddington-based (4-5 days per week in-office) Tech environment: Python | SQL | Airflow | dbt | GCP | AWS | Data Architecture | Kafka If you wish to keep your CV/data private, feel free to WhatsApp your details/CV to me, Dan - WHO WE … Senior or Lead Data Engineer , Data Manager, or similar leadership role. Strong proficiency in Python (or Scala/Java) and SQL . Hands-on experience with data orchestration tools (Airflow, dbt, Dagster, or Prefect). Solid understanding of cloud data platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery, Redshift). Experience with streaming technologies (Kafka, Kinesis, or … are giving express consent for us to process (subject to required skills) your application to our client in conjunction with this vacancy only. KEY SKILLS: Data Management | Python | SQL | Airflow | dbt | GCP | AWS | Data Architecture | Kafka | Governance | Data Quality | Cloud Data Platforms More ❯

a scaling startup in the AI and Healthcare technology sector Salary up to £150k + Equity Paddington-based (4–5 days per week in-office) Tech environment: Python | SQL | Airflow | dbt | GCP | AWS | Data Architecture | Kafka If you wish to keep your CV/data private, feel free to WhatsApp your details/CV to me, Dan … Senior or Lead Data Engineer , Data Manager, or similar leadership role. Strong proficiency in Python (or Scala/Java) and SQL . Hands-on experience with data orchestration tools (Airflow, dbt, Dagster, or Prefect). Solid understanding of cloud data platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery, Redshift). Experience with streaming technologies (Kafka, Kinesis, or … are giving express consent for us to process (subject to required skills) your application to our client in conjunction with this vacancy only. KEY SKILLS: Data Management | Python | SQL | Airflow | dbt | GCP | AWS | Data Architecture | Kafka | Governance | Data Quality | Cloud Data Platforms More ❯

a scaling startup in the AI and Healthcare technology sector Salary up to £150k + Equity Paddington-based (4–5 days per week in-office) Tech environment: Python | SQL | Airflow | dbt | GCP | AWS | Data Architecture | Kafka If you wish to keep your CV/data private, feel free to WhatsApp your details/CV to me, Dan … Senior or Lead Data Engineer , Data Manager, or similar leadership role. Strong proficiency in Python (or Scala/Java) and SQL . Hands-on experience with data orchestration tools (Airflow, dbt, Dagster, or Prefect). Solid understanding of cloud data platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery, Redshift). Experience with streaming technologies (Kafka, Kinesis, or … are giving express consent for us to process (subject to required skills) your application to our client in conjunction with this vacancy only. KEY SKILLS: Data Management | Python | SQL | Airflow | dbt | GCP | AWS | Data Architecture | Kafka | Governance | Data Quality | Cloud Data Platforms More ❯

principles. Success in this role requires excellent communication, a collaborative mindset, and proactive problem-solving to mitigate blockers and deliver scalable solutions. Candidates with experience in tools like Snowflake, Airflow, or Terraform, familiarity with infrastructure as code, and exposure to financial and operational data domains will stand out. This is a full-time onsite position in our London office … transformation and automation scripts) Azure DevOps/GitHub (CI/CD pipelines, source control) Data warehousing and ETL best practices Plusses: Experience with similar tools or technologies (e.g., Snowflake, Airflow, Terraform) Familiarity with infrastructure as code Ability to participate in architectural decisions Strong problem-solving and continuous improvement mindset More ❯

principles. Success in this role requires excellent communication, a collaborative mindset, and proactive problem-solving to mitigate blockers and deliver scalable solutions. Candidates with experience in tools like Snowflake, Airflow, or Terraform, familiarity with infrastructure as code, and exposure to financial and operational data domains will stand out. This is a full-time onsite position in our London office … transformation and automation scripts) Azure DevOps/GitHub (CI/CD pipelines, source control) Data warehousing and ETL best practices Plusses: Experience with similar tools or technologies (e.g., Snowflake, Airflow, Terraform) Familiarity with infrastructure as code Ability to participate in architectural decisions Strong problem-solving and continuous improvement mindset More ❯

Machine Learning Engineer Machine Learning Engineer – AI for Advanced Materials – Oxford (Tech stack: Python, PyTorch, TensorFlow, Scikit-learn, MLflow, Airflow, Docker, Kubernetes, AWS, Azure, GCP, Pandas, NumPy, SciPy, CI/CD, MLOps, Data Visualization, Bayesian Modelling, Probabilistic Programming, Terraform) We’re looking for a Machine Learning Engineer to join a rapidly scaling deep-tech company that’s reinventing how … Our client is seeking Machine Learning Engineers with experience in some or all of the following (full training provided to fill any gaps): Python, PyTorch, TensorFlow, Scikit-learn, MLflow, Airflow, Docker, Kubernetes, Pandas, NumPy, SciPy, CI/CD, Data Visualization, Bayesian Modelling, Probabilistic Programming, Terraform, Azure, AWS, GCP, Git, and Agile methodologies. Join a team that’s fusing AI More ❯

Machine Learning Engineer Machine Learning Engineer - AI for Advanced Materials - Oxford/Remote (UK) (Tech stack: Python, PyTorch, TensorFlow, Scikit-learn, MLflow, Airflow, Docker, Kubernetes, AWS, Azure, GCP, Pandas, NumPy, SciPy, CI/CD, MLOps, Data Visualization, Bayesian Modelling, Probabilistic Programming, Terraform) We're looking for a Machine Learning Engineer to join a rapidly scaling deep-tech company that … Our client is seeking Machine Learning Engineers with experience in some or all of the following (full training provided to fill any gaps): Python, PyTorch, TensorFlow, Scikit-learn, MLflow, Airflow, Docker, Kubernetes, Pandas, NumPy, SciPy, CI/CD, Data Visualization, Bayesian Modelling, Probabilistic Programming, Terraform, Azure, AWS, GCP, Git, and Agile methodologies. Join a team that's fusing AI More ❯

Job Title: Data Engineer Job Type: Full Time, Permanent Working location: London, Hybrid (3 office days a week) Role Purpose At Travelex we are developing modern data services, which will be at the heart of our relationship with our customers. More ❯

Job Title: Data Engineer Job Type: Full Time, Permanent Working location: London, Hybrid (3 office days a week) Role Purpose At Travelex we are developing modern data services, which will be at the heart of our relationship with our customers. More ❯

ECS images – largely in NodeJS.) ETL Pipeline Management: Develop and optimise data pipelines to enable seamless data flow and transformation. (We currently use a mix of SSIS, ETL Works, Airflow, Snowflake and are moving to Airflow/Snowflake only architecture.) Snowflake Management: Create production-ready procedures in Snowflake for moving and analysing data. System Optimisation: Improve existing backend … Can handle sensitive and confidential information Experience working with non-data stakeholders to translate their needs and generate useful results presented in an understandable way Familiarity with orchestration tools (Airflow, DBT) and data warehouse modelling Managing other data engineers Experience with customer and commercial datasets, especially in retail or FMCG A love of pets! About Jollyes Pets Jollyes are More ❯

of data modelling and data warehousing concepts Familiarity with version control systems, particularly Git Desirable Skills: Experience with infrastructure as code tools such as Terraform or CloudFormation Exposure to Apache Spark for distributed data processing Familiarity with workflow orchestration tools such as Airflow or AWS Step Functions Understanding of containerisation using Docker Experience with CI/CD pipelines More ❯

of data modelling and data warehousing concepts Familiarity with version control systems, particularly Git Desirable Skills: Experience with infrastructure as code tools such as Terraform or CloudFormation Exposure to Apache Spark for distributed data processing Familiarity with workflow orchestration tools such as Airflow or AWS Step Functions Understanding of containerisation using Docker Experience with CI/CD pipelines More ❯