experience designing and implementing robust, performant data pipelines from a variety of sources such as databases, APIs, SFTP, etc. Experience building ELT pipelines using tools such as dbt and Airflow Proven experience managing software engineering teams, including mentoring juniors and seniors, and promoting professional development. Demonstrated experience in project management, with the ability to manage multiple projects and prioritize More ❯
ETL using big data tools (HIVE/Presto, Redshift) Previous experience with web frameworks for Python such as Django/Flask is a plus Experience writing data pipelines using Airflow Fluency in Looker and/or Tableau Strong understanding of data warehousing principles, pipelines, and APIs Strong communication skills The ability to work independently and across multiple time zones More ❯
.NET framework backend services and React frontends. You'll utilise tools such as Terraform for infrastructure-as-code ( IaC ), AWS (Lambda, EC2, EKS, Step Functions, VPC etc.) for ETL, Airflow pipelines, Snowflake, and ensure architectural alignment with AI/ML initiatives and data-driven services. You will serve as the go-to engineer for: End-to-end data migration More ❯
learningknowledge Effective communication skills toworkwith different stakeholders/team members with varying degrees of knowledge in Data Science A collaborative team player Highly Desirable qualifications : Hands-on experience in Airflow Commercial experience in softwaredevelopment CommercialML Opsexperience Life at WPP Media & Benefits Our passion for shaping the next era of media includes investing in our employees to help them do More ❯
Lumi Space is empowering the future prosperity of earth - making space scalable and sustainable using ground-based laser systems. We work with global companies and institutions to build products and services to precisely track satellites and remove the dangers of More ❯
Lumi Space is empowering the future prosperity of earth - making space scalable and sustainable using ground-based laser systems. We work with global companies and institutions to build products and services to precisely track satellites and remove the dangers of More ❯
Sciences subject A good understanding of GIS and its practical application. Experience using GIS; QGIS ideally but ArcGIS, MapInfo or ESRI are also useful Any experience with FME, AWS, ApacheAirflow, PGSQL or GeoServer is a distinct advantage This role is not eligible for sponsorship and so you must have the right to work in the UK Salary More ❯
BN1, Brighton, Brighton and Hove, East Sussex, United Kingdom
First Recruitment Services
Sciences subject A good understanding of GIS and its practical application. Experience using GIS; QGIS ideally but ArcGIS, MapInfo or ESRI are also useful Any experience with FME, AWS, ApacheAirflow, PGSQL or GeoServer is a distinct advantage This role is not eligible for sponsorship and so you must have the right to work in the UK Salary More ❯
standardized Spark SQL and PySpark code for data transformations, ensuring data integrity and accuracy across the pipeline. Automate pipeline orchestration using Databricks Workflows or integration with external tools (e.g., ApacheAirflow, Azure Data Factory). Data Ingestion & Transformation: Build scalable data ingestion processes to handle structured, semi-structured, and unstructured data from various sources (APIs, databases, file systems More ❯
Code) Create terraform scripts for the infrastructure provisioning Set up infrastructure security Implementation of IAM policy and permissions for applications and GitHub Changes of environment variables for applications and Airflow DAGS More ❯
Looking for an AI Engineer specialised in the Agentic AI Space Required Skill Set- Python Machine Learning APIs (TEST, GraphQL) AWS/Azure cloud Experience Data Pipeline tools (Airflow/Prefect) Contract- 6 month contract Outside IR35 1 stage interview 1-2 days on site in London per month More ❯
Code • Create Terraform scripts for the infrastructure provisioning • Set up infrastructure security • Implementation of IAM policy and permissions for applications and GitHub • Changes of environment variables for applications and Airflow DAGS If you are interested please hit apply with your updated CV and we will arrange a call to further your application. More ❯
Code • Create Terraform scripts for the infrastructure provisioning • Set up infrastructure security • Implementation of IAM policy and permissions for applications and GitHub • Changes of environment variables for applications and Airflow DAGS If you are interested please hit apply with your updated CV and we will arrange a call to further your application. More ❯
Code • Create Terraform scripts for the infrastructure provisioning • Set up infrastructure security • Implementation of IAM policy and permissions for applications and GitHub • Changes of environment variables for applications and Airflow DAGS If you are interested please hit apply with your updated CV and we will arrange a call to further your application. More ❯
Code • Create Terraform scripts for the infrastructure provisioning • Set up infrastructure security • Implementation of IAM policy and permissions for applications and GitHub • Changes of environment variables for applications and Airflow DAGS If you are interested please hit apply with your updated CV and we will arrange a call to further your application. More ❯
East London, London, United Kingdom Hybrid / WFH Options
RP International
Code • Create Terraform scripts for the infrastructure provisioning • Set up infrastructure security • Implementation of IAM policy and permissions for applications and GitHub • Changes of environment variables for applications and Airflow DAGS If you are interested please hit apply with your updated CV and we will arrange a call to further your application. More ❯
City of London, London, United Kingdom Hybrid / WFH Options
RP International
Code • Create Terraform scripts for the infrastructure provisioning • Set up infrastructure security • Implementation of IAM policy and permissions for applications and GitHub • Changes of environment variables for applications and Airflow DAGS If you are interested please hit apply with your updated CV and we will arrange a call to further your application. More ❯
Bury, Greater Manchester, United Kingdom Hybrid / WFH Options
RP International
Code • Create Terraform scripts for the infrastructure provisioning • Set up infrastructure security • Implementation of IAM policy and permissions for applications and GitHub • Changes of environment variables for applications and Airflow DAGS If you are interested please hit apply with your updated CV and we will arrange a call to further your application. More ❯
Altrincham, Greater Manchester, United Kingdom Hybrid / WFH Options
RP International
Code • Create Terraform scripts for the infrastructure provisioning • Set up infrastructure security • Implementation of IAM policy and permissions for applications and GitHub • Changes of environment variables for applications and Airflow DAGS If you are interested please hit apply with your updated CV and we will arrange a call to further your application. More ❯
Leigh, Greater Manchester, United Kingdom Hybrid / WFH Options
RP International
Code • Create Terraform scripts for the infrastructure provisioning • Set up infrastructure security • Implementation of IAM policy and permissions for applications and GitHub • Changes of environment variables for applications and Airflow DAGS If you are interested please hit apply with your updated CV and we will arrange a call to further your application. More ❯
Leeds, West Yorkshire, United Kingdom Hybrid / WFH Options
RP International
Code • Create Terraform scripts for the infrastructure provisioning • Set up infrastructure security • Implementation of IAM policy and permissions for applications and GitHub • Changes of environment variables for applications and Airflow DAGS If you are interested please hit apply with your updated CV and we will arrange a call to further your application. More ❯
Bolton, Greater Manchester, United Kingdom Hybrid / WFH Options
RP International
Code • Create Terraform scripts for the infrastructure provisioning • Set up infrastructure security • Implementation of IAM policy and permissions for applications and GitHub • Changes of environment variables for applications and Airflow DAGS If you are interested please hit apply with your updated CV and we will arrange a call to further your application. More ❯
Central London / West End, London, United Kingdom Hybrid / WFH Options
RP International
Code • Create Terraform scripts for the infrastructure provisioning • Set up infrastructure security • Implementation of IAM policy and permissions for applications and GitHub • Changes of environment variables for applications and Airflow DAGS If you are interested please hit apply with your updated CV and we will arrange a call to further your application. More ❯
Ashton-Under-Lyne, Greater Manchester, United Kingdom Hybrid / WFH Options
RP International
Code • Create Terraform scripts for the infrastructure provisioning • Set up infrastructure security • Implementation of IAM policy and permissions for applications and GitHub • Changes of environment variables for applications and Airflow DAGS If you are interested please hit apply with your updated CV and we will arrange a call to further your application. More ❯
critical trading workflows What We’re Looking For: Strong Python development skills, especially in a data engineering or quant dev context Experience with workflow orchestrators like Dagster (big plus), Airflow, or Prefect Familiarity with tools like Postgres, Kafka, Snowflake, and cloud-based storage Ability to thrive in a high-performance, collaborative trading environment If you're passionate about credit More ❯