Lead Data Engineer , Data Manager, or similar leadership role. Strong proficiency in Python (or Scala/Java) and SQL . Hands-on experience with data orchestration tools (Airflow, dbt, Dagster, or Prefect). Solid understanding of cloud data platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery, Redshift). Experience with streaming technologies (Kafka, Kinesis, or similar). More ❯
engineers. Solid programming skills in Python and SQL, and familiarity with tools such as Git, CI/CD workflows, Docker, and Kubernetes. Experience with data pipeline orchestration tools (e.g., Dagster) and modern data stack components. Why Join Us Help shape the future of responsible, high-impact data and AI solutions in infrastructure, engineering, and consulting. Work alongside a mature More ❯
technical issues to non-technical folks succinctly. Bonus Points If You Have 1+ year in a customer-facing role. Prior experience using or administering Apache Airflow, Autosys, UC4, Temporal, Dagster, or Prefect. Enterprise data experience with or in regulated environments. Experience with scripting/automation, specifically infra (Pulumi, Terraform, Ansible, etc.). Experience with ElasticSearch/Prometheus/Vault. More ❯
automate complex business or security processes and build intelligent solutions Solid understanding of software security principles, secure coding practices, and security automation Experience with data orchestration frameworks (e.g., Airflow, Dagster, Prefect) to manage and scale automation pipelines Familiarity with infrastructure-as-code (Terraform), CI/CD systems (BuildKite or similar), and container orchestration platforms (Kubernetes, Docker) Strong problem-solving More ❯
automate complex business or security processes and build intelligent solutions Solid understanding of software security principles, secure coding practices, and security automation Experience with data orchestration frameworks (e.g., Airflow, Dagster, Prefect) to manage and scale automation pipelines Familiarity with infrastructure-as-code (Terraform), CI/CD systems (BuildKite or similar), and container orchestration platforms (Kubernetes, Docker) Strong problem-solving More ❯
automate complex business or security processes and build intelligent solutions Solid understanding of software security principles, secure coding practices, and security automation Experience with data orchestration frameworks (e.g., Airflow, Dagster, Prefect) to manage and scale automation pipelines Familiarity with infrastructure-as-code (Terraform), CI/CD systems (BuildKite or similar), and container orchestration platforms (Kubernetes, Docker) Strong problem-solving More ❯
automate complex business or security processes and build intelligent solutions Solid understanding of software security principles, secure coding practices, and security automation Experience with data orchestration frameworks (e.g., Airflow, Dagster, Prefect) to manage and scale automation pipelines Familiarity with infrastructure-as-code (Terraform), CI/CD systems (BuildKite or similar), and container orchestration platforms (Kubernetes, Docker) Strong problem-solving More ❯
automate complex business or security processes and build intelligent solutions Solid understanding of software security principles, secure coding practices, and security automation Experience with data orchestration frameworks (e.g., Airflow, Dagster, Prefect) to manage and scale automation pipelines Familiarity with infrastructure-as-code (Terraform), CI/CD systems (BuildKite or similar), and container orchestration platforms (Kubernetes, Docker) Strong problem-solving More ❯
automate complex business or security processes and build intelligent solutions Solid understanding of software security principles, secure coding practices, and security automation Experience with data orchestration frameworks (e.g., Airflow, Dagster, Prefect) to manage and scale automation pipelines Familiarity with infrastructure-as-code (Terraform), CI/CD systems (BuildKite or similar), and container orchestration platforms (Kubernetes, Docker) Strong problem-solving More ❯
automate complex business or security processes and build intelligent solutions Solid understanding of software security principles, secure coding practices, and security automation Experience with data orchestration frameworks (e.g., Airflow, Dagster, Prefect) to manage and scale automation pipelines Familiarity with infrastructure-as-code (Terraform), CI/CD systems (BuildKite or similar), and container orchestration platforms (Kubernetes, Docker) Strong problem-solving More ❯
automate complex business or security processes and build intelligent solutions Solid understanding of software security principles, secure coding practices, and security automation Experience with data orchestration frameworks (e.g., Airflow, Dagster, Prefect) to manage and scale automation pipelines Familiarity with infrastructure-as-code (Terraform), CI/CD systems (BuildKite or similar), and container orchestration platforms (Kubernetes, Docker) Strong problem-solving More ❯
automate complex business or security processes and build intelligent solutions Solid understanding of software security principles, secure coding practices, and security automation Experience with data orchestration frameworks (e.g., Airflow, Dagster, Prefect) to manage and scale automation pipelines Familiarity with infrastructure-as-code (Terraform), CI/CD systems (BuildKite or similar), and container orchestration platforms (Kubernetes, Docker) Strong problem-solving More ❯
automate complex business or security processes and build intelligent solutions Solid understanding of software security principles, secure coding practices, and security automation Experience with data orchestration frameworks (e.g., Airflow, Dagster, Prefect) to manage and scale automation pipelines Familiarity with infrastructure-as-code (Terraform), CI/CD systems (BuildKite or similar), and container orchestration platforms (Kubernetes, Docker) Strong problem-solving More ❯
automate complex business or security processes and build intelligent solutions Solid understanding of software security principles, secure coding practices, and security automation Experience with data orchestration frameworks (e.g., Airflow, Dagster, Prefect) to manage and scale automation pipelines Familiarity with infrastructure-as-code (Terraform), CI/CD systems (BuildKite or similar), and container orchestration platforms (Kubernetes, Docker) Strong problem-solving More ❯
London, South East, England, United Kingdom Hybrid/Remote Options
Robert Half
The Role Build and optimise scalable data pipelines for a new Data Lake Work with Python, SQL, Spark, AWS, Docker, CI/CD Orchestrate workflows using Airflow, Prefect, or Dagster Support ETL, API integrations, and high-quality data validation Translate business needs into technical solutions with full ownership What You Need STEM degree (Computer Science, Engineering, Maths, etc.) 2+ … data engineering/analytics/software Strong Python + SQL 2+ years ETL, APIs, CI/CD, Docker, AWS Ideally but not essential experience with Airflow/Prefect/Dagster Background in Financial Services, FinTech, Insurance, PE/VC, or Banking Package & Benefits High performance bonus 25 days holiday Pension & private healthcare Join at inception - shape the team and More ❯
London, South East, England, United Kingdom Hybrid/Remote Options
Harnham - Data & Analytics Recruitment
you'll be doing: Managing and maintaining a Python-based data warehouse , ensuring reliable data ingestion and transformation. Developing and monitoring data pipelines using Meltano and orchestration tools like Dagster or Airflow . Designing and optimising SQL transformations (DBT experience a plus). Working within Azure cloud infrastructure following Infrastructure-as-Code (IaC) principles. Managing Power BI semantic models … a modern data stack for ETL/ELT processes and data warehousing. Strong SQL and Python skills, with an understanding of Kimball-style data modelling . Experience with DBT, Dagster, or Airflow for transformation and orchestration. Hands-on experience with Azure (preferred), or other cloud environments (GCP/AWS). Familiarity with Git-based version control , CI/CD More ❯
London, South East, England, United Kingdom Hybrid/Remote Options
Adecco
and Ansible to provision and manage data infrastructure.* Performance Optimization: Enhance data processing for speed, scalability, and reliability.What We're Looking For* Strong experience with orchestration tools (Airflow, Prefect, Dagster).* Expertise in Docker and Kubernetes.* Solid understanding of CI/CD principles and tooling.* Familiarity with open-source data technologies (Spark, Kafka, PostgreSQL).* Knowledge of Infrastructure as … with you before presenting it to any potential employer.Please note we are on the client's supplier list for this position.KeywordsLead DataOps Engineer, DataOps, Data Pipeline Automation, Airflow, Prefect, Dagster, Docker, Kubernetes, EKS, AKS, CI/CD, Terraform, Ansible, Grafana, Prometheus, Spark, Kafka, PostgreSQL, Infrastructure as Code, Cloud Data Engineering, Hybrid Working, Security Clearance, Leadership, DevOps, Observability, Monitoring. More ❯
