Lead DataOps Engineer - SC, DataOps, Cloud

Lead DataOps Engineer - SC, DataOps, Cloud Location: London (Hybrid)Type: PermanentSalary: £72,000 - £90,000 (depending on experience) + benefitsSecurity: Must be able to undergo security clearanceAbout the RoleAs a Lead DataOps Engineer, you'll be at the forefront of delivering automated, scalable data solutions that power modern analytics and applications. This role combines the best of data engineering and DevOps, focusing on containerized environments, orchestration, and continuous delivery. You'll lead initiatives to streamline data workflows, optimize performance, and ensure reliability across cloud platforms-while guiding teams with strong technical leadership.Key Responsibilities* Pipeline Automation: Build and orchestrate data workflows using tools like Airflow, Prefect, or Dagster.* Containerization: Package and deploy data applications using Docker and Kubernetes (including EKS and AKS).* CI/CD for Data: Implement and maintain automated pipelines for data applications.* Monitoring & Observability: Deploy solutions using Grafana, Prometheus, and other tools to ensure data quality and system health.* Infrastructure as Code: Use Terraform and Ansible to provision and manage data infrastructure.* Performance Optimization: Enhance data processing for speed, scalability, and reliability.What We're Looking For* Strong experience with orchestration tools (Airflow, Prefect, Dagster).* Expertise in Docker and Kubernetes.* Solid understanding of CI/CD principles and tooling.* Familiarity with open-source data technologies (Spark, Kafka, PostgreSQL).* Knowledge of Infrastructure as Code (Terraform, Ansible).* Understanding of data architecture principles.* Experience with monitoring tools like Grafana and Prometheus.* Strong leadership skills to guide teams and influence technical direction.Why Join Us You'll work on innovative projects in a collaborative environment that values automation, scalability, and inclusion. Hybrid working gives you flexibility while contributing to impactful solutions.Application ProcessAdecco operates as an Employment Agency and is an equal opportunities employer. Your CV will be treated with the utmost confidentiality, and we will always discuss your application with you before presenting it to any potential employer.Please note we are on the client's supplier list for this position.KeywordsLead DataOps Engineer, DataOps, Data Pipeline Automation, Airflow, Prefect, Dagster, Docker, Kubernetes, EKS, AKS, CI/CD, Terraform, Ansible, Grafana, Prometheus, Spark, Kafka, PostgreSQL, Infrastructure as Code, Cloud Data Engineering, Hybrid Working, Security Clearance, Leadership, DevOps, Observability, Monitoring.