Leeds, West Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Unolabs
being phased out by late 2025. This project involves migrating pipelines and platform infrastructure running on PVC to the Databricks Enterprise Edition (E2) using EC2-based compute, which enables DeltaLake, advanced security, and scalable architecture. The project also includes decomposing and migrating core components of a centralized automation framework, a multi-repository CI/CD system that … cloud-native environments. Strong experience with AWS services including EC2, IAM, ECR, S3, and Autoscaling. Deep knowledge of Databricks, including workspace setup, instance profiles, notebook CI/CD, and DeltaLake capabilities. Hands-on with Terraform for infrastructure provisioning and GitLab/Jenkins for pipeline orchestration. Experience with Docker, container image lifecycle, and secure CI/CD container More ❯
a fast-paced and agile environment What We're Looking For : Essential Skills : Solid DevOps experience including GitHub Actions and Jenkins Proficient in Python and shell scripting Experience with DeltaLake table formats Strong data engineering background Proven experience working with large datasets Nice to Have : Familiarity with Airflow Background in full stack development Team & Culture : Join a More ❯
a fast-paced and agile environment What We're Looking For : Essential Skills : Solid DevOps experience including GitHub Actions and Jenkins Proficient in Python and shell scripting Experience with DeltaLake table formats Strong data engineering background Proven experience working with large datasets Nice to Have : Familiarity with Airflow Background in full stack development Team & Culture : Join a More ❯
Jenkins). Familiarity with large-scale data management and engineering best practices. Bonus Points For Workflow orchestration tools like Airflow. Working knowledge of Kafka and Kafka Connect. Experience with DeltaLake and lakehouse architectures. Proficiency in data serialization formats: JSON, XML, PARQUET, YAML. Cloud-based data services experience. Ready to build the future of data? If you're More ❯
Jenkins). Familiarity with large-scale data management and engineering best practices. Bonus Points For Workflow orchestration tools like Airflow. Working knowledge of Kafka and Kafka Connect. Experience with DeltaLake and lakehouse architectures. Proficiency in data serialization formats: JSON, XML, PARQUET, YAML. Cloud-based data services experience. Ready to build the future of data? If you're More ❯
