Data DevOps Engineer

Data DevOps Engineer

Are you passionate about building scalable, reliable data infrastructure in the cloud? Join our innovative team as a Data DevOps Engineer and play a pivotal role in transforming how data powers decision-making and operational excellence. This is your chance to work at the forefront of cloud-native data architecture, ensuring seamless deployment, management, and optimization of large-scale analytics solutions that drive impactful insights and business growth.

Compensation: £85,000 p/a

Work Model: 3 days on site per week in Watford

What You'll Do:

• Design, implement, and maintain AWS-based data infrastructure leveraging Redshift, S3, EMR, and other cloud services.
• Develop and oversee CI/CD pipelines for ETL processes and Power BI deployments, ensuring rapid, error-free code releases.
• Automate environment provisioning and data workflows using Terraform, Docker, Kubernetes, Python, and other automation tools.
• Manage data provisioning workflows, environment freshness, and synchronization across development, testing, and production stages.
• Optimize data pipelines for performance, resource utilization, and cost efficiency while ensuring high reliability and scalability.
• Establish observability frameworks with CloudWatch, Grafana, or Datadog for proactive monitoring and troubleshooting.
• Collaborate with cross-functional teams to enhance deployment strategies, resolve technical issues, and implement best practices in security, compliance, and governance.
• Continuously explore innovative cloud services and tools to improve deployment speed, operational efficiency, and developer experience.

Required Skills:

• Extensive experience with AWS cloud services (Redshift, S3, Lambda, EMR, CloudFormation/Terraform).
• Proficiency in CI/CD tools such as Jenkins, GitHub Actions, or similar.
• Strong scripting skills in Python for automation, logging, and observability integrations.
• Expertise in SQL, especially Redshift, and in managing large-scale data processing frameworks like Spark and EMR.
• Hands-on experience with containerization (Docker, Kubernetes).
• Professional certifications such as AWS Certified Solutions Architect and AWS Certified DevOps Engineer are highly desirable.
• Deep understanding of environment management, code promotion, deployment pipelines, and release management.
• Familiarity with Jira integrations and data provisioning automation.

Nice to Have Skills:

• Experience with Power BI, DAX, and data modeling for optimized reporting.
• Knowledge of big data orchestration tools like Apache Airflow.
• Previous exposure to regulated environments such as finance, healthcare, or gaming.
• Experience in a lottery or similar domain is a plus.

Preferred Education & Experience:

• Bachelor’s or Master’s degree in Computer Science, Data Analytics, or related field.
• Several years of professional experience in cloud data engineering, DevOps, or related roles.

Other Requirements:

• Ability to work within an agile team, managing multiple deliverables simultaneously.
• Strong troubleshooting skills and the ability to diagnose complex cloud-based issues.
• Commitment to security, compliance, and best practices in data governance.

Take the next step in your career—apply now and be part of a transformative journey to create a more innovative, reliable, and impactful data environment that makes a real difference!