DataWorks DevOps Engineer

DataWorks DevOps Engineer - Public Sector

Max Day Rate: £445/day inside IR35
Location: Remote
Duration: 6 months
Security Clearance: SC required (additional vetting required; onboarding may take longer than usual)
Sector: Public

Job Description:

We are seeking a senior DataWorks DevOps Engineer to support public sector data and analytics initiatives. This role focuses on building, deploying, and managing large-scale data pipelines and infrastructure in cloud environments, primarily AWS.

Key Responsibilities:

• Build, deploy, and manage CI/CD pipelines using GitLab CI or Concourse.
• Design and implement infrastructure as code using Terraform.
• Support big data tooling: Hadoop, Hive, Spark, and ideally Amazon EMR or equivalents.
• Manage Linux-based systems, containerised workloads (Kubernetes/EKS optional).
• Write scripts and automation tools using Python.
• Ensure secure, reliable, and scalable deployment and monitoring of data systems.

Core Skills & Experience:

• AWS: VPC, EC2, S3, Lambda, EMR, Athena, Redshift, Security Groups, ALB/ELB, KMS, and other relevant services
• CI/CD pipelines: GitLab CI, Concourse
• Infrastructure as code: Terraform
• Big Data: Hadoop, Hive, Spark, Amazon EMR
• Linux administration and Shell Scripting
• Containerisation: Kubernetes/EKS (helpful but not mandatory)
• Python Scripting (advantageous)

Desirable/Additional Skills:

• Network and connectivity management, Kong
• Code and security analysis (SonarQube, Tenable, Vault)
• Monitoring & logging: Prometheus, Grafana, Splunk, Stackdriver
• Databases: DynamoDB, MySQL, Redshift
• Azure infrastructure experience (VM, Blob, PaaS, networking)

Notes:

• SC clearance is mandatory; additional vetting required.
• Interview process: Technical (Level IV).
• Fully remote role.

If this matches your skills and experience, please apply today!