Data Engineer AWS | Kafka | Terraform - SC Cleared

Location: Remote with occasional travel to Newcastle
Work Pattern: Predominantly remote
Duration: 6 months + extension
Clearance Requirement: Active SC Clearance
Rate: £510 per day Inside IR35
SFIA Level: SFIA 4

Overview

We are seeking an experienced SC Cleared Data Engineer to support the design, build, and optimisation of secure, scalable cloud-based data platforms within a complex public sector environment. This role is ideal for a hands-on engineer with strong AWS data engineering experience, supported by solid knowledge of Terraform, Kafka, Python, and modern big data tooling such as Databricks.

Exposure to EMR would be advantageous, and Java is considered a nice to have. You will work as part of a collaborative delivery team, helping to build robust data pipelines and cloud-native data services that enable reliable, secure, and high-quality data processing.

Essential Skills:

• Strong commercial experience working as a Data Engineer within cloud-based delivery environments
• Strong AWS experience, with a focus on building and supporting data engineering solutions
• Hands-on experience using Terraform for infrastructure as code
• Good understanding of Kafka and event-driven or streaming data architectures
• Experience working with Databricks in modern data engineering environments
• Strong Python development skills, including use in data pipelines and potentially AWS Lambda
• Experience delivering secure, scalable, and maintainable data solutions in complex environments
• Strong communication skills with the ability to engage effectively with both technical and non-technical stakeholders
• Good stakeholder management skills and the ability to work collaboratively across multidisciplinary teams
• Experience working in Agile delivery environments
• Active SC Clearance

Nice To Have:

• Knowledge or experience of Amazon EMR
• Java development experience
• Experience working within Central Government or wider Public Sector environments
• Familiarity with CI/CD, version control, and engineering best practice in cloud delivery 

Desirable skills

• Knowledge or experience of Amazon EMR
• Java development experience
• Experience working within Central Government or wider Public Sector environments
• Familiarity with CI/CD, version control, and engineering best practice in cloud delivery