AWS Data Engineer (Active SC)

AWS Data Engineer (Active SC)

Full time/ perm

Our client is seeking Security Cleared AWS Data Engineers at all levels to design, build, and support scalable cloud-based data solutions. You will develop robust data pipelines, automate workflows, and deliver secure, high-performance data platforms using AWS-native technologies.

Key Responsibilities

  • Develop and maintain data pipelines using Python, SQL, and Apache Airflow.
  • Build and manage containerised data applications using Docker.
  • Design and optimise solutions using AWS services including Redshift, OpenSearch, Lambda, Glue, Step Functions, and Batch.
  • Implement CI/CD pipelines using GitLab or similar tools.
  • Monitor, troubleshoot, and improve data pipeline performance and reliability.
  • Collaborate with cross-functional teams to deliver secure and scalable data platforms.
  • Ensure adherence to data governance, security, and best practice standards.

Essential Skills

  • Active Security Clearance
  • Strong experience with Python and SQL.
  • Hands-on experience with Apache Airflow and Docker.
  • Proven experience with AWS data services, including Redshift, OpenSearch, Lambda, Glue, Step Functions, and Batch.
  • Experience with Git, GitLab, and CI/CD pipelines.
  • Understanding of AWS security best practices, IAM, and RBAC.

Desirable Skills

  • Experience with Athena, SQS, CloudWatch, CloudTrail, or EMR.
  • Knowledge of Terraform or CloudFormation.
  • Experience in consultancy or client-facing environments.

Personal Attributes

  • Strong problem-solving and troubleshooting skills.
  • Excellent communication and stakeholder management abilities.
  • Collaborative approach and experience working in Agile teams.
  • Proactive mindset with a focus on continuous improvement.

Job Details

Company
True North Group
Location
London, South East, England, United Kingdom
Employment Type
Full-Time
Salary
Salary negotiable
Posted