AWS Data Engineer (Active SC)
AWS Data Engineer (Active SC)
Full time/ perm
Our client is seeking Security Cleared AWS Data Engineers at all levels to design, build, and support scalable cloud-based data solutions. You will develop robust data pipelines, automate workflows, and deliver secure, high-performance data platforms using AWS-native technologies.
Key Responsibilities
- Develop and maintain data pipelines using Python, SQL, and Apache Airflow.
- Build and manage containerised data applications using Docker.
- Design and optimise solutions using AWS services including Redshift, OpenSearch, Lambda, Glue, Step Functions, and Batch.
- Implement CI/CD pipelines using GitLab or similar tools.
- Monitor, troubleshoot, and improve data pipeline performance and reliability.
- Collaborate with cross-functional teams to deliver secure and scalable data platforms.
- Ensure adherence to data governance, security, and best practice standards.
Essential Skills
- Active Security Clearance
- Strong experience with Python and SQL.
- Hands-on experience with Apache Airflow and Docker.
- Proven experience with AWS data services, including Redshift, OpenSearch, Lambda, Glue, Step Functions, and Batch.
- Experience with Git, GitLab, and CI/CD pipelines.
- Understanding of AWS security best practices, IAM, and RBAC.
Desirable Skills
- Experience with Athena, SQS, CloudWatch, CloudTrail, or EMR.
- Knowledge of Terraform or CloudFormation.
- Experience in consultancy or client-facing environments.
Personal Attributes
- Strong problem-solving and troubleshooting skills.
- Excellent communication and stakeholder management abilities.
- Collaborative approach and experience working in Agile teams.
- Proactive mindset with a focus on continuous improvement.