Senior Data Engineer
You will be joining a fast growing consultancy at the forefront of secure data and cloud infrastructure, building AI-ready platforms for high-impact projects.
As a Data Engineer, you'll help build and maintain a secure batch and Real Time data platform for a government client. You'll work with modern commercial and open-source tools to ingest, transform, and deliver data to support analytics and decision-making.
Duties & Responsibilities
- Build, test, and maintain data pipelines
- Design logical and physical data models
- Support the growth of the data platform to meet new use cases
- Analyse data and improve processing performance
- Ensure data aligns with agreed architecture and standards
- Troubleshoot data issues and identify improvements
Core Experience & Competencies
You'll have a degree (or equivalent experience) and meet the core requirements below.
Essential
- Experience building data pipelines
- Understanding of data modelling and data structures
- Familiarity with Agile delivery methods
- Experience with AWS (eg EC2, RDS, Lambda, Athena, Glue)
- Knowledge of relational and NoSQL databases
- Python or similar Scripting language
- Experience with test-driven development
Preferred
- CI tools (eg Jenkins, Drone)
- Infrastructure as Code (Terraform)
- Configuration tools (Ansible, Packer)
- Linux and Windows environments
Due to the nature of this role, candidates must be eligible for an enhanced DV Security Clearance with sole British nationality.
Reasonable Adjustments:
Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built, and we welcome applications from people of all backgrounds and perspectives. Our success is driven by our people, united by the spirit of partnership to deliver the best resourcing solutions for our clients.
If you need any help or adjustments during the recruitment process for any reason , please let us know when you apply or talk to the recruiters directly so we can support you.