Lead Data Platform Engineer, Perm, Remote
Lead Data Platform Engineer
Java, Kafka, AWS
Remote (UK-based)
Permanent - Up to £110,000 + Benefits
For this role, you must be eligible for SC Clearance. In this secure environment this means that you must be a British Citizen as some data is for UK Eyes Only.
We are looking for a hands-on Lead Data Platform Engineer to join a high-impact programme delivering scalable, Real Time data solutions. This role offers the opportunity to work on complex, mission-critical systems using modern technologies across streaming, cloud, and distributed data platforms.
The Role
As a Lead Data Platform Engineer, you will design and deliver batch and Real Time data pipelines that are highly available, low latency, and scalable.
You will collaborate with cross-functional teams to shape solutions, influence architecture, and ensure data is transformed into reliable, consumable outputs.
Key Responsibilities
- Design, build, and deploy data pipelines and Back End services
- Work with Real Time streaming technologies and event-driven architectures
- Champion engineering best practices including TDD, CI/CD, and clean code
- Collaborate with architects, analysts, and testers in Agile/BDD environments
- Take ownership of services in production, ensuring performance and reliability
- Drive continuous improvement across data platform capabilities
- Contribute to solution design, estimation, and delivery planning
Required Experience
- Strong production Java experience
- Experience with Kafka streaming technologies
- Hands-on experience with Spark, Flink, Kafka Streams, or similar
- Experience with Spring Boot and/or Python
- Strong experience with AWS (including Lambda and S3)
- Experience integrating with PostgreSQL, Redis, or similar
- Solid understanding of data pipelines and data modelling
- Passion for clean, testable, and maintainable code
- Experience working in Agile and/or DevOps environments
Desirable Skills
- Experience with Elasticsearch, OpenSearch, or Solr
- Familiarity with Terraform, Ansible, or Packer
- Experience with CI/CD tools such as Jenkins or Drone
This role is working for an SME who build and integrate highly secure data platforms across highly secure environments. The company are about 300 people strong, UK based and highly focused on the UK Government and national infrastructure. You will work alongside them, using your skills to build and implement their Data tools and services within critical Government clients.
You will work alongside internal experts and clients, side by side in integrated teams.
The client are a great place to work, super talented people and great benefits. You will work fully remotely (within the UK for security reasons) and will have flexibility and great benefits.
If this is of interest, please apply