AWS Data Engineer

Senior Data Engineer - London (Hybrid 3 to 4 days)

Type: Full-time
Location: London, UK

Help Build the Future of Data in Financial Services

A leading financial services client is growing its data engineering team and is looking for experienced engineers who are passionate about building scalable, high-quality data systems. This is an opportunity to work on globally impactful products in a modern cloud environment, alongside a collaborative team that values clean code, continuous learning, and strong engineering principles.

What You'll Be Doing

You'll be a key contributor to the development of a next-generation data platform, with responsibilities including:

• Designing and implementing scalable data pipelines using Python and Apache Spark
• Building and orchestrating workflows using AWS services such as Glue, Lambda, S3, and EMR Serverless
• Applying best practices in software engineering: CI/CD, version control, automated testing, and modular design
• Supporting the development of a lakehouse architecture using Apache Iceberg
• Collaborating with product and business teams to deliver data-driven solutions
• Embedding observability and quality checks into data workflows
• Participating in code reviews, pair programming, and architectural discussions
• Gaining domain knowledge in financial data and sharing insights with the team

What They're Looking For

Core Requirements

• Proficiency in Python, with a focus on clean, maintainable code (bonus for experience with type hints, linters, and testing frameworks like pytest)
• Solid understanding of data engineering fundamentals: ETL/ELT, schema evolution, batch processing
• Experience or strong interest in Apache Spark for distributed data processing
• Familiarity with AWS data tools (e.g., S3, Glue, Lambda, EMR)
• Strong communication skills and a collaborative mindset
• Comfortable working in Agile environments and engaging with stakeholders

Bonus Skills

• Experience with Apache Iceberg or similar table formats (e.g., Delta Lake, Hudi)
• Exposure to CI/CD tools like GitHub Actions, GitLab CI, or Jenkins
• Familiarity with data quality frameworks such as Great Expectations or Deequ
• Interest in financial markets, investment analytics, or index data

Why Join This Team?

• Work on mission-critical systems used by financial professionals worldwide
• Solve real-world data challenges at scale
• Collaborate with a diverse team of engineers and domain experts
• Enjoy a flexible hybrid working model with autonomy and support
• Accelerate your career with learning opportunities and mentorship

Diversity & Inclusion

The client is committed to fostering an inclusive and accessible workplace. They welcome applicants from all backgrounds and provide accommodations throughout the hiring process to ensure fairness and equity.

Interested?

If you're excited about building data systems that matter, enjoy writing clean code, and want to grow in a collaborative environment - this could be the perfect next step in your career.