Lead Data Engineer (AWS)

About Synechron:

Synechron is a leading digital transformation consulting firm specializing in banking, financial markets, and insurance. We deliver innovative solutions to complex business challenges through cutting-edge technologies and agile methodologies. Join our talented team and contribute to building impactful data solutions within a dynamic environment.

We are seeking a talented and motivated Data Engineer to join our UK team. In this role, you will design, develop, and maintain scalable data pipelines and architectures that support our clients' data-driven initiatives, particularly within the financial domain. You will work closely with business stakeholders and technical teams to translate requirements into efficient data solutions, leveraging modern cloud-based tools and frameworks.

Key Responsibilities

• Design and develop scalable, testable data pipelines utilizing Python and Apache Spark.
• Orchestrate data workflows using AWS services including Glue, EMR Serverless, Lambda, and S3.
• Apply industry-standard software engineering practices such as version control, CI/CD, modular design, and automated testing.
• Contribute to the development of a lakehouse architecture leveraging Apache Iceberg for efficient data storage and management.
• Collaborate with business teams to understand requirements and deliver insightful, data-driven solutions.
• Enhance data pipeline observability and implement basic data quality checks.
• Participate in code reviews, pair programming, and architecture discussions to promote best practices.
• Continuously expand knowledge of the financial indices domain and share insights with team members.

What You'll Bring

• Proficiency in writing clean, maintainable Python code, ideally with type hints, linters, and testing frameworks like pytest.
• Fundamental understanding of data engineering concepts: batch processing, schema evolution, and ETL pipeline development.
• Eagerness to learn and work with Apache Spark for large-scale data processing.
• Familiarity with AWS data stack components such as S3, Glue, Lambda, and EMR.
• Strong interest in understanding business context and working collaboratively with stakeholders.
• Ability to thrive in Agile team environments, valuing teamwork and shared success.

Nice-to-Have Skills

• Experience with Apache Iceberg or similar table formats.
• Knowledge of CI/CD tools like GitLab CI, Jenkins, or GitHub Actions.
• Exposure to data quality frameworks such as Great Expectations or Deequ.
• Curiosity about financial markets, index data, or investment analytics.