Senior Data Engineer (£90k-120k) - FinTech
We’re looking for a Senior Data Engineer to help build and scale a modern, configuration-led data platform leveraging Databricks and Snowflake. The platform is designed to enable non-technical users to define and manage complex regulatory logic, while ensuring data remains scalable, traceable, and fit for client-facing use.
This role sits within a key phase of infrastructure transformation, as the business transitions from legacy Python-based processes and MySQL databases to a more scalable cloud-native architecture. The systems underpin critical reporting workflows for financial institutions, where accuracy, transparency, and reliability are essential.
You’ll be expected to produce high-quality, maintainable, and well-tested code, while also contributing to the technical direction of the team and supporting more junior engineers.
Key Responsibilities
- Develop and enhance a configuration-driven data platform using Databricks and Snowflake
- Build, maintain, and optimise data pipelines using Python, PySpark, and streaming technologies
- Ensure data pipelines are robust, traceable, and compliant, with strong lineage and fault tolerance
- Implement and maintain data quality frameworks, including validation, monitoring, and alerting
- Optimise performance across distributed data processing and warehouse environments
- Work closely with product, engineering, DevOps, and regulatory stakeholders to translate requirements into scalable solutions
- Support and guide junior team members, contributing to overall team capability and delivery
- Continuously improve development standards, tooling, and engineering practices
Required Experience
- Proven experience building scalable and auditable data pipelines in regulated or high-integrity environments
- Strong proficiency in Python and PySpark
- Advanced SQL skills, including working with large and complex datasets
- Solid understanding of data modelling and warehouse design principles
- Strong grounding in software engineering best practices (clean code, testing, CI/CD, observability)
- Experience working with modern cloud-based data platforms and orchestration tools
- Ability to interpret and translate complex regulatory or business requirements into technical solutions
- Comfortable working independently with ownership of key systems and deliverables
Desirable Experience
- Exposure to event-driven architectures (e.g. Kafka or similar tools)
- Experience with AWS cloud environments
- Track record of building new data platforms or transforming legacy systems
- Background in financial services or FinTech