Senior Software Engineer

Senior Python Data Engineer

Location: Remote (London office available)

Type: Full-time

We’re looking for an experienced Senior Python Data Engineer to join a small, highly skilled engineering team building a next-generation Financial Services Data and Compliance Intelligence platform .

You’ll work at the intersection of data engineering, AI, and large-scale analytics , designing systems that collect, process, and analyse massive volumes of structured and unstructured regulatory and financial data.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and backend systems in Python using FastAPI and modern cloud services.
• Build and optimise ETL frameworks to ingest, clean, and transform high-volume datasets from multiple external APIs and internal sources.
• Collaborate with the data science team to productionise AI/LLM models , ensuring data quality, traceability, and performance.
• Take ownership of core data services, contributing to architectural decisions as we transition our cloud infrastructure from Azure to GCP (and potentially AWS ).
• Implement best practices for data governance, observability, and monitoring , ensuring compliance with security and regulatory standards.
• Work closely with product and engineering teams to deliver data-driven insights that enhance automation and regulatory intelligence.

About You

• Strong professional experience with Python , particularly in data engineering or backend development .
• Deep understanding of data modelling, ETL/ELT processes, and distributed data systems .
• Hands-on experience with SQL/NoSQL databases , and data frameworks like Pandas, PySpark, or Airflow .
• Cloud experience with GCP, Azure, or AWS (BigQuery, Dataflow, ADF, Glue, or similar).
• Comfortable working autonomously in a fast-moving environment, with the curiosity and initiative to explore new data technologies.
• Familiarity with LLMs, ML pipelines, or data science workflows is a plus.
• Knowledge of financial services, compliance, or regulatory data is beneficial but not essential.

Tech Stack

• Languages: Python (FastAPI, Pandas, PySpark)
• Databases: MongoDB, PostgreSQL
• Data Processing: Airflow, Redis, GCP BigQuery / Azure Data Factory
• Cloud: Azure (migrating to GCP; AWS potential)
• Frontend: Next.js / React (for internal tools)

What We Offer

• Flexible remote working, with an optional London office for in-person collaboration.
• The opportunity to shape the data backbone of a cutting-edge AI-driven platform in financial compliance.
• A collaborative, low-bureaucracy environment where your work has immediate impact and visibility.