Senior Data Engineer
Senior Data Engineer | Python | Airbyte | Apache | BigQuery | EducationTech | Remote, London | £70k Looking to help shape Data Strategy for a scaling Tech-for-Good business I'm partnered with a AI-first data and analytics platform built for schools, multi-academy trusts and education groups. Their technology connects fragmented school data - attendance, behaviour, wellbeing, assessment, SEND and unstructured documents - and uses a multi-agent AI system to surface actionable insights for school leaders in seconds.They are in a high-growth phase, backed by Innovate UK funding, with a roadmap spanning predictive analytics, supplier intelligence, and international expansion. The team is mission-driven, remote-first, and growing quickly - every hire has very meaningful impact.They are looking for a Senior Data Engineer to build and maintain the data infrastructure that underpins the entire platform.You’ll own and extend the ELT pipeline - Airbyte (OSS) for extraction, Airflow on Astro for orchestration, dbt via Cosmos for transformation - and the BigQuery lakehouse beneath it, with a semantic layer on top.These are hands-on, build-and-operate roles in a team that takes engineering quality seriously.Core Responsibilities:
- ELT Pipeline Ownership: Extend and maintain the Airbyte Airflow dbt BigQuery pipeline.
- Connector Development: Build custom Airbyte OSS connectors for MIS systems and third-party platforms.
- dbt Modelling: Design and maintain dbt models across bronze/silver/gold layers.
- Lakehouse Engineering: Own schema design, optimisation, partitioning and clustering in BigQuery.
- Pipeline Reliability: Ensure data quality, observability and freshness across all pipelines.
- Architecture Contribution: Help shape the evolving data platform as the product and dataset scale.