Senior Data Engineer - Terminal.exe
- Location
- Greater London, England, United Kingdom
layer that turns raw operational data into curated, documented datasets. Concretely, you will work on: ELT pipelines from on-premises terminal databases into our Azure-based platform, with near-real-time refresh (3-minute microbatch) for operational reporting and daily batch for analytics. Extraction uses watermark-based incremental queries … over Kafka (Azure Event Hubs) to PostgreSQL staging. A multi-tenant data architecture on Azure PostgreSQL with database-per-tenant isolation and a standardized STG → ODS → DataMart layer structure driven by our internal declarative transformation framework (dewi) Our internal connector tooling written in Go, which you will help ...