Data Engineer
- Hiring Organisation
- UK Tote Group
- Location
- Wigan, Greater Manchester, United Kingdom
- Salary
- £ 60 K
Data Engineer, you’ll play a key role in designing, building, and optimising the Databricks-based Lakehouse that drives real-time data, analytics, and reporting across the Tote.You’ll build streaming and batch data pipelines on AWS using Apache Spark Structured Streaming, Delta Live Tables (DLT), and Kafka (MSK), ensuring … across the organisation. By applying the Medallion Architecture, you’ll develop robust Bronze, Silver, and Gold Delta tables that serve as the foundation for analytics, APIs, and decision-making tools. You’ll integrate data from Kafka (MSK), AWS S3, and external APIs, ensuring seamless ingestion into the Lakehouse.You’ll work ...