1 of 1 AWS Lambda Jobs in Wigan

Data Engineer

Hiring Organisation
Appcast
Location
Wigan, Greater Manchester, UK
optimising the Databricks-based Lakehouse that drives real-time data, analytics, and reporting across the Tote.You’ll build streaming and batch data pipelines on AWS using Apache Spark Structured Streaming, Delta Live Tables (DLT), and Kafka (MSK), ensuring our business teams across Liquidity, Product, Marketing, Finance, and Compliance have … Silver, and Gold Delta tables that serve as the foundation for analytics, APIs, and decision-making tools. You’ll integrate data from Kafka (MSK), AWS S3, and external APIs, ensuring seamless ingestion into the Lakehouse.You’ll work closely with BI teams to enable high-performance Power BI dashboards through ...