1 of 1 Apache Spark Jobs in Wigan

Data Engineer

Location
Wigan, England, United Kingdom
driving business growth and commercial success. Reporting into the Data Discipline Lead you will build streaming and batch data pipelines on AWS using Apache Spark Structured Streaming, Lakeflow Spark Declarative Pipelines (formerly DLT), and Kafka (MSK), ensuring our business teams have fast, trusted data at their fingertips. … Looking For: We’re looking for experienced Data Engineers with proven expertise in building pipelines in Databricks and a strong grasp of Apache Spark, whether in PySpark, including Structured Streaming. You should have experience with Kafka (MSK) and real-time data ingestion, as well as a deep understanding ...