2 of 2 Permanent Delta Lake Jobs in the North West

pipelines within a Databricks Lakehouse environment. You’ll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams, you will help … Experience building streaming and batch pipelines using Spark Structured Streaming Hands-on experience with Kafka (MSK) and real-time data ingestion Strong understanding of Delta Lake, Delta Live Tables, and Medallion Architecture Proficiency in Python and SQL for data engineering and analytics TO BE CONSIDERED... Please either ...

transformations, stored procedures, and performance basics 3+ years Azure Data Factory, including pipeline development, parameter usage, and basic templates 3+ years Databricks experience (PySpark, Delta Lake, notebooks) 2+ years Python Experience Experience working with data warehouses and structured modelling concepts Strong understanding of ETL/ELT practices … data centric engineering Desirable Exposure to metadata driven or config driven engineering practices Basic PySpark optimisation or Delta Lake performance tuning Experience using Azure DevOps (repos, pipelines) Understanding of data governance, data quality tooling, or lineage concepts Experience in regulated environments or financial services The Application Timeline ...