2 of 2 Spark SQL Jobs in the North of England

firefighting? You will design, build and maintain ETL and ELT pipelines , lakehouse structures and semantic models using Microsoft Fabric's Dataflows Gen2, Notebooks, Spark SQL and Python. Your work will ensure data is accessible, trusted and well governed across hybrid on‐prem and cloud environments. … Essential Strong experience designing and operating scalable ETL/ELT pipelines. Hands‐on Microsoft Fabric experience (Dataflows Gen2, Notebooks, semantic models). SQL and Python proficiency, with Spark/Spark SQL exposure. Practical understanding of data quality, observability and troubleshooting. Ability ...

through to modelling and optimisation — working closely with analytics, reporting, and business stakeholders. Key Responsibilities: Design, build, and maintain data pipelines using Databricks (Spark/PySpark/SQL). Support the migration of on-premise data sources to a cloud-based Databricks platform. Develop and optimise … planning, delivery, and issue tracking using Jira. Help establish and promote data engineering standards, governance, and documentation. Tech Stack & Tools: Core Technologies: Databricks Apache Spark (PySpark/Spark SQL) Delta Lake SQL Focus Areas Databricks platform development Cloud data migration Data modelling ...