2 of 2 Permanent Spark SQL Jobs in England

forward-thinking data team What You'll Do: Build and maintain ETL/ELT pipelines and data models in Fabric (Data Factory, Notebooks, Spark) Write high-performance Spark SQL, T-SQL, Python/PySpark Manage ingestion, transformation, and loading from multiple sources … tools like GitHub Copilot, ChatGPT, and Fabric Copilot Essential Experience: Microsoft Fabric is essential Azure Data ecosystem Lakehouse architectures & Data Factory Python, PySpark, Spark SQL Proven hands-on delivery in this stack If you're an experienced Data Engineer with strong Microsoft Fabric and Azure experience ...

technical designs, data models, ETL/ELT pipelines, and engineering implementation. Provide architectural guidance to data engineers working on Azure Databricks, ADF, PySpark, SQL, and Delta Lake. Collaborate with enterprise architecture, solution architecture, security, infrastructure, DevOps, and business teams. Define CI/CD, DevOps, deployment, monitoring, and operational … modelling, dimensional modelling, canonical data models, and enterprise data models. Strong experience in designing ETL/ELT data pipelines. Good understanding of PySpark, Spark SQL, Python, and SQL. Strong knowledge of data warehouse, data lake, data mart, and semantic layer architecture. Experience in defining data quality ...