12 of 12 Delta Lake Jobs in the North West

timely, reliable and well-governed data across the organisation. You’ll: Design and develop scalable batch and streaming data pipelines using Databricks, Spark and Delta Lake Optimise Spark jobs and workflows to meet near real-time monitoring SLAs Build and maintain streaming pipelines using Structured Streaming and Delta … technical leader and mentor , raising standards across the data engineering community What you’ll bring Deep expertise in Databricks (Spark/PySpark, Delta Lake, Unity Catalog, Workflows) Strong experience building ETL/ELT pipelines , both batch and streaming Advanced Python and SQL skills Hands-on experience with cloud ...

scalable ETL/ELT data pipelines. Microsoft Fabric, including Data Factory, Dataflow Gen2 and Fabric Notebooks. Databricks Workflows and Lakehouse technologies. PySpark, SQL and Delta Lake environments. Data ingestion, transformation and orchestration processes. Data governance, security and quality initiatives. Enterprise-wide analytics and reporting solutions, including Power … data transformation best practices. Experience building and supporting production-grade data pipelines. Hands-on experience with Microsoft Fabric. Experience with Databricks and Delta Lake technologies. Understanding of Lakehouse architecture and modern data platforms. Experience delivering data solutions that support analytics and business reporting. Interested? This is a rare ...

secure networks Specialist tracks (we'd love depth in one of these; you don't need all of them) Azure/Databricks Azure Data Lake Storage, Databricks, Apache Spark, Delta Lake, Azure Data Factory, MLflow; and, for the AI edge, Databricks Mosaic AI, Vector Search and Unity ...

extensive benefits package. What you'll be doingDesign, build and maintain scalable data pipelines and data products using Databricks, PySpark, Spark SQL and Delta Lake.Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems.Shape enterprise data architecture, balancing scalability, performance, security … mature a growing data function.What you need to bring“Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc)Advanced SQL and Python coding skills.A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions.Solid ...

extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise data architecture, balancing … growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions. ...

This is hands‐on delivery in a regulated iGaming environment: production pipelines, not notebooks. Key responsibilities Migrate ML data pipelines from Databricks (Spark/Delta Lake) to the SageMaker-based "golden template" architecture, working to the pattern set by the Lead ML Ops Engineer Build and amend feature … engineering pipelines, feature store integrations, and data access layers (S3, Glue, Lake Formation) supporting migrated models Implement parity and statistical testing to prove migrated pipelines/models match Databricks outputs Handle data migration/integration between Databricks and AWS: storage, permissions, IAM alignment Work within CI/ ...

Service) Mandatory Skills Azure Databricks Platform Engineering Hands-on implementation and troubleshooting of Azure Databricks Databricks Serverless configuration and workload optimisation Databricks SQL and Delta Lake development Cluster management, compute policies, autoscaling, and workload monitoring Data Engineering Strong Python, PySpark, and SQL development skills Design and build ingestion ...

scalable data solutions. Strong hands-on experience with Microsoft Fabric and Databricks. Strong programming capability across PySpark and T-SQL. Experience working with Delta Lake, Lakehouse architectures and modern cloud data platforms. Understanding of data quality frameworks, testing approaches and governance principles. What's on Offer Salary ...

into technical solutions Requirements: Enterprise data warehouse architecture and design Microsoft Fabric, Azure Data Platform technologies and modern Lakehouse architectures Databricks, Unity Catalog and Delta Lake PySpark, Databricks, SQL Medallion Architecture implementation Data modelling approaches including Star Schema and Data Vault Data governance, security and access management ...

Skills & Experience: Hands-on experience with Databricks and Microsoft Fabric Experience building and running production-grade pipelines Strong PySpark and SQL skills Experience with Delta Lake and Lakehouse architectures Good grasp of data modelling, orchestration and workflow automation Comfortable working with structured and semi-structured data (Parquet, JSON ...

CPD. What You’ll Do Build — AI & automation solution development Design, build and maintain AI-powered data and document pipelines on Microsoft Fabric (Lakehouse, Delta tables, notebooks, Dataflows Gen2, pipelines) supporting CPD service lines. Apply Large Language Models (LLMs) to real consulting workflow problems — including document extraction, classification, summarisation … with practical experience building data and AI pipelines end-to-end (ingestion → transformation → modelling → delivery). Working proficiency in Microsoft Fabric — Lakehouse, Delta Lake, notebooks, Dataflows Gen2 and pipelines — in line with ERM's strategic adoption of the integrated Fabric Data Platform. Strong Power BI skills, including semantic ...

cloud data environments Expertise in PySpark, SQL and data transformation practices Experience building production-grade data pipelines Knowledge of Microsoft Fabric Experience working with Delta Lake and Lakehouse architectures ...