3 of 3 Delta Lake Jobs in the West Midlands

PySpark, Spark SQL and Python Implement and maintain CI/CD practices Enhance and optimise existing data pipelines About You Proven experience in Databricks, Delta Lake, PySpark and Spark SQL Excellent communication skills - ability to partner with the business and key stakeholders to champion best practice in data ...

Role Design and build scalable ETL/ELT pipelines in Microsoft Fabric using PySpark and SQL Develop transformation logic within Fabric Lakehouses using Delta Lake and medallion architecture principles Integrate data from ecommerce, ticketing, and marketing platforms into a central data layer Connect sources such as GA4, Google ...

business problems, such as forecasting daily/hourly reactive workloads, predicting asset failures, and optimising resource allocation. · Databricks Ecosystem Mastery: Utilise Databricks (Unity Catalog, Delta Lake, MLflow) to ingest, process, and analyse large-scale structured and unstructured data from diverse sources (e.g., SAP Datasphere, S3). · Algorithm Versatility ...