5 of 5 Contract Delta Lake Jobs in the UK

frameworks and modern data engineering solutions Provide technical leadership and architectural guidance across data platform initiatives Design and govern Lakehouse architectures leveraging Databricks and Delta Lake Manage sprint planning, backlog prioritisation and delivery tracking within Agile teams Identify and mitigate delivery risks, dependencies and technical challenges Troubleshoot complex … Technical Lead, Engineering Lead, or similar hands-on leadership role Strong hands-on expertise in Python Extensive experience with Databricks, including workflows, notebooks and Delta Lake Strong experience with Apache Spark/PySpark Experience building and optimising enterprise-scale ETL pipelines Strong understanding of modern data architecture ...

Build and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF). Develop Change Data Capture (CDC) solutions to support incremental and delta data loads. Create data transformation and cleansing processes using PySpark and Spark DataFrames. Develop Python-based utilities and automation scripts to support migration … optimise data models, SQL queries, stored procedures and analytical views within Azure Synapse Analytics. Manage data ingestion, transformation and storage across Azure Data Lake Storage (ADLS) and Azure SQL environments. Support processing of structured and semi-structured data formats, including Delta Lake and JSON. Collaborate with stakeholders ...

frameworks including data masking, encryption, lineage, access controls, and regulatory adherence (GDPR, ISO 27001) Design and optimise cloud-native storage and compute architectures using Delta Lake, ADLS Gen2, Synapse, Azure SQL, Cosmos DB, and NoSQL for petabyte-scale workloads Implement event-driven and Real Time streaming architectures using … Will Ideally Bring Strong experience with Azure Data Factory, Synapse Analytics, and Azure Databricks Experience with ADLS, Azure Blob, Azure SQL DB, Cosmos DB, Delta Lake, and Oracle DB Experience with Azure Event Hub, Azure Kafka, Azure IoT Hub, and ADX Microsoft Fabric experience, including OneLake CI/ ...

Modelling, Data Warehousing. Strong background in incident resolution, requests, changes and problem-solving within SLAs. Hands-on experience with Spark, Data Architecture, SQL and Delta Lake. Cloud development experience (AWS, GCP or Azure). Working knowledge of Medallion Architecture. Demonstrated capability in implementing and supporting pipelines in demanding environments. ...

Design, develop and maintain scalable data pipelines using Python and Databricks. Build, optimise and support enterprise ETL/ELT workflows using Apache Spark and Delta Lake. Design and develop robust data models and Lakehouse architectures. Implement and manage data workflows within the Databricks ecosystem. Ensure high levels of data … initiatives. Required Skills & Experience Strong commercial experience developing data engineering solutions using Python . Extensive hands-on experience with Databricks , including Workflows, Notebooks and Delta Lake. Strong experience with Apache Spark/PySpark . Proven experience building scalable ETL/ELT pipelines. Strong SQL and data modelling skills. Experience ...