2 of 2 Contract Delta Lake Jobs in the Midlands

Build and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF). Develop Change Data Capture (CDC) solutions to support incremental and delta data loads. Create data transformation and cleansing processes using PySpark and Spark DataFrames. Develop Python-based utilities and automation scripts to support migration … optimise data models, SQL queries, stored procedures and analytical views within Azure Synapse Analytics. Manage data ingestion, transformation and storage across Azure Data Lake Storage (ADLS) and Azure SQL environments. Support processing of structured and semi-structured data formats, including Delta Lake and JSON. Collaborate with stakeholders ...

frameworks including data masking, encryption, lineage, access controls, and regulatory adherence (GDPR, ISO 27001) Design and optimise cloud-native storage and compute architectures using Delta Lake, ADLS Gen2, Synapse, Azure SQL, Cosmos DB, and NoSQL for petabyte-scale workloads Implement event-driven and Real Time streaming architectures using … Will Ideally Bring Strong experience with Azure Data Factory, Synapse Analytics, and Azure Databricks Experience with ADLS, Azure Blob, Azure SQL DB, Cosmos DB, Delta Lake, and Oracle DB Experience with Azure Event Hub, Azure Kafka, Azure IoT Hub, and ADX Microsoft Fabric experience, including OneLake CI/ ...