4 of 4 Delta Lake Jobs in the Midlands

/ELT pipelines using PySpark, SQL and orchestration frameworks Automate and modernise legacy data processes with reusable patterns Design robust data models (Delta Lake, schema evolution, metadata, lineage) Ensure data security, governance, and compliance (access control, encryption, lifecycle) Provide technical leadership, mentoring and design reviews Collaborate with stakeholders … analysis, profiling and insight delivery Cloud & Platforms Azure: Data Factory, Synapse, Databricks, ADLS Gen2, Event Hub, Purview AWS: S3, Glue, Athena, Kinesis, Lambda, EMR, Lake Formation Databricks: Delta Lake, Unity Catalog, Structured Streaming, MLflow SQL Server stack (SSIS, SSRS) Engineering Practices CI/CD for data platforms ...

data masking, encryption, lineage, access controls, and regulatory adherence (e.g., GDPR, ISO 27001). Design and optimize cloud-native storage and compute architectures using Delta Lake, ADLS Gen2, Synapse, Azure SQL, Cosmos DB, and NoSQL for petabyte-scale workloads. Implement event-driven and real-time streaming architectures using … Essential skills/knowledge/experience: (Up to 10) Azure Data Factory, Synapse Analytics, Azure Databricks ADLS, Azure Blob, Azure SQL DB, Cosmos DB, Delta Lake, Oracle DB Azure Event Hub, Azure Kafka, Azure IoT Hub, ADX Fabric including OneLake CI/CD using Azure DevOps, GitHub ...

Views, SLT, or equivalent SAP-native frameworks. Design and implement Medallion-aligned data pipelines (Bronze/Silver/Gold) in our cloud data lake or lakehouse (Azure/AWS/GCP/Databricks/Snowflake). Assess and remediate the current third-party implementation , identifying blockers and accelerating delivery. … strategy , including prioritisation of modules (FI/CO/MM/SD/PP etc.) required for December cutover. Build scalable ingestion pipelines using Delta Lake/Parquet and modern orchestration tools (ADF, dbx, Airflow, etc.). Collaborate with SAP functional teams to validate business logic, deltas ...

have the following skills and experience: Strong commercial experience in data architecture or data engineering within modern cloud environments. Deep expertise in Databricks, including Delta Lake, Unity Catalog, and SQL Warehousing. Advanced SQL skills with a focus on performance tuning and optimization. Experience migrating legacy data systems into ...