3 of 3 Contract Delta Lake Jobs in London

improving security, supportability and delivery speed. 4. Data Engineering and Integration Design and build reliable ingestion and transformation pipelines using Python, PySpark, SQL and Delta Lake. Implement full and incremental ingestion, CDC where appropriate, schema evolution, reconciliation, error handling and data quality controls. Design reusable integration patterns for REST … Azure Databricks implementation and troubleshooting Databricks Serverless and compute/workload optimisation Azure identity, networking, security, secrets, monitoring and private connectivity Databricks SQL, Delta Lake and performance optimisation Python, PySpark and SQL Jobs/workflows, incremental processing, CDC and data quality REST/API and external data integration ...

planning, solution design and adoption. Data Engineering and Integration Design, build and optimise scalable data ingestion and transformation solutions using Python, PySpark, SQL and Delta Lake. Implement batch and incremental processing patterns, including Change Data Capture (CDC), schema evolution, reconciliation processes, data quality controls and error handling. Develop reusable … administration and troubleshooting experience. Databricks Serverless architecture, workload placement and compute optimisation. Azure networking, identity, security, monitoring, secrets management and private connectivity. Databricks SQL, Delta Lake and query/workload performance optimisation. Strong understanding of platform governance, operational support and best practices. Highly Desirable Experience migrating workloads from ...

extraction through reconciliation) Microsoft Fabric experience is a bonus, not a requirement - strong Azure Databricks/Synapse background welcomed Nice to have: Microsoft Purview, Delta Lake/medallion architecture, Key Vault/Managed Identities, Azure DE Associate or Databricks certification. ...