2 of 2 Delta Lake Jobs in Scotland

we will also consider London based or remote candidates. What you'll do Design and implement scalable data solutions using Azure services including Data Factory, Data Bricks, and Data Lake Gen2 Build and maintain metadata managed data pipelines supporting the business by working to centralise critical data within a single platform Collaboration with business analysts, data scientists and business … manage workload, update tasks and develop CI/CD Pipelines for deployment into other environments What to bring Strong Proficiency in Azure Data Factory, Synapse Analytics, SQL Databases & Data Lake Gen 2 Demonstratable understanding on how to apply Medallion Architecture to an Azure Datawarehouse Advanced Knowledge around CI/CD pipelines, deployment automation, Infrastructure as Code and work management … within Azure DevOps Knowledge of development within Databricks, PySpark, Delta Lake, Unity Catalog and Notebook Development Demonstratable experience in SQL, T-SQL, JSON, Python & data consumption via API's, with some understanding of Dax and PowerShell Understanding and experience of Data Quality & Validation during the data load process Ability to analyse complex data requirements and design efficient data More ❯

Databricks for improved traceability Implement Unity Catalog for automated data lineage Deliver backlog items through Agile sprint planning Skills & Experience Strong hands-on experience with Databricks, Fabric, Apache Spark, Delta Lake Proficient in Python, SQL, and PySpark Familiar with Azure Data Factory, Event Hub, Unity Catalog Solid understanding of data governance and enterprise architecture Effective communicator with experience More ❯