1 to 25 of 82 Delta Lake Jobs in the UK

all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. You'll build physical … Kanban). Experience of Databricks solutions, Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. Synapse … tests for data pipelines. Data Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation - Extensive hands-on with Azure Data Flow Activities More ❯

all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. You'll build physical … Kanban). Experience of Databricks solutions, Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. Synapse … tests for data pipelines. Data Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation - Extensive hands-on with Azure Data Flow Activities More ❯

all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. You'll build physical … Kanban). Experience of Databricks solutions, Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. Synapse … tests for data pipelines. Data Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation - Extensive hands-on with Azure Data Flow Activities More ❯

contribute to code reviews and best practices Skills & Experience Strong expertise in Python and SQL for data engineering Hands-on experience with Databricks, Spark, Delta Lake, Delta Live Tables Experience in batch and real-time data processing Proficiency with cloud platforms (AWS, Azure, Databricks) Solid understanding of More ❯

contribute to code reviews and best practices Skills & Experience Strong expertise in Python and SQL for data engineering Hands-on experience with Databricks, Spark, Delta Lake, Delta Live Tables Experience in batch and real-time data processing Proficiency with cloud platforms (AWS, Azure, Databricks) Solid understanding of More ❯

practices in data engineering, governance, and performance optimisation. Key Responsibilities Lead the architecture and design of a next-gen data platform using Databricks and Delta Lake Collaborate with stakeholders including data engineers, analysts, and business leads to define data requirements and architecture patterns Ensure the platform is scalable … mentorship to engineering teams Champion best practices in data quality, lineage, governance , and performance tuning Integrate with a wider Azure ecosystem (e.g. Azure Data Lake, Synapse, Power BI) Required Skills & Experience Proven experience as a Data Architect in enterprise environments Extensive hands-on experience with Databricks (including SQL, PySpark … Delta Lake) Solid background in data warehousing , data lakes , and big data frameworks Strong knowledge of Azure cloud services , especially in data integration Experience working in regulated environments (e.g. financial services, insurance, banking) Excellent communication skills, capable of engaging with technical and non-technical stakeholders alike Comfortable working More ❯

practices in data engineering, governance, and performance optimisation. Key Responsibilities Lead the architecture and design of a next-gen data platform using Databricks and Delta Lake Collaborate with stakeholders including data engineers, analysts, and business leads to define data requirements and architecture patterns Ensure the platform is scalable … mentorship to engineering teams Champion best practices in data quality, lineage, governance , and performance tuning Integrate with a wider Azure ecosystem (e.g. Azure Data Lake, Synapse, Power BI) Required Skills & Experience Proven experience as a Data Architect in enterprise environments Extensive hands-on experience with Databricks (including SQL, PySpark … Delta Lake) Solid background in data warehousing , data lakes , and big data frameworks Strong knowledge of Azure cloud services , especially in data integration Experience working in regulated environments (e.g. financial services, insurance, banking) Excellent communication skills, capable of engaging with technical and non-technical stakeholders alike Comfortable working More ❯

and optimize data solutions on Databricks to support a unified data platform architecture. Implement data ingestion, transformation, and storage strategies within Databricks. Work with Delta Lake to ensure data reliability, performance, and scalability. Integrate Databricks with other components of the data platform (e.g., data warehousing, data streaming). … data platforms. Deep expertise in Apache Spark and the Databricks Lakehouse Platform. Strong proficiency in SQL and data warehousing principles. Hands-on experience with Delta Lake for reliable data storage. Proficiency in Python for data engineering and processing. Experience integrating Databricks with other data technologies. Solid understanding of … data modeling, data warehousing, and data lake concepts. Proven ability to optimize data pipelines and query performance. Strong problem-solving, analytical, and communication skills. More ❯

and optimize data solutions on Databricks to support a unified data platform architecture. Implement data ingestion, transformation, and storage strategies within Databricks. Work with Delta Lake to ensure data reliability, performance, and scalability. Integrate Databricks with other components of the data platform (e.g., data warehousing, data streaming). … data platforms. Deep expertise in Apache Spark and the Databricks Lakehouse Platform. Strong proficiency in SQL and data warehousing principles. Hands-on experience with Delta Lake for reliable data storage. Proficiency in Python for data engineering and processing. Experience integrating Databricks with other data technologies. Solid understanding of … data modeling, data warehousing, and data lake concepts. Proven ability to optimize data pipelines and query performance. Strong problem-solving, analytical, and communication skills. More ❯

data-driven initiatives. Job Specification ( Technical Skills) : Cloud Platforms: Expert-level proficiency in Azure (Data Factory, Databricks, Spark, SQL Database, DevOps/Git, Data Lake, Delta Lake, Power BI), with working knowledge of Azure WebApp and Networking. Conceptual understanding of Azure AI Services, ML, Unity Catalog, and … Advanced proficiency in SQL, Python, and at least one additional programming language (Java, C#, C++) is desired. Proven experience with data warehousing and data lake technologies. Solid understanding of database systems (SQL, NoSQL). Platform Architecture: Able to develop and implement data platform architecture (data lakes, data warehouses, data More ❯

clients and internal teams to deliver scalable, efficient data solutions tailored to business needs. Key Responsibilities Develop ETL/ELT pipelines with Databricks and Delta Lake Integrate and process data from diverse sources Collaborate with data scientists, architects, and analysts Optimize performance and manage Databricks clusters Build cloud … pipelines Document architecture and processes What We’re Looking For Required: 3+ years in data engineering with hands-on Databricks experience Proficient in Databricks, Delta Lake, Spark, Python, SQL Cloud experience (Azure preferred, AWS/GCP a plus) Strong problem-solving and communication skills Preferred: Experience with MLflow More ❯

Security: Apply protocols and standards to secure clinical data in-motion and at-rest.Shape Data Workflows: Use your expertise with Databricks components such as Delta Lake, Unity Catalog, and ML Flow to ensure our data workflows are efficient, secure, and reliable.Key Responsibilities Data Engineering with Databricks: Utilize Databricks … models, ETL/ELT processes, and data lakes to support data analytics and machine learning.Requirements Expertise in Databricks: Proficiency with Databricks components such as Delta Lake, Unity Catalog, and ML Flow.Azure Data Factory Knowledge: Experience with Azure Data Factory for data orchestration.Clinical Data Security: Understanding of protocols and More ❯

Apply protocols and standards to secure clinical data in-motion and at-rest. Shape Data Workflows: Use your expertise with Databricks components such as Delta Lake, Unity Catalog, and ML Flow to ensure our data workflows are efficient, secure, and reliable. Key Responsibilities Data Engineering with Databricks: Utilize … ETL/ELT processes, and data lakes to support data analytics and machine learning. Requirements Expertise in Databricks: Proficiency with Databricks components such as Delta Lake, Unity Catalog, and ML Flow. Azure Data Factory Knowledge: Experience with Azure Data Factory for data orchestration. Clinical Data Security: Understanding of More ❯

using Purview , Unity Catalog , Profisee , Informatica Implement real-time streaming with Event Hub, Kafka, IoT Hub, and Kusto/ADX Design data platforms with Delta Lake, ADLS Gen2, Cosmos DB, Synapse, Fabric OneLake Lead CI/CD infrastructure using Terraform , Bicep , Azure DevOps , GitHub Define compute, storage, security … engineers, data scientists, and stakeholders across disciplines Promote DevSecOps, governance, resilience, and observability across the ecosystem Core Skills & Experience Azure Data Factory, Synapse, Databricks, Delta Lake, ADLS, Cosmos DB, Azure SQL Event Hub, Kafka, IoT Hub, Kusto/ADX Strong unstructured data migration and transformation experience Data modelling More ❯

clients and internal teams to deliver scalable, efficient data solutions tailored to business needs. Key Responsibilities Develop ETL/ELT pipelines with Databricks and Delta Lake Integrate and process data from diverse sources Collaborate with data scientists, architects, and analysts Optimize performance and manage Databricks clusters Build cloud … pipelines Document architecture and processes What We’re Looking For Required: 5+ years in data engineering with hands-on Databricks experience Proficient in Databricks, Delta Lake, Spark, Python, SQL Cloud experience (Azure preferred, AWS/GCP a plus) Strong problem-solving and communication skills Databricks Champion More ❯

London, Hybrid 💰 Rate: Up to £600 per day 📆 Contract: 6 months (Outside IR35, potential to go perm) 🛠 Tech Stack: Azure Data Factory, Synapse, Databricks, Delta Lake, PySpark, Python, SQL, Event Hub, Azure ML, MLflow We’ve partnered with a new AI-first professional services consultancy that’s taking … supporting team capability development What You Need: ✔ 5+ years in data engineering or backend cloud development ✔ Strong Python, SQL, and Databricks skills (especially PySpark & Delta Lake) ✔ Deep experience with Azure: Data Factory, Synapse, Event Hub, Azure Functions ✔ Understanding of MLOps tooling like MLflow and integration with AI pipelines More ❯

London, Hybrid 💰 Rate: Up to £600 per day 📆 Contract: 6 months (Outside IR35, potential to go perm) 🛠 Tech Stack: Azure Data Factory, Synapse, Databricks, Delta Lake, PySpark, Python, SQL, Event Hub, Azure ML, MLflow We’ve partnered with a new AI-first professional services consultancy that’s taking … supporting team capability development What You Need: ✔ 5+ years in data engineering or backend cloud development ✔ Strong Python, SQL, and Databricks skills (especially PySpark & Delta Lake) ✔ Deep experience with Azure: Data Factory, Synapse, Event Hub, Azure Functions ✔ Understanding of MLOps tooling like MLflow and integration with AI pipelines More ❯

batch). - Integrate structured/unstructured sources incl. SCADA, SAP, telemetry, APIs. - Lead data governance (Purview, Unity Catalog), security, and compliance. - Architect solutions using Delta Lake, ADLS Gen2, Synapse, Cosmos DB. - Build streaming systems with Kafka, Event Hubs, IoT Hub. - Automate delivery using Terraform, Bicep, Azure DevOps, GitHub … Power BI, Databricks, and MDM platforms. - Collaborate across teams and mentor technical staff. Skills & Experience Essential: - Azure Data Factory, Synapse, Databricks - ADLS, Azure SQL, Delta Lake, Cosmos DB - Kafka, Event Hub, IoT Hub, ADX - Data governance & security (RBAC, encryption, Zero Trust) - DevOps & IaC: Terraform, Bicep, Azure DevOps - MDM More ❯

meaningful. 🛠️ What you'll do: Lead and mentor a junior-heavy team of data engineers Build and scale robust pipelines using Spark, Kafka and Delta Lake Define test-driven, documented and repeatable engineering practices Work closely with AI, research and DevOps to deliver products and insights Handle sensitive … the office (1 day in Oxford and 1 day in London) 🧰 Tech you'll use: Python, SQL, Spark, Kafka, Kubernetes, Docker, Airflow, RabbitMQ, AWS, Delta Lake ✅ You’ll thrive here if you: Believe in clean code, strong documentation and a test-first mindset Enjoy mentoring and levelling up More ❯

Constructor's Championship. You will be responsible for: Working with stakeholders to understand their data requirements Building pipelines to ingest data into the data lake Designing, building and deploying dashboards and reports in Power BI Performing data mapping and modelling Developing and updating technical documentation Implementing and owning a … of designing and building data models using Data Analysis Expressions (DAX) Hands-on experience with Azure tools: Azure Data Factory, Synapse, Databricks, SQL, Data Lake, Power BI, Delta Lake, and Spark. Ability to design, build, and deploy interactive user interfaces for interrogating data Experience of Power Automate More ❯

Constructor’s Championship. You will be responsible for: Working with stakeholders to understand their data requirements Building pipelines to ingest data into the data lake Designing, building and deploying dashboards and reports in Power BI Performing data mapping and modelling Developing and update technical documentation Implementing and owning a … of designing and building data models using Data Analysis Expressions (DAX) Hands-on experience with Azure tools: Azure Data Factory, Synapse, Databricks, SQL, Data Lake, Power BI, Delta Lake, and Spark. Ability to design, build, and deploy interactive user interfaces for interrogating data Experience of Power Automate More ❯

Constructor’s Championship. You will be responsible for: Working with stakeholders to understand their data requirements Building pipelines to ingest data into the data lake Designing, building and deploying dashboards and reports in Power BI Performing data mapping and modelling Developing and update technical documentation Implementing and owning a … of designing and building data models using Data Analysis Expressions (DAX) Hands-on experience with Azure tools: Azure Data Factory, Synapse, Databricks, SQL, Data Lake, Power BI, Delta Lake, and Spark. Ability to design, build, and deploy interactive user interfaces for interrogating data Experience of Power Automate More ❯

Constructor’s Championship. You will be responsible for: Working with stakeholders to understand their data requirements Building pipelines to ingest data into the data lake Designing, building and deploying dashboards and reports in Power BI Performing data mapping and modelling Developing and update technical documentation Implementing and owning a … of designing and building data models using Data Analysis Expressions (DAX) Hands-on experience with Azure tools: Azure Data Factory, Synapse, Databricks, SQL, Data Lake, Power BI, Delta Lake, and Spark. Ability to design, build, and deploy interactive user interfaces for interrogating data Experience of Power Automate More ❯

in Business Intelligence, with 5+ years in a BI leadership role in a global or matrixed organisation. Proven expertise in modern BI architecture (Data Lake, EDW, Streaming, APIs, Real-Time & Batch Processing). Demonstrated experience delivering cloud-based analytics platforms (Azure, AWS, GCP). Strong knowledge of data governance … BI will work within a modern, cloud-based BI ecosystem, including: Data Integration: Fivetran, HVR, Databricks, Apache Kafka, Google BigQuery, Google Analytics 4 Data Lake & Storage: Databricks Delta Lake, Amazon S3 Data Transformation: dbt Cloud Data Warehouse: Snowflake Analytics & Reporting: Power BI, Excel, Snowflake SQL REST API More ❯

in building/architecting data analytic solutions. 3 years of experience in building data platform using Azure services including Azure Databricks, Azure Data Factory, Delta Lake, Azure Data Lake (ADLS), Power BI. Solid hands-on experience with Azure Databricks - Pyspark coding and Spark SQL coding - Must have. More ❯