18 of 18 Delta Lake Jobs in the North West

Data Warehouse Architect

Location
Manchester, England, United Kingdom
building scalable lakehouse and warehouse solutions (Databricks SQL, Fabric SQL) Strong data pipeline development using Databricks Workflows, DLT, and Fabric Data Factory Knowledge of Delta Lake and cross-platform data strategies to reduce duplication Data governance expertise, including Unity Catalog, RLS, and data lineage Experience managing compute across … Fabric and Databricks environments CI/CD knowledge using Azure DevOps, GitHub, and Databricks Asset Bundles Proficiency in PySpark, Databricks SQL, T‐SQL, and Delta Lake internals Strong understanding of Medallion Architecture and modern data modelling (Star Schema, Data Vault 2.0) Experience optimising Databricks performance and integrating with ...

Sr DataOps Engineer (R14334)

Location
Rochdale, England, United Kingdom
platform integrations. You’ll support Unity Catalog, including access governance, catalog and schema permissions, and secure data sharing. You’ll monitor and troubleshoot Delta Live Tables, Spark jobs, Delta Lake workloads, and data pipelines, including failures, performance issues, recovery, and data-quality concerns. You’ll maintain secure … infrastructure, or DataOps environments. Hands-on experience administering and supporting Databricks, including workspaces, jobs, workflows, compute, cluster policies, and access controls. Experience supporting Spark, Delta Lake, and Delta Live Tables workloads. Strong experience with AWS services such as EC2, VPC, IAM, S3, security groups, CloudWatch, and networking. ...

Principal Data Engineer

Location
Manchester, England, United Kingdom
scope to drive data democratisation, governance maturity and AI-readiness across the firm.## **What you will be doing** * Design and maintain scalable, secure data lake and lakehouse solutions using Azure Data Lake, Databricks and Delta Lake — built to support real-time insight, advanced analytics … validation, logging and monitoring to catch issues early and keep the platform reliable. **Key Requirements** * Experience in data engineering, including designing and delivering data lake or lakehouse architectures in an enterprise cloud environment, ideally Microsoft Azure.* Hands-on expertise with Databricks, Spark, PySpark, SQL and core Azure Data Services ...

Data Engineer (Databricks)

Hiring Organisation
iO Associates
Location
Manchester, United Kingdom
Employment Type
Permanent Contract
Salary
£60,000
Responsibilities Design, build and maintain ETL/ELT data pipelines using Azure Data Factory, Databricks, SQL and PySpark Develop and support enterprise-scale data lake and lakehouse solutions Build data products that enable analytics, reporting and self-service data consumption Implement data quality controls, validation frameworks and monitoring processes … delivery processes Strong communication and stakeholder management skills An interest in analytics, AI and emerging data technologies Desirable Experience Azure Synapse Analytics Azure Data Lake Storage Gen2 Azure Functions Delta Lake dbt Apache Airflow Purview or Collibra What's On Offer Salary up to £60,000 Hybrid ...

Data Engineer (Databricks)

Hiring Organisation
IO Associates
Location
Manchester, Lancashire, United Kingdom
Employment Type
Permanent
Salary
GBP 60,000 Annual
Responsibilities Design, build and maintain ETL/ELT data pipelines using Azure Data Factory, Databricks, SQL and PySpark Develop and support enterprise-scale data lake and lakehouse solutions Build data products that enable analytics, reporting and self-service data consumption Implement data quality controls, validation frameworks and monitoring processes … delivery processes Strong communication and stakeholder management skills An interest in analytics, AI and emerging data technologies Desirable Experience Azure Synapse Analytics Azure Data Lake Storage Gen2 Azure Functions Delta Lake dbt Apache Airflow Purview or Collibra What's On Offer Salary up to £60,000 Hybrid ...

Senior Data Engineer

Location
Manchester, England, United Kingdom
scalable, maintainable, and aligned with organisational standards and governance requirements. Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines to ensure trusted, accurate outputs. ...

Lead Data Engineer

Location
Manchester, England, United Kingdom
Apache Kafka or Amazon MSK, including stream processing with Spark Structured Streaming. Hands‐on experience with open table formats, such as Apache Iceberg or Delta Lake, including partitioning, schema evolution and table maintenance at scale. Experience with pipeline orchestration and infrastructure‐as‐code using Terraform. Experience acting ...

Data Architect

Location
Manchester, England, United Kingdom
least 3 years hands-on with Azure Databricks in production environments Proven experience designing and implementing medallion architecture (Bronze/Silver/Gold) using Delta Lake on Azure Databricks Strong hands-on experience with Unity Catalog — metastore setup, catalog and schema design, access controls, and governance policies Experience … configuring Azure Data Lake Storage Gen2 — containers, access control lists, lifecycle policies, and integration with Databricks Hands-on experience with Microsoft Fabric — specifically Mirrored Azure Databricks Unity Catalog and Power BI connectivity to Databricks SQL Warehouses Experience with enterprise data source integration — MS SQL Server (on-premises and Azure ...

Data Engineer

Location
Wigan, England, United Kingdom
detail at interview. What You’ll Be Doing: Designing, building, and optimising streaming and batch pipelines in Databricks Develop robust bronze, silver, and gold delta tables using the Medallion Architecture to serve downstream analytics and APIs Implement and manage integrations from AWS MSK (Kafka), S3, and external APIs into … PySpark, including Structured Streaming. You should have experience with Kafka (MSK) and real-time data ingestion, as well as a deep understanding of Delta Lake, Declarative Pipelines (DLT) and the Medallion Architecture. A strong AWS background is important, particularly with services such as S3. You’ll need ...

Data Engineer

Location
Manchester, England, United Kingdom
meet deadlines. Experience with source control and CI/CD (GitHub, Azure DevOps, DABs) Data architecting, solutions architecting and experience optimising pipelines and Delta Lake Databricks Data Engineer Professional certified #J-18808-Ljbffr ...

Consultant Data & AI Architect IRC303856

Location
Manchester, England, United Kingdom
time streaming, and CI/CD pipelines (Git, Terraform, Databricks Asset Bundles). Deep knowledge of Databricks/Snowflake environments, including Unity Catalog, workspaces, Delta Lake, and networking/security (VPNs, Private Links, Firewalls) and/or Snowflake Platform including Cortex, Horizon and Snowpark. Advanced proficiency in Azure ...

Data Engineer

Location
Manchester, England, United Kingdom
data solutions using Databricks, PySpark and SQL Integrating data from multiple source systems Supporting the development of Azure-based data infrastructure Creating and maintaining Delta Lake tables and workflows Improving data quality, monitoring and performance Working closely with analysts and business stakeholders to understand data requirements Contributing ...

Lead Data Engineer - Perm up to £100k

Hiring Organisation
Lorien Resourcing Limited
Location
Manchester, North West, United Kingdom
Employment Type
Permanent Contract, Hybrid
Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data modelling and lakehouse design (bronze, silver, gold) Terraform, CI/CD and pipeline orchestration A track record of setting standards ...

Principal Data Solution Architect

Location
Manchester, England, United Kingdom
cloud databases Proven track record with complex data migration projects (terabyte+ datasets, multiple legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing Knowledge ...

Junior Data Engineer

Location
Manchester, England, United Kingdom
from employment, education, an apprenticeship or personal projects. Experience with Microsoft Fabric or another cloud data platform. Familiarity with data warehouses, Lakehouses , PySpark or Delta Lake. Awareness of testing and CI/CD practices. Candidates do not need to meet every desirable criterion to apply. We are proud ...

Product Architect - Data Intelligent Platform

Hiring Organisation
Capgemini
Location
Manchester, United Kingdom
Employment Type
Full Time
leading enterprise-scale data platforms in complex global organisations. Deep expertise in modern data architectures, cloud platforms, and technologies such as Databricks, Snowflake, Spark, Delta Lake, and AI/ML solutions. Proven ability to define enterprise technology strategy and translate business objectives into architectural outcomes. Strong leadership, stakeholder ...

Azure Databricks Data Architect for Lakehouse Governance

Location
Manchester, England, United Kingdom
seeking a Data Architect for a permanent hybrid role in the UK. The candidate will lead data architecture with extensive Azure Databricks experience, including Delta Lake medallion patterns and Unity Catalog governance. You will collaborate with senior stakeholders and ensure secure data lake implementations in a Microsoft ...

Azure Databricks Data Engineer | ETL, Delta Lake & Governance

Location
Manchester, England, United Kingdom
MPM Products Limited in Manchester is seeking a Data Engineer to develop, maintain and optimise our data infrastructure, ensuring scalable, secure centralised data assets and reliable ETL pipelines using Azure Databricks. You will lead end ...