701 to 725 of 979 Databricks Jobs in the UK

world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. YOUR ROLE We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on designing, building, and optimizing scalable data solutions … using the Databricks platform. YOUR PROFILE Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable data engineering solutions using Apache Spark on Databricks. Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. Optimize performance and cost-efficiency of Databricks workloads. Develop and maintain CI/CD workflows for … Databricks using GitLab or similar tools. Ensure data quality and reliability through robust unit testing and validation frameworks. Implement best practices for data governance, security, and access control within Databricks. Provide technical mentorship and guidance to junior engineers Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable data engineering solutions using Apache Spark on More ❯

world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. YOUR ROLE We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on designing, building, and optimizing scalable data solutions … using the Databricks platform. YOUR PROFILE Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable data engineering solutions using Apache Spark on Databricks. Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. Optimize performance and cost-efficiency of Databricks workloads. Develop and maintain CI/CD workflows for … Databricks using GitLab or similar tools. Ensure data quality and reliability through robust unit testing and validation frameworks. Implement best practices for data governance, security, and access control within Databricks. Provide technical mentorship and guidance to junior engineers Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable data engineering solutions using Apache Spark on More ❯

CI/CD, automation). Proven track record of designing, building, and scaling data platforms in production environments. Hands-on experience with big data technologies such as Airflow, DBT, Databricks, and data catalogue/observability tools (e.g. Monte Carlo, Atlan, Datahub). Knowledge of cloud infrastructure (AWS or GCP) - including services such as S3, RDS, EMR, ECS, IAM. Experience with More ❯

CI/CD, automation). Proven track record of designing, building, and scaling data platforms in production environments. Hands-on experience with big data technologies such as Airflow, DBT, Databricks, and data catalogue/observability tools (e.g. Monte Carlo, Atlan, Datahub). Knowledge of cloud infrastructure (AWS or GCP) - including services such as S3, RDS, EMR, ECS, IAM. Experience with More ❯

Data Engineering Lead - Databricks - London - £95K Global construction business with a strong technology focus are looking for a hands on Data Engineering Lead to manage, mentor and help develop a small team of Engineers, coupled with technical leadership. You will be using the latest, cutting edge technology across the Azure and Databricks ecosystem within a close knit, collaborative environment.Key Responsibilities … and Skills Required:- Proficiency in MS Business Intelligence tools and practices (SQL, Azure, Data Factory, Power BI, Databricks)- Strong background in data engineering principles and methodologies.- Experience leading and mentoring teams in technical environments.- Ability to collaborate effectively with cross-functional teams to deliver impactful solutions.- Excellent problem-solving skills and a data-driven mindset.This role suits an innovative candidate More ❯

Exciting Opportunity for a Data Engineering Technical Lead with deep expertise in Azure Databricks to join a Global company on a 12 Month initial Contract. Key Responsibilities: Design, build, and manage large-scale data platforms with a focus on ETL, Data Management, and Data Governance Develop and maintain Databricks Delta Live Tables (DLT) pipelines with strong emphasis on cost and … performance optimisation Implement and manage structured streaming and real-time data processing solutions. Handle and process high volumes of data efficiently within Databricks Translate business requirements into technical delivery plans—including defining PBIs, tasks, and technical design documents Collaborate closely with business stakeholders to understand use cases and deliver high-quality, timely solutions Lead a technical delivery team of … governance, and performance tuning Drive continuous improvement in data engineering processes and platform scalability Required Skills & Experience: Proven experience in building multiple large-scale data platforms Deep expertise in Databricks, especially Delta Live Tables (DLT) and structured streaming Strong understanding of data governance, data modeling, and pipeline orchestration Hands-on experience optimising Databricks workloads for performance and cost Excellent communication More ❯

Exciting Opportunity for a Data Engineering Technical Lead with deep expertise in Azure Databricks to join a Global company on a 12 Month initial Contract. Key Responsibilities: Design, build, and manage large-scale data platforms with a focus on ETL, Data Management, and Data Governance Develop and maintain Databricks Delta Live Tables (DLT) pipelines with strong emphasis on cost and … performance optimisation Implement and manage structured streaming and real-time data processing solutions. Handle and process high volumes of data efficiently within Databricks Translate business requirements into technical delivery plans—including defining PBIs, tasks, and technical design documents Collaborate closely with business stakeholders to understand use cases and deliver high-quality, timely solutions Lead a technical delivery team of … governance, and performance tuning Drive continuous improvement in data engineering processes and platform scalability Required Skills & Experience: Proven experience in building multiple large-scale data platforms Deep expertise in Databricks, especially Delta Live Tables (DLT) and structured streaming Strong understanding of data governance, data modeling, and pipeline orchestration Hands-on experience optimising Databricks workloads for performance and cost Excellent communication More ❯

Exciting Opportunity for a Data Engineering Technical Lead with deep expertise in Azure Databricks to join a Global company on a 12 Month initial Contract. Key Responsibilities: Design, build, and manage large-scale data platforms with a focus on ETL, Data Management, and Data Governance Develop and maintain Databricks Delta Live Tables (DLT) pipelines with strong emphasis on cost and … performance optimisation Implement and manage structured streaming and real-time data processing solutions. Handle and process high volumes of data efficiently within Databricks Translate business requirements into technical delivery plans—including defining PBIs, tasks, and technical design documents Collaborate closely with business stakeholders to understand use cases and deliver high-quality, timely solutions Lead a technical delivery team of … governance, and performance tuning Drive continuous improvement in data engineering processes and platform scalability Required Skills & Experience: Proven experience in building multiple large-scale data platforms Deep expertise in Databricks, especially Delta Live Tables (DLT) and structured streaming Strong understanding of data governance, data modeling, and pipeline orchestration Hands-on experience optimising Databricks workloads for performance and cost Excellent communication More ❯

Exciting Opportunity for a Data Engineering Technical Lead with deep expertise in Azure Databricks to join a Global company on a 12 Month initial Contract. Key Responsibilities: Design, build, and manage large-scale data platforms with a focus on ETL, Data Management, and Data Governance Develop and maintain Databricks Delta Live Tables (DLT) pipelines with strong emphasis on cost and … performance optimisation Implement and manage structured streaming and real-time data processing solutions. Handle and process high volumes of data efficiently within Databricks Translate business requirements into technical delivery plans—including defining PBIs, tasks, and technical design documents Collaborate closely with business stakeholders to understand use cases and deliver high-quality, timely solutions Lead a technical delivery team of … governance, and performance tuning Drive continuous improvement in data engineering processes and platform scalability Required Skills & Experience: Proven experience in building multiple large-scale data platforms Deep expertise in Databricks, especially Delta Live Tables (DLT) and structured streaming Strong understanding of data governance, data modeling, and pipeline orchestration Hands-on experience optimising Databricks workloads for performance and cost Excellent communication More ❯

Exciting Opportunity for a Data Engineering Technical Lead with deep expertise in Azure Databricks to join a Global company on a 12 Month initial Contract. Key Responsibilities: Design, build, and manage large-scale data platforms with a focus on ETL, Data Management, and Data Governance Develop and maintain Databricks Delta Live Tables (DLT) pipelines with strong emphasis on cost and … performance optimisation Implement and manage structured streaming and real-time data processing solutions. Handle and process high volumes of data efficiently within Databricks Translate business requirements into technical delivery plans—including defining PBIs, tasks, and technical design documents Collaborate closely with business stakeholders to understand use cases and deliver high-quality, timely solutions Lead a technical delivery team of … governance, and performance tuning Drive continuous improvement in data engineering processes and platform scalability Required Skills & Experience: Proven experience in building multiple large-scale data platforms Deep expertise in Databricks, especially Delta Live Tables (DLT) and structured streaming Strong understanding of data governance, data modeling, and pipeline orchestration Hands-on experience optimising Databricks workloads for performance and cost Excellent communication More ❯

Azure Senior Data Lead with Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, Python, Power BI. The Senior Technical Lead will be responsible for leading the technical aspects of projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, Power BI and Python. The role involves designing, developing, and maintaining data pipelines and … ETL processes while ensuring high performance and scalability of data solutions. (Lead the end-to-end technical implementation of data projects using azure data factory, azure databricks, sql, oracle pl/sql, Power BI and python. Optimize data workflows, troubleshoot issues, and ensure data quality and integrity. Implement best practices for data security, governance, and compliance. Provide technical guidance, mentoring … in data engineering and analytics. Monitor and optimise performance of Power BI reports and datasets, identifying bottlenecks and implementing solutions proactively. Proficiency in azure data factory (adf) and azure databricks for data integration and processing. Strong skills in writing complex sql queries for data manipulation and analysis. Experience with oracle pl/sql for database development and management. Proficient in More ❯

Platform Engineer-£400PD-Remote We are seeking a highly skilled Cloud Platform Engineer with hands-on experience managing and scaling Databricks from a platform perspective, along with deep knowledge of Azure services, Terraform, and CI/CD pipelines using GitHub Actions. You will be part of a team responsible for designing, implementing, and maintaining scalable, secure, and cost-effective cloud … Center, defender policies, and other security controls across cloud resources. Monitor and manage cloud costs using Azure Cost Management, ensuring resources are optimized and within budget. Architect and support Databricks workspaces, focusing on Unity Catalog, data access control, workspace deployment, and platform reliability. Collaborate with data engineering and analytics teams to ensure Databricks is performant, secure, and well-integrated with … systems. Create and maintain platform documentation, templates, and reusable modules to support self-service provisioning. Participate in incident response and troubleshooting for cloud platform issues, particularly those related to Databricks and underlying infrastructure. Required Skills & Experience: Proven experience with Terraform in a production environment. Deep understanding of GitHub Actions and CI/CD best practices. Strong experience working with Azure More ❯

security and privacy regulations. Contribute to Communities of Practice and support their cloud-first strategy. What you'll need to succeed Extensive experience in cloud-based data engineering (preferably Databricks), with a strong background in modernisation and large-scale migration. Expertise in Azure services (API Manager, App Service), Databricks, Spark, Python, SQL, and AI/ML frameworks. Proven track record … . Ability to translate strategic goals into technical delivery plans and roadmaps. Desirable Criteria Experience designing and implementing AI/ML-driven solutions within data platforms. Relevant certifications (e.g. Databricks Engineer Professional, Azure Data Engineer Associate, Azure Solutions Architect). Advanced academic qualifications or industry recognition in data engineering and cloud technologies. Experience in DevOps practices using GitHub Actions and … this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now. Desired Skills and Experience Lead Data and AI Engineer/Databricks/Principle Data Engineer Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job More ❯

release, monitoring, and support. Operationalize models with CI/CD pipelines, automated testing, and monitoring, applying MLOps practices such as versioning, retraining, and drift detection (tools: MLflow, Azure ML, Databricks) Leverage both open-source frameworks (LangChain, Hugging Face, etc.) and enterprise platforms (Azure OpenAI, Databricks, etc.) to deliver production ready, scalable AI solutions Implement generative AI and advanced analytics features More ❯

Contract Databricks Platform Engineer - Remote - £525/pd Please note - whilst this role is fully remote, applications will only be accepted by candidates who live in the UK permanently and have the unrestricted right to work in the UK. This organisation is unable to offer sponsorship. A well-established UK-based Data & AI consultancy is looking for a Databricks Platform … Engineer to support the rollout of a Databricks platform for a major finance client. Key Responsibilities: Support the deployment and configuration of Databricks with Unity Catalog. Implement infrastructure as code using Terraform. Set up and manage CI/CD pipelines with GitHub Actions. Ensure robust Azure security and cost management practices. Collaborate with client teams to ensure smooth platform adoption. … Required Skills: Strong experience with Databricks and Unity Catalog. Proficiency in Terraform, GitHub Actions, and CI/CD. Solid understanding of Azure security and cost optimisation. Experience working with enterprise clients in a consultancy setting is a plus. Why Apply? Work with a top-tier consultancy on a high-impact project. Fully remote flexibility. Competitive day rate outside IR35. Quick More ❯

security and privacy regulations. Contribute to Communities of Practice and support their cloud-first strategy. What you'll need to succeed Extensive experience in cloud-based data engineering (preferably Databricks), with a strong background in modernisation and large-scale migration. Expertise in Azure services (API Manager, App Service), Databricks, Spark, Python, SQL, and AI/ML frameworks. Proven track record … . Ability to translate strategic goals into technical delivery plans and roadmaps. Desirable Criteria Experience designing and implementing AI/ML-driven solutions within data platforms. Relevant certifications (e.g. Databricks Engineer Professional, Azure Data Engineer Associate, Azure Solutions Architect). Advanced academic qualifications or industry recognition in data engineering and cloud technologies. Experience in DevOps practices using GitHub Actions and More ❯

Senior Data Engineer - Azure, Healthcare A Global Healthcare Leader based in Burton Upon Trent is currently searching for a Senior Data Engineer to help support a greenfield implementation of Databricks and further support the advancement of their modern data platform. The successful applicant will work closely with the Director of Analytics and Strategic Data Manager and be responsible for implementing … data pipelines in Azure Data Factory and Azyre Databricks, supporting Darewhaoure implementation and ETL process. Location: Hybrid in London Salary: £55,000 to £65,000 + Benefits To be considered: Minimum 3 years of experience working as a Data Engineer within an Azure Environment. Prior experience working with Azure Databricks. Strong programming skills in Python, C# or .Net. Experience deploying More ❯

Senior Data Engineer - Azure, Healthcare A Global Healthcare Leader based in Burton Upon Trent is currently searching for a Senior Data Engineer to help support a greenfield implementation of Databricks and further support the advancement of their modern data platform. The successful applicant will work closely with the Director of Analytics and Strategic Data Manager and be responsible for implementing … data pipelines in Azure Data Factory and Azyre Databricks, supporting Darewhaoure implementation and ETL process. Location: Hybrid in London Salary: £55,000 to £65,000 + Benefits To be considered: Minimum 3 years of experience working as a Data Engineer within an Azure Environment. Prior experience working with Azure Databricks. Strong programming skills in Python, C# or .Net. Experience deploying More ❯

Senior Data Engineer - Azure, Healthcare A Global Healthcare Leader based in Burton Upon Trent is currently searching for a Senior Data Engineer to help support a greenfield implementation of Databricks and further support the advancement of their modern data platform. The successful applicant will work closely with the Director of Analytics and Strategic Data Manager and be responsible for implementing … data pipelines in Azure Data Factory and Azyre Databricks, supporting Darewhaoure implementation and ETL process. Location: Hybrid in London Salary: £55,000 to £65,000 + Benefits To be considered: Minimum 3 years of experience working as a Data Engineer within an Azure Environment. Prior experience working with Azure Databricks. Strong programming skills in Python, C# or .Net. Experience deploying More ❯

Senior Data Engineer - Azure, Healthcare A Global Healthcare Leader based in Burton Upon Trent is currently searching for a Senior Data Engineer to help support a greenfield implementation of Databricks and further support the advancement of their modern data platform. The successful applicant will work closely with the Director of Analytics and Strategic Data Manager and be responsible for implementing … data pipelines in Azure Data Factory and Azyre Databricks, supporting Darewhaoure implementation and ETL process. Location: Hybrid in London Salary: £55,000 to £65,000 + Benefits To be considered: Minimum 3 years of experience working as a Data Engineer within an Azure Environment. Prior experience working with Azure Databricks. Strong programming skills in Python, C# or .Net. Experience deploying More ❯

Senior Data Engineer - Azure, Healthcare A Global Healthcare Leader based in Burton Upon Trent is currently searching for a Senior Data Engineer to help support a greenfield implementation of Databricks and further support the advancement of their modern data platform. The successful applicant will work closely with the Director of Analytics and Strategic Data Manager and be responsible for implementing … data pipelines in Azure Data Factory and Azyre Databricks, supporting Darewhaoure implementation and ETL process. Location: Hybrid in London Salary: £55,000 to £65,000 + Benefits To be considered: Minimum 3 years of experience working as a Data Engineer within an Azure Environment. Prior experience working with Azure Databricks. Strong programming skills in Python, C# or .Net. Experience deploying More ❯

Hybrid – Surrey (1 day in office every fortnight) This is a high-impact Lead Data Engineer role, where you’ll work across a cutting-edge data stack (AWS, Databricks, Spark, dbt) to design scalable platforms and products that enable self-service analytics, advanced modelling, and AI-driven decision-making. You’ll report into the Head of Data Engineering, supporting a … driving best practices, and acting as a foundational support. Key responsibilities include: Leading data engineering projects and managing sub-teams Designing, optimising, and scaling data platforms in AWS/Databricks Driving coding standards, frameworks, and best practices Building and supporting modern data pipelines and products Coaching and mentoring engineers to raise technical excellence Partnering with product managers, data & AI engineers … major business problems, including Generative AI applications What we’re looking for: Hands-on expertise in Python, SQL, Spark, Airflow, Terraform Proven experience with cloud-native data platforms (AWS, Databricks, Snowflake) Strong track record of mentoring or coaching other engineers Knowledge of CI/CD tooling (Git, Jenkins or similar) Experience in batch and real-time data processing Exposure to More ❯

cutting-edge tech and make a real impact? We’re hiring for a hands-on role where you’ll design and build scalable data pipelines using Microsoft Fabric and Databricks , drive DataOps best practices, and manage agile delivery through Jira . You’ll be part of a high-performing consultancy team delivering modern data platforms for enterprise clients. What You … ll Be Doing as a Fabric Consultant: Building end-to-end data pipelines with Microsoft Fabric & Databricks Driving DataOps workflows, CI/CD automation, and agile delivery via Jira Leading client workshops and collaborating with cross-functional teams Supporting data governance, compliance, and privacy initiatives Mentoring junior engineers and contributing to internal best practices What You’ll Bring: Strong experience More ❯

cutting-edge tech and make a real impact? We’re hiring for a hands-on role where you’ll design and build scalable data pipelines using Microsoft Fabric and Databricks , drive DataOps best practices, and manage agile delivery through Jira . You’ll be part of a high-performing consultancy team delivering modern data platforms for enterprise clients. What You … ll Be Doing as a Fabric Consultant: Building end-to-end data pipelines with Microsoft Fabric & Databricks Driving DataOps workflows, CI/CD automation, and agile delivery via Jira Leading client workshops and collaborating with cross-functional teams Supporting data governance, compliance, and privacy initiatives Mentoring junior engineers and contributing to internal best practices What You’ll Bring: Strong experience More ❯

cutting-edge tech and make a real impact We’re hiring for a hands-on role where you’ll design and build scalable data pipelines using Microsoft Fabric and Databricks , drive DataOps best practices, and manage agile delivery through Jira . You’ll be part of a high-performing consultancy team delivering modern data platforms for enterprise clients.What You’ll … Be Doing as a Fabric Consultant: Building end-to-end data pipelines with Microsoft Fabric & Databricks Driving DataOps workflows, CI/CD automation, and agile delivery via Jira Leading client workshops and collaborating with cross-functional teams Supporting data governance, compliance, and privacy initiatives Mentoring junior engineers and contributing to internal best practices What You’ll Bring: Strong experience in More ❯