801 to 825 of 1,030 Databricks Jobs in the UK

Role Title: Sr. Databricks Engineer Location: Glasgow Duration: 31/12/2026 Days on site: 2-3 MUST BE PAYE THROUGH UMBRELLA Role Description: We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on designing … building, and optimizing scalable data solutions using the Databricks platform. Key Responsibilities: • Lead the migration of existing AWS-based data pipelines to Databricks. • Design and implement scalable data engineering solutions using Apache Spark on Databricks. • Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. • Optimize performance and cost-efficiency of Databricks workloads. • Develop and … maintain CI/CD workflows for Databricks using GitLab or similar tools. • Ensure data quality and reliability through robust unit testing and validation frameworks. • Implement best practices for data governance, security, and access control within Databricks. • Provide technical mentorship and guidance to junior engineers. Must-Have Skills: • Strong hands-on experience with Databricks and Apache Spark (preferably PySpark). • Proven More ❯

Senior Data Engineer (Databricks) Location: London (Hybrid) Rate: Negotiable, depending on experience Duration: 6 months (initial)We’re looking for a Senior Data Engineer (Databricks) to join a world-leading energy organisation on a key transformation programme within their trading and supply division. This is an exciting opportunity to play a pivotal role in building modern, scalable data solutions using … engineering space. Required Skills & Experience Cloud Platforms: Strong expertise in AWS/Azure/SAP ETL/ELT Pipelines: Advanced proficiency Data Modelling: Expert level Data Integration & Ingestion: Skilled Databricks, SQL, Synapse, Data Factory and related Azure services Version Control/DevOps tools: GITHUB, Azure DevOps, Actions Testing & Automation tools: PyTest, SonarQube Desirable Experience Experience leading or running scrum teams … deliver a unified and standardised view of data across international operations — a key enabler for smarter, data-driven trading decisions.If you’re a data engineer with deep Azure and Databricks experience, and you enjoy solving complex challenges within a global business, this contract offers a chance to make a real impact on a high-profile initiative. Interested? Please apply now More ❯

and managing streaming and batch data pipelines . The ideal candidate will have strong experience working with large-scale data systems operating on cloud-based platforms such as AWS, Databricks or Snowflake . This role also involves close collaboration with hyperscalers and data platform vendors to evaluate and document Proofs of Concept (PoCs) for modern data platforms, while effectively engaging … tools and frameworks. Work with large volumes of structured and unstructured data , ensuring high performance and scalability. Collaborate with cloud providers and data platform vendors (e.g., AWS, Microsoft Azure, Databricks, IBM, Snowflake) to conduct PoCs for data platform solutions. Evaluate PoC outcomes and provide comprehensive documentation including architecture, performance benchmarks, and recommendations. Engage with key stakeholders including Heads of Architecture … Skills: Proven experience as a Data Engineer with a strong focus on streaming and batch processing . Hands-on experience with cloud-based data plaforms such as AWS/Databricks/IBM/Snowflake . Strong programming skills in Python, Scala, or Java . Experience with data modeling , ETL/ELT processes , and data warehousing . Experience conducting and documenting More ❯

ensuring our data flows are scalable, secure, and high-performing. What Youll Do Architect, build, and enhance integrations across ERP, CRM, POS, e-commerce, and analytics using Microsoft Azure, Databricks, and related tools Design, develop, and maintain secure ETL/ELT pipelines and real-time or near real-time dataflows Act as the subject matter expert on integration best practices … integration practices What Youll Bring 10+ years of experience in enterprise integration, data architecture, or data engineering, ideally within retail, beauty, wellness, or consumer goods Proven expertise in Azure, Databricks, ETL, and API or middleware integrations Strong knowledge of SAP, CRM, Shopify POS, and e-commerce platforms Deep understanding of data governance, security, and cloud or SaaS environments Excellent communication … with the ability to influence across teams Strong documentation, solution review, and architectural advisory experience Degree in Computer Science or equivalent certifications Tools and Technologies Microsoft Azure Integration Services Databricks SAP CRM platforms Shopify POS E-commerce platforms API Gateways and management tools ETL and ELT tools Git, CI/CD, and DevOps toolchain What Success Looks Like Reliable, secure More ❯

our data flows are scalable, secure, and high-performing. What You’ll Do Architect, build, and enhance integrations across ERP, CRM, POS, e-commerce, and analytics using Microsoft Azure, Databricks, and related tools Design, develop, and maintain secure ETL/ELT pipelines and real-time or near real-time dataflows Act as the subject matter expert on integration best practices … practices What You’ll Bring 10+ years of experience in enterprise integration, data architecture, or data engineering, ideally within retail, beauty, wellness, or consumer goods Proven expertise in Azure, Databricks, ETL, and API or middleware integrations Strong knowledge of SAP, CRM, Shopify POS, and e-commerce platforms Deep understanding of data governance, security, and cloud or SaaS environments Excellent communication … with the ability to influence across teams Strong documentation, solution review, and architectural advisory experience Degree in Computer Science or equivalent certifications Tools and Technologies Microsoft Azure Integration Services Databricks SAP CRM platforms Shopify POS E-commerce platforms API Gateways and management tools ETL and ELT tools Git, CI/CD, and DevOps toolchain What Success Looks Like Reliable, secure More ❯

our data flows are scalable, secure, and high-performing. What You’ll Do Architect, build, and enhance integrations across ERP, CRM, POS, e-commerce, and analytics using Microsoft Azure, Databricks, and related tools Design, develop, and maintain secure ETL/ELT pipelines and real-time or near real-time dataflows Act as the subject matter expert on integration best practices … practices What You’ll Bring 10+ years of experience in enterprise integration, data architecture, or data engineering, ideally within retail, beauty, wellness, or consumer goods Proven expertise in Azure, Databricks, ETL, and API or middleware integrations Strong knowledge of SAP, CRM, Shopify POS, and e-commerce platforms Deep understanding of data governance, security, and cloud or SaaS environments Excellent communication … with the ability to influence across teams Strong documentation, solution review, and architectural advisory experience Degree in Computer Science or equivalent certifications Tools and Technologies Microsoft Azure Integration Services Databricks SAP CRM platforms Shopify POS E-commerce platforms API Gateways and management tools ETL and ELT tools Git, CI/CD, and DevOps toolchain What Success Looks Like Reliable, secure More ❯

Data Engineering Lead Azure & Databricks Full Time Role - Hybrid 2/3 days per week London This role has a Flexible salary and company benefits as well get in touch to learn more! My client is looking for a hands-on Data Engineering Lead to shape and evolve a modern hybrid data platform built on Azure and Databricks. This role … data solutions that drive analytics and reporting across the organisation. Design and enhance data pipelines that support large-scale ingestion, transformation, and delivery across varied sources. Leverage Azure and Databricks to ensure reliable, high-throughput data movement and integration for analytics and BI. Apply best practices in orchestration, monitoring, and error handling to maintain consistent and dependable data flows. Optimise … and innovation in BI practices to support decision-making. Enforce strong data governance, quality standards, and security protocols across the data estate. Deep experience in data engineering using Azure, Databricks, SQL, and Azure Data Factory, including medallion architecture. Proven leadership in guiding teams through complex data deliveries and adopting best practices. Strong background in ETL orchestration and hybrid cloud integration. More ❯

data solutions. Designing and maintaining robust data pipelines and models for analytics and reporting. Applying best practices in data architecture, security, and performance. Working with modern tools including Azure, Databricks, Python, Azure DevOps, Unity Catalog, and SQL . Supporting data governance through cataloguing, lineage, and compliance frameworks. Mentoring junior engineers and contributing to the team’s technical roadmap. What You … ll Bring Proven experience building and optimising data solutions in large, complex environments. Hands-on expertise in Azure, Databricks, and Python , with a strong grasp of modern data architectures. Experience working with Lloyd’s Syndicate and specialty insurance data sets , including data structures, lineage, and compliance nuances. Strong communication skills and a passion for collaboration and continuous improvement. If you More ❯

data solutions. Designing and maintaining robust data pipelines and models for analytics and reporting. Applying best practices in data architecture, security, and performance. Working with modern tools including Azure, Databricks, Python, Azure DevOps, Unity Catalog, and SQL . Supporting data governance through cataloguing, lineage, and compliance frameworks. Mentoring junior engineers and contributing to the team’s technical roadmap. What You … ll Bring Proven experience building and optimising data solutions in large, complex environments. Hands-on expertise in Azure, Databricks, and Python , with a strong grasp of modern data architectures. Experience working with Lloyd’s Syndicate and specialty insurance data sets , including data structures, lineage, and compliance nuances. Strong communication skills and a passion for collaboration and continuous improvement. If you More ❯

data solutions. Designing and maintaining robust data pipelines and models for analytics and reporting. Applying best practices in data architecture, security, and performance. Working with modern tools including Azure, Databricks, Python, Azure DevOps, Unity Catalog, and SQL . Supporting data governance through cataloguing, lineage, and compliance frameworks. Mentoring junior engineers and contributing to the team’s technical roadmap. What You … ll Bring Proven experience building and optimising data solutions in large, complex environments. Hands-on expertise in Azure, Databricks, and Python , with a strong grasp of modern data architectures. Experience working with Lloyd’s Syndicate and specialty insurance data sets , including data structures, lineage, and compliance nuances. Strong communication skills and a passion for collaboration and continuous improvement. If you More ❯

data solutions. Designing and maintaining robust data pipelines and models for analytics and reporting. Applying best practices in data architecture, security, and performance. Working with modern tools including Azure, Databricks, Python, Azure DevOps, Unity Catalog, and SQL . Supporting data governance through cataloguing, lineage, and compliance frameworks. Mentoring junior engineers and contributing to the team’s technical roadmap. What You … ll Bring Proven experience building and optimising data solutions in large, complex environments. Hands-on expertise in Azure, Databricks, and Python , with a strong grasp of modern data architectures. Experience working with Lloyd’s Syndicate and specialty insurance data sets , including data structures, lineage, and compliance nuances. Strong communication skills and a passion for collaboration and continuous improvement. If you More ❯

data solutions. Designing and maintaining robust data pipelines and models for analytics and reporting. Applying best practices in data architecture, security, and performance. Working with modern tools including Azure, Databricks, Python, Azure DevOps, Unity Catalog, and SQL . Supporting data governance through cataloguing, lineage, and compliance frameworks. Mentoring junior engineers and contributing to the team’s technical roadmap. What You … ll Bring Proven experience building and optimising data solutions in large, complex environments. Hands-on expertise in Azure, Databricks, and Python , with a strong grasp of modern data architectures. Experience working with Lloyd’s Syndicate and specialty insurance data sets , including data structures, lineage, and compliance nuances. Strong communication skills and a passion for collaboration and continuous improvement. If you More ❯

Data Engineering Lead – Azure & Databricks | Full Time Role - Hybrid 2/3 days per week London This role has a Flexible salary and company benefits as well get in touch to learn more! My client is looking for a hands-on Data Engineering Lead to shape and evolve a modern hybrid data platform built on Azure and Databricks. This role … reporting across the organisation. What does the role consist of? Design and enhance data pipelines that support large-scale ingestion, transformation, and delivery across varied sources. Leverage Azure and Databricks to ensure reliable, high-throughput data movement and integration for analytics and BI. Apply best practices in orchestration, monitoring, and error handling to maintain consistent and dependable data flows. Optimise … decision-making. Enforce strong data governance, quality standards, and security protocols across the data estate. What type of candidate do they need? Deep experience in data engineering using Azure, Databricks, SQL, and Azure Data Factory, including medallion architecture. Proven leadership in guiding teams through complex data deliveries and adopting best practices. Strong background in ETL orchestration and hybrid cloud integration. More ❯

Data Engineering Lead – Azure & Databricks | Full Time Role - Hybrid 2/3 days per week London This role has a Flexible salary and company benefits as well get in touch to learn more! My client is looking for a hands-on Data Engineering Lead to shape and evolve a modern hybrid data platform built on Azure and Databricks. This role … reporting across the organisation. What does the role consist of? Design and enhance data pipelines that support large-scale ingestion, transformation, and delivery across varied sources. Leverage Azure and Databricks to ensure reliable, high-throughput data movement and integration for analytics and BI. Apply best practices in orchestration, monitoring, and error handling to maintain consistent and dependable data flows. Optimise … decision-making. Enforce strong data governance, quality standards, and security protocols across the data estate. What type of candidate do they need? Deep experience in data engineering using Azure, Databricks, SQL, and Azure Data Factory, including medallion architecture. Proven leadership in guiding teams through complex data deliveries and adopting best practices. Strong background in ETL orchestration and hybrid cloud integration. More ❯

Data Engineering Lead – Azure & Databricks | Full Time Role - Hybrid 2/3 days per week London This role has a Flexible salary and company benefits as well get in touch to learn more! My client is looking for a hands-on Data Engineering Lead to shape and evolve a modern hybrid data platform built on Azure and Databricks. This role … reporting across the organisation. What does the role consist of? Design and enhance data pipelines that support large-scale ingestion, transformation, and delivery across varied sources. Leverage Azure and Databricks to ensure reliable, high-throughput data movement and integration for analytics and BI. Apply best practices in orchestration, monitoring, and error handling to maintain consistent and dependable data flows. Optimise … decision-making. Enforce strong data governance, quality standards, and security protocols across the data estate. What type of candidate do they need? Deep experience in data engineering using Azure, Databricks, SQL, and Azure Data Factory, including medallion architecture. Proven leadership in guiding teams through complex data deliveries and adopting best practices. Strong background in ETL orchestration and hybrid cloud integration. More ❯

Data Engineering Lead – Azure & Databricks | Full Time Role - Hybrid 2/3 days per week London This role has a Flexible salary and company benefits as well get in touch to learn more! My client is looking for a hands-on Data Engineering Lead to shape and evolve a modern hybrid data platform built on Azure and Databricks. This role … reporting across the organisation. What does the role consist of? Design and enhance data pipelines that support large-scale ingestion, transformation, and delivery across varied sources. Leverage Azure and Databricks to ensure reliable, high-throughput data movement and integration for analytics and BI. Apply best practices in orchestration, monitoring, and error handling to maintain consistent and dependable data flows. Optimise … decision-making. Enforce strong data governance, quality standards, and security protocols across the data estate. What type of candidate do they need? Deep experience in data engineering using Azure, Databricks, SQL, and Azure Data Factory, including medallion architecture. Proven leadership in guiding teams through complex data deliveries and adopting best practices. Strong background in ETL orchestration and hybrid cloud integration. More ❯

Data Engineering Lead – Azure & Databricks | Full Time Role - Hybrid 2/3 days per week London This role has a Flexible salary and company benefits as well get in touch to learn more! My client is looking for a hands-on Data Engineering Lead to shape and evolve a modern hybrid data platform built on Azure and Databricks. This role … reporting across the organisation. What does the role consist of? Design and enhance data pipelines that support large-scale ingestion, transformation, and delivery across varied sources. Leverage Azure and Databricks to ensure reliable, high-throughput data movement and integration for analytics and BI. Apply best practices in orchestration, monitoring, and error handling to maintain consistent and dependable data flows. Optimise … decision-making. Enforce strong data governance, quality standards, and security protocols across the data estate. What type of candidate do they need? Deep experience in data engineering using Azure, Databricks, SQL, and Azure Data Factory, including medallion architecture. Proven leadership in guiding teams through complex data deliveries and adopting best practices. Strong background in ETL orchestration and hybrid cloud integration. More ❯

high-performing team managing a complex hybrid SQL Server and Azure data estate. This includes over 80 on-premises SQL Server instances, as well as Azure SQL, Cosmos DB, Databricks, and Power BI servicesall managed using modern DevOps and Infrastructure as Code (IaC) practices with Terraform. Youll act as a technical leader across key areas such as performance tuning, automation … Administration Administer and support 80+ SQL Server instances (20172022) across standalone, multi-instance, and clustered environments. Manage and optimise Azure SQL, Cosmos DB, and related services such as Azure Databricks and Power BI Reporting Services. Support and maintain SSRS, SSAS, and SSIS across hybrid environments. Cloud Transformation & Azure Landing Zone Participate in the migration of databases and data services to … Demonstrated strength in problem-solving, root cause analysis, and cross-system diagnostics. Desirable Skills Microsoft certifications such as DP-300, AZ-104, AZ-305, or equivalent. Experience with Azure Databricks, Data Factory, or other analytics services. Familiarity with ARM templates, Bicep, or other IaC alternatives. Experience working in regulated or security-sensitive environments. Personal Attributes Technically curious and passionate about More ❯

high-performing team managing a complex hybrid SQL Server and Azure data estate. This includes over 80 on-premises SQL Server instances, as well as Azure SQL, Cosmos DB, Databricks, and Power BI services—all managed using modern DevOps and Infrastructure as Code (IaC) practices with Terraform. You’ll act as a technical leader across key areas such as performance … Administer and support 80+ SQL Server instances (2017–2022) across standalone, multi-instance, and clustered environments. Manage and optimise Azure SQL, Cosmos DB, and related services such as Azure Databricks and Power BI Reporting Services. Support and maintain SSRS, SSAS, and SSIS across hybrid environments. Cloud Transformation & Azure Landing Zone Participate in the migration of databases and data services to … Demonstrated strength in problem-solving, root cause analysis, and cross-system diagnostics. Desirable Skills Microsoft certifications such as DP-300, AZ-104, AZ-305, or equivalent. Experience with Azure Databricks, Data Factory, or other analytics services. Familiarity with ARM templates, Bicep, or other IaC alternatives. Experience working in regulated or security-sensitive environments. Personal Attributes Technically curious and passionate about More ❯

high-performing team managing a complex hybrid SQL Server and Azure data estate. This includes over 80 on-premises SQL Server instances, as well as Azure SQL, Cosmos DB, Databricks, and Power BI services—all managed using modern DevOps and Infrastructure as Code (IaC) practices with Terraform. You’ll act as a technical leader across key areas such as performance … Administer and support 80+ SQL Server instances (2017–2022) across standalone, multi-instance, and clustered environments. Manage and optimise Azure SQL, Cosmos DB, and related services such as Azure Databricks and Power BI Reporting Services. Support and maintain SSRS, SSAS, and SSIS across hybrid environments. Cloud Transformation & Azure Landing Zone Participate in the migration of databases and data services to … Demonstrated strength in problem-solving, root cause analysis, and cross-system diagnostics. Desirable Skills Microsoft certifications such as DP-300, AZ-104, AZ-305, or equivalent. Experience with Azure Databricks, Data Factory, or other analytics services. Familiarity with ARM templates, Bicep, or other IaC alternatives. Experience working in regulated or security-sensitive environments. Personal Attributes Technically curious and passionate about More ❯

high-performing team managing a complex hybrid SQL Server and Azure data estate. This includes over 80 on-premises SQL Server instances, as well as Azure SQL, Cosmos DB, Databricks, and Power BI services—all managed using modern DevOps and Infrastructure as Code (IaC) practices with Terraform. You’ll act as a technical leader across key areas such as performance … Administer and support 80+ SQL Server instances (2017–2022) across standalone, multi-instance, and clustered environments. Manage and optimise Azure SQL, Cosmos DB, and related services such as Azure Databricks and Power BI Reporting Services. Support and maintain SSRS, SSAS, and SSIS across hybrid environments. Cloud Transformation & Azure Landing Zone Participate in the migration of databases and data services to … Demonstrated strength in problem-solving, root cause analysis, and cross-system diagnostics. Desirable Skills Microsoft certifications such as DP-300, AZ-104, AZ-305, or equivalent. Experience with Azure Databricks, Data Factory, or other analytics services. Familiarity with ARM templates, Bicep, or other IaC alternatives. Experience working in regulated or security-sensitive environments. Personal Attributes Technically curious and passionate about More ❯

experience with cloud data services, modern data platforms, and data integration technologies. Core technologies include Azure Data Services such as Fabric, AI Foundry, Synapse Analytics, Data Lake, Data Factory, Databricks, Microsoft Purview and Power BI. What you'll do: Participate in pre-sales activities with customers, internal teams, and technology partners to help secure new business. Provide data-focused support … Present at customer workshops, webinars, and company events. What you'll need: Minimum 5 years of hands-on experience with Azure Data Services (e.g. Synapse, Data Factory, Data Lake, Databricks, Cosmos DB, Power BI). Hands-on experience with Microsoft Fabric and Agentic AI Understanding of data governance, security, and compliance in cloud environments and Microsoft Purview Knowledge of DevOps More ❯

Copilot Lead, Azure OpenAI, Copilot Studio, Microsoft Fabric, Microsoft Graph, Azure Cognitive Services, Databricks, Power Platform, AI Builder, Power Automate, Dynamics 365 (F&O/CE/BC), LLMs, agentic AI, product ownership, roadmap, backlog, MLOps, Responsible AI, data governance, rapid prototyping, commercialisation, 75,000 - 80,000 per annum Copilot Lead - Join a trusted Microsoft Partner specialising in business and … operations, and scalable data architectures. Technical and Professional Skills Product ownership excellence - roadmapping, backlog management, value hypothesis, and outcome-based prioritisation. Strong architecture and engineering acumen across Azure AI, Databricks, Fabric, Copilot Studio, and integration patterns for D365 and Power Platform. MLOps and lifecycle management - CI/CD for models, monitoring, drift management, and continuous improvement. Hands-on capability in … and partner alignment where applicable, maximising Microsoft co-sell opportunities. Solution Design and Delivery Lead the end-to-end design and architecture of AI solutions using Azure AI services, Databricks, Microsoft Fabric, and Copilot Studio, integrated with Dynamics 365 (F&O, CE, BC) and the Power Platform. Embed intelligent automation, predictive analytics, and natural-language experiences within ERP and line More ❯

Copilot Lead, Azure OpenAI, Copilot Studio, Microsoft Fabric, Microsoft Graph, Azure Cognitive Services, Databricks, Power Platform, AI Builder, Power Automate, Dynamics 365 (F&O/CE/BC), LLMs, agentic AI, product ownership, roadmap, backlog, MLOps, Responsible AI, data governance, rapid prototyping, commercialisation, £75,000 - £80,000 per annum Copilot Lead - Join a trusted Microsoft Partner specialising in business and … operations, and scalable data architectures. Technical and Professional Skills Product ownership excellence - roadmapping, backlog management, value hypothesis, and outcome-based prioritisation. Strong architecture and engineering acumen across Azure AI, Databricks, Fabric, Copilot Studio, and integration patterns for D365 and Power Platform. MLOps and lifecycle management - CI/CD for models, monitoring, drift management, and continuous improvement. Hands-on capability in … and partner alignment where applicable, maximising Microsoft co-sell opportunities. Solution Design and Delivery Lead the end-to-end design and architecture of AI solutions using Azure AI services, Databricks, Microsoft Fabric, and Copilot Studio, integrated with Dynamics 365 (F&O, CE, BC) and the Power Platform. Embed intelligent automation, predictive analytics, and natural-language experiences within ERP and line More ❯

Copilot Lead, Azure OpenAI, Copilot Studio, Microsoft Fabric, Microsoft Graph, Azure Cognitive Services, Databricks, Power Platform, AI Builder, Power Automate, Dynamics 365 (F&O/CE/BC), LLMs, agentic AI, product ownership, roadmap, backlog, MLOps, Responsible AI, data governance, rapid prototyping, commercialisation, 75,000 - 80,000 per annum Copilot Lead - Join a trusted Microsoft Partner specialising in business and … at scale. Drive certification and partner alignment where applicable, maximising Microsoft co-sell opportunities. Lead the end-to-end design and architecture of AI solutions using Azure AI services, Databricks, Microsoft Fabric, and Copilot Studio, integrated with Dynamics 365 (F&O, CE, BC) and the Power Platform. Embed intelligent automation, predictive analytics, and natural-language experiences within ERP and line More ❯