226 to 250 of 373 Databricks Jobs in the UK

Lead, you’ll deliver reporting primarily in Power BI and Excel , while also gaining hands-on experience with our modern data platform, including Azure Databricks and other emerging technologies. You’ll play a key role in improving data quality, supporting cleansing activity, and contributing to our wider data strategy. This ...

Lead Azure Databricks Engineer About the Role We are seeking a Lead Azure Databricks Engineer to join a specialist consultancy focused on transforming enterprises through modern cloud data platforms, advanced analytics and next-generation engineering capabilities. This role requires strong experience working within the Lloyd's of London or wider … engineering best practice and guide delivery across cross-functional teams. Responsibilities Build and optimise Azure data platforms using ADF, Data Lake, Azure Functions and Databricks Deliver reliable, high-quality data pipelines Work with stakeholders to ensure solutions meet Lloyd's of London regulatory, audit and data governance requirements Work with ...

Databricks Data Engineer £500 - £550 per day Outside IR35 We're partnering with a leading online retail company that's transforming the way data and real-time intelligence shape customer experiences. Their mission is to harness cutting-edge data and streaming technologies to drive smarter decisions, improve efficiency, and create … tools and frameworks for data governance, privacy, and quality monitoring, ensuring full compliance with data protection standards. Create resilient data workflows and automation within, Databricks, and other modern big data ecosystems. Contribute to an engineering culture that values testing, peer reviews, and automation-first principles. What You'll Bring Strong ...

Clearance - required• Lead the design, development, and deployment of scalable, secure, and cost-effective distributed data solutions [MA2.1]using Azure services (e.g., Azure Databricks, Azure Data Lake Storage, Azure Data Factory).• Architect and implement advanced data pipelines using Databricks, Delta Lake, Python and Spark, ensuring performance, reliability, and maintainability … junior and mid-level engineers, fostering a culture of continuous learning, innovation, and technical excellence. Experience needed: • Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory.• Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

Overview: We are seeking a motivated and detail-oriented Data Engineer with a passion for designing and delivering high-quality data solutions in Databricks . You will be responsible for building and optimising data pipelines that form the foundation of our reporting and analytics ecosystem. Using your technical expertise … role for you! Contract - 6 months Location - Cambridge (2 days onsite) Rate - Flexible (inside IR35) Responsibilities: Design, build, and maintain scalable ETL pipelines in Databricks to integrate data from multiple business systems such as ServiceNow, JIRA, and ADO. Optimise data workflows for performance, scalability, and reliability. Implement data validation ...

teams, and external partners (Microsoft) to ensure high‐quality delivery of modern analytics platforms. Required •Strong hands-on expertise in Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, Azure SQL, Synapse. •Proven experience designing and developing solutions using Microsoft Fabric: o Lakehouse o Data Pipelines o Dataflows Gen2 … OneLake governance •Ability to translate business requirements into technical architecture and detailed design. •Expertise in building scalable ingestion frameworks (batch/streaming) using ADF, Databricks or Fabric pipelines. •Strong programming skills in PySpark, SQL, Python. •Experience implementing medallion architecture, delta lakes, and metadata‐driven pipelines. •Hands-on experience with ...

data platform that will underpin some of the organisation’s most critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality … Work closely with architecture, analytics and business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

data platform that will underpin some of the organisation's most critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality … Work closely with architecture, analytics and business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

part in enabling data-driven transformation across critical UK industries. Core Responsibilities Design, build, and optimise data pipelines using Azure Data Factory, Synapse, and Databricks Develop and maintain ETL/ELT workflows to ensure high data quality and reliability Collaborate with analysts and AI engineers to deliver robust and reusable … junior engineers and contribute to team capability building Technical Stack Core: Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Gen2 SQL Server Databricks Enhancements: Python (PySpark, Pandas) CI/CD (Azure DevOps) Infrastructure as Code (Terraform, Bicep) REST APIs GitHub Actions Desirable: Microsoft Fabric Delta Live Tables Power ...

owner for our Azure and Fabric data platforms and Microsoft Purview governance environment. Oversee architecture, roadmap and optimisation across Azure Data Lake, Data Factory, Databricks, Synapse, SQL, Fabric Lakehouse and Power BI. Ensure data platforms meet regulatory and best-practice expectations (GDPR, PRA/FCA, DAMA). Data Governance & Compliance … Essential Proven experience leading data functions in financial services or other regulated environments. Deep technical expertise across the Microsoft Azure data ecosystem, including ADF, Databricks, Synapse, SQL, ADLS, and DevOps CI/CD. Understanding of Microsoft Purview governance, lineage, classification and policy controls. Hands-on leadership across Microsoft Fabric-lakehouse ...

Databricks Data Architect/Lead Data Engineer - Contract We're working with a client undergoing a major data transformation and are looking for an experienced Databricks contractor to play a key role in shaping and delivering a modern data platform. This is an opportunity to join a high-impact programme … engineering capability with a solid understanding of data modelling, lakehouse design, and governance best practice . Key experience required: Strong hands-on experience with Databricks Strong SQL and Python/PySpark Data modelling and modern warehouse/lakehouse design ETL/ELT pipeline development and optimisation Data governance, quality, lineage ...

AWS Data Engineer (Innovation Group) Location: London (Hybrid – 3 days per week) Duration: 6 Months Initial Contract Rate: TBD Are you a Data Engineer who thrives on building more than just standard ETL pipelines? Our ...

Azure Databricks Architect 6 months Remote with 2 days travel to London per month Active SC Inside IR35 Role Summary We require an Azure Databricks Architect to provide architectural leadership and assurance for the design, implementation, and ongoing evolution of an Azure-based data and analytics platform within a public … ensure solutions are secure, scalable, and compliant with organisational and government standards. Key Responsibilities Define and maintain the end-to-end architecture for Azure Databricks-based data platforms. Design Lakehouse architectures using Azure Databricks, Azure Data Lake Storage (ADLS Gen2), and associated Azure services. Produce and maintain High-Level Designs ...

Modeller Analytical Solutions to lead the design of enterprise-scale analytical data models for our new data platform built on Azure Data Stack (Azure Databricks & Microsoft Fabric). While our current ecosystem is a Microsoft-centric environment, we are looking for a candidate whose expertise is rooted in foundational data ...

Python Full Stack Developer - Azure Databricks London (Hybrid) 6 Month Contract £550/day (Inside IR35) Python Full Stack Developer needed with active SC Security Clearance Azure Cloud and Azure Databricks. . 6 Month Contract based in Central London (Hybrid). xkybehq Start ASAP in March/April 2026. Hybrid ...

networking, and security Experience with Microsoft Entra ID and Infrastructure as Code (Terraform, Bicep, or ARM) Knowledge of modern data platforms (Microsoft Fabric, Azure Databricks, Data Lake) Exposure to Azure AI/OpenAI solutions Experience in a client-facing consulting role AZ-305 certification preferred Security Clearance Candidates must hold ...

wider regulatory, compliance environment for global insurance businesses (e.g. GDPR) Knowledge of Business Intelligence and Data platform technologies (e.g. Microsoft Fabric, Databricks etc.). Good knowledge of technology governance standards Good knowledge of technology best practice including SDLC Please apply ...

strong statistical/ML background Integrate external forecasting methods into IBP Support promotions planning , ensuring data and forecasts are correctly incorporated Collaborate with offshore Databricks consultants to deliver production-ready solutions Occasional visits to Walton-on-Thames client site Requirements Experience with SAP IBP Demand and demand planning processes Familiarity ...

wider regulatory, compliance environment for global insurance businesses (e.g. GDPR) Knowledge of Business Intelligence and Data platform technologies (e.g. Microsoft Fabric, Databricks etc.). Good knowledge of technology governance standards Good knowledge of technology best practice including SDLC Please apply Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting ...

engagement capability across all levels Proactive, hands-on mindset with willingness to get involved in both business and technical detail Interest in tools like Databricks, Informatica, and Excel-based governance templates Curiosity, initiative and a desire to grow alongside a maturing data governance function Click"APPLY" OR Email ...

Senior Data Engineer- Spark & Databricks Optimisation- Up to £55K North Lincolnshire/Hybrid (2 days onsite) Major performance, optimisation & AI-driven projects Are you a Data Engineer who loves solving performance challenges, optimising compute, and getting stuck into large-scale data environments? This one is very much for the techies … make smart architectural decisions that genuinely impact runtime and cost. Tech-wise, you'll have hands-on experience with a modern cloud ecosystem. ideally Databricks (but AWS, Azure or GCP equivalents are absolutely fine). You'll understand how to optimise Spark, improve compute efficiency, and ensure pipelines are robust ...

right at the start of our data journey. Not maintaining something someone else built five years ago, but designing and building a modern Databricks Lakehouse on Azure from the ground up and we need a Data Engineer who's as curious about why we're doing … better tool to solve a problem you'll fit right in. What you'll bring You'll likely have: Hands-on expertise with Databricks Confidence in Python, Spark and SQL Experience building pipelines in Azure A solid understanding of data modelling and scalable architectures But just as important ...

Data Architect (Databricks) £110,000–£125,000 + Benefits Hybrid – 2 days a week in London, Manchester, or Edinburgh Gravitas is partnered with a leading organisation seeking an experienced Data Architect with a strong consultancy background to provide expertise, guidance, and strategic advisory to clients. You will play … role in shaping modern data ecosystems and delivering scalable, efficient solutions using Databricks and Lakehouse architecture. The Role In this position, you will: Design and deliver robust, scalable, modern data architectures. Lead client engagements and influence long‐term data strategy. Ensure best practice across performance, governance, security, and Databricks optimisation. ...

Data Architect (Databricks) £110,000–£125,000 + Benefits Hybrid – 2 days a week in London, Manchester, or Edinburgh Gravitas is partnered with a leading organisation seeking an experienced Data Architect with a strong consultancy background to provide expertise, guidance, and strategic advisory services to clients. You will play … role in shaping modern data ecosystems and delivering scalable, efficient solutions using Databricks and Lakehouse architecture. The Role In this position, you will: Design and deliver robust, scalable, modern data architectures. Lead client engagements and influence long‐term data strategy. Ensure best practice across performance, governance, security, and Databricks optimisation. ...

engineering and platform roles, with 3–5 years focused on architecture. Proven hands-on experience with at least two major cloud data platforms (e.g., Databricks, Snowflake, BigQuery) in production environments. Strong understanding of cross-cloud integration, networking, identity management, and data governance. Experience leading large-scale data platform modernization, consolidation ...