201 to 225 of 356 Databricks Jobs in the UK

modern cloud data platform? We are seeking a Data Engineer Lead to design, build, and optimise enterprise-scale data solutions, focusing on Databricks and cloud-based engineering. You’ll lead the migration of legacy Oracle systems to a scalable, cloud-native environment, ensuring high-quality pipelines and models that support … analytics, regulatory reporting, and business decision-making. Key Responsibilities Lead the design and development of Data Marts and pipelines using Databricks (SQL/Python). Manage migration from Oracle databases to cloud-native platforms, including data model redesign and automated ETL/ELT frameworks. Provide technical leadership, mentoring, and coaching ...

Month Contract £600-650/day (Inside IR35) DevOps Platform Engineer needed with active SC Security Clearance and strong Azure Cloud expertise including Databricks + Data Factory. 6 Month Rolling Contract based in London click apply for full job details ...

Data Engineer (SQL Databricks Python) *Newcastle Onsite* to £120k Do you have a first class education combined with Data Engineering skills? You could be progressing your career at a start-up Investment Management firm that have secure backing, an established Hedge Fund client as a partner and massive growth potential. … grades at A-level You have commercial Data Engineering experience and a strong understanding of modern data engineering best practices You have experience with Databricks, ideally also Azure You have experience of working with technologies such as SQL, Apache Spark and Python including PySpark and Pandas You're excited ...

scale our modern data governance framework. You will be at the intersection of data engineering and business strategy, ensuring our data assets in Azure Databricks (Unity Catalog) and Microsoft Fabric are secure, discoverable, and high-quality click apply for full job details ...

Month Contract £600-650/day (Inside IR35) DevOps Platform Engineer needed with active SC Security Clearance and strong Azure Cloud expertise including Databricks + Data Factory. 6 Month Rolling Contract based in London. xkybehq Start ASAP in March/April 2026. Hybrid Working - 2 days/week remote ...

required: Proven operational leadership for large-scale data platforms. Expertise in incident management, SLA enforcement, and stakeholder communication. Hands-on experience with Azure Synapse, Databricks, ADF, Power BI. Familiarity with CI/CD and automation. Strong FinOps mindset and cost management experience. Knowledge of monitoring and observability frameworks. Salary ...

senior leaders actually use You’re confident with SQL, comfortable with Python or R, and familiar with large datasets and marketing platforms (they use Databricks). Due to a high volume of applicants, we are unable to respond to everyone. We will get in touch if you are successful ...

claims, and risk.• Demonstrable experience defining product strategy, roadmaps, prioritisation frameworks, and value measurement.• Practical knowledge of cloud data platforms such as Azure and Databricks, with the ability to engage engineering teams credibly.• Experience establishing governance frameworks for data products, ensuring regulatory compliance and data integrity.• Strong executive level stakeholder ...

claims, and risk. • Demonstrable experience defining product strategy, roadmaps, prioritisation frameworks, and value measurement. • Practical knowledge of cloud data platforms such as Azure and Databricks, with the ability to engage engineering teams credibly. • Experience establishing governance frameworks for data products, ensuring regulatory compliance and data integrity. • Strong executive level stakeholder ...

architecture: medallion architecture (Bronze/Silver/Gold), Delta Lake, or equivalent. Proficiency in dimensional modelling (Kimball methodology) and enterprise data modelling. Experience with Databricks (Unity Catalog, Delta Lake) or Snowflake on AWS. Knowledge of Semantic Layer design patterns: pre-computed aggregations, business-facing views, Tableau integration. Experience migrating from ...

claims, and risk. • Demonstrable experience defining product strategy, roadmaps, prioritisation frameworks, and value measurement. • Practical knowledge of cloud data platforms such as Azure and Databricks, with the ability to engage engineering teams credibly. • Experience establishing governance frameworks for data products, ensuring regulatory compliance and data integrity. • Strong executive level stakeholder ...

Experience owning roadmaps and prioritising backlogs in agile environments Confidence engaging and influencing senior stakeholders Familiarity with data platforms and tools (e.g. Power BI, Databricks or similar) Clear, compelling communicator who can translate complexity into clarity Why Join Us? You’ll play a central role in shaping how data ...

environments Hands-on background with: Microsoft Power Platform/Dynamics, REST, SOAP, and Web API integrations, Azure Integration Services, Azure DevOps, Azure Service Bus, Databricks, Jitterbit, SQL Server, C#, ASP.NET, JavaScript, XML Experience delivering engineering work within large IT change portfolios Strong understanding of SDLC, automation, DevOps, pipelines, and engineering ...

systems analysis and solution design Proven experience designing and supporting Microsoft Azure based platforms Hands-on exposure to Data & AI technologies, such as: Azure Databricks/Microsoft Fabric Enterprise AI tooling (e.g. Copilot, Foundry, Bedrock or equivalent) Databases (SQL Server and/or Oracle) Experience with identity, security and risk ...

Lead, you’ll deliver reporting primarily in Power BI and Excel , while also gaining hands-on experience with our modern data platform, including Azure Databricks and other emerging technologies. You’ll play a key role in improving data quality, supporting cleansing activity, and contributing to our wider data strategy. This ...

Lead Azure Databricks Engineer About the Role We are seeking a Lead Azure Databricks Engineer to join a specialist consultancy focused on transforming enterprises through modern cloud data platforms, advanced analytics and next-generation engineering capabilities. This role requires strong experience working within the Lloyd's of London or wider … engineering best practice and guide delivery across cross-functional teams. Responsibilities Build and optimise Azure data platforms using ADF, Data Lake, Azure Functions and Databricks Deliver reliable, high-quality data pipelines Work with stakeholders to ensure solutions meet Lloyd's of London regulatory, audit and data governance requirements Work with ...

Databricks Data Engineer £500 - £550 per day Outside IR35 We're partnering with a leading online retail company that's transforming the way data and real-time intelligence shape customer experiences. Their mission is to harness cutting-edge data and streaming technologies to drive smarter decisions, improve efficiency, and create … tools and frameworks for data governance, privacy, and quality monitoring, ensuring full compliance with data protection standards. Create resilient data workflows and automation within, Databricks, and other modern big data ecosystems. Contribute to an engineering culture that values testing, peer reviews, and automation-first principles. What You'll Bring Strong ...

Clearance - required• Lead the design, development, and deployment of scalable, secure, and cost-effective distributed data solutions [MA2.1]using Azure services (e.g., Azure Databricks, Azure Data Lake Storage, Azure Data Factory).• Architect and implement advanced data pipelines using Databricks, Delta Lake, Python and Spark, ensuring performance, reliability, and maintainability … junior and mid-level engineers, fostering a culture of continuous learning, innovation, and technical excellence. Experience needed: • Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory.• Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

Overview: We are seeking a motivated and detail-oriented Data Engineer with a passion for designing and delivering high-quality data solutions in Databricks . You will be responsible for building and optimising data pipelines that form the foundation of our reporting and analytics ecosystem. Using your technical expertise … role for you! Contract - 6 months Location - Cambridge (2 days onsite) Rate - Flexible (inside IR35) Responsibilities: Design, build, and maintain scalable ETL pipelines in Databricks to integrate data from multiple business systems such as ServiceNow, JIRA, and ADO. Optimise data workflows for performance, scalability, and reliability. Implement data validation ...

teams, and external partners (Microsoft) to ensure high‐quality delivery of modern analytics platforms. Required •Strong hands-on expertise in Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, Azure SQL, Synapse. •Proven experience designing and developing solutions using Microsoft Fabric: o Lakehouse o Data Pipelines o Dataflows Gen2 … OneLake governance •Ability to translate business requirements into technical architecture and detailed design. •Expertise in building scalable ingestion frameworks (batch/streaming) using ADF, Databricks or Fabric pipelines. •Strong programming skills in PySpark, SQL, Python. •Experience implementing medallion architecture, delta lakes, and metadata‐driven pipelines. •Hands-on experience with ...

data platform that will underpin some of the organisation’s most critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality … Work closely with architecture, analytics and business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

data platform that will underpin some of the organisation's most critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality … Work closely with architecture, analytics and business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

part in enabling data-driven transformation across critical UK industries. Core Responsibilities Design, build, and optimise data pipelines using Azure Data Factory, Synapse, and Databricks Develop and maintain ETL/ELT workflows to ensure high data quality and reliability Collaborate with analysts and AI engineers to deliver robust and reusable … junior engineers and contribute to team capability building Technical Stack Core: Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Gen2 SQL Server Databricks Enhancements: Python (PySpark, Pandas) CI/CD (Azure DevOps) Infrastructure as Code (Terraform, Bicep) REST APIs GitHub Actions Desirable: Microsoft Fabric Delta Live Tables Power ...

owner for our Azure and Fabric data platforms and Microsoft Purview governance environment. Oversee architecture, roadmap and optimisation across Azure Data Lake, Data Factory, Databricks, Synapse, SQL, Fabric Lakehouse and Power BI. Ensure data platforms meet regulatory and best-practice expectations (GDPR, PRA/FCA, DAMA). Data Governance & Compliance … Essential Proven experience leading data functions in financial services or other regulated environments. Deep technical expertise across the Microsoft Azure data ecosystem, including ADF, Databricks, Synapse, SQL, ADLS, and DevOps CI/CD. Understanding of Microsoft Purview governance, lineage, classification and policy controls. Hands-on leadership across Microsoft Fabric-lakehouse ...

development.Engineer data for optimal AI application performance.Advise peers and senior management on business and customer impact.Write production-grade Python code, leveraging CI/CD, Databricks, and ensuring appropriate test coverage; proficiency in SQL.Liaise with third-party partners and stay updated on field advancements and regulations.Collaborate with data governance and data … huggingface and LLM offerings by 3rd party vendors.Knowledge of OO programming and software design, i.e., SOLID principles.Knowledge and working experience of AGILE methodologies.Familiarity with Databricks, and RAG application architecture a plusExperience with latency optimisation and quantisation preferredAdditional InformationWhat’s in it for you?:Competitive salary that reflects your skills, experience ...