726 to 750 of 979 Databricks Jobs in the UK

working with the latest Azure technologies to help the business make smarter, data-driven decisions. What you'll be doing Building and maintaining data pipelines using Azure Data Factory , Databricks , and Synapse Analytics Supporting the design and development of a centralised data platform Working closely with analysts and business stakeholders to understand data needs Enhancing data quality, governance, and performance … across key datasets Contributing to an environment that values collaboration, learning, and innovation What we're looking for Hands-on experience with the Azure Data Engineering stack (ADF, Databricks, Synapse, Data Lake) Strong skills in SQL and Python (PySpark experience is a bonus) Experience building and optimising ETL/ELT pipelines A background in Financial Services is a plus, but More ❯

a key role in building, optimising, and maintaining cloud-based data solutions. Responsibilities include: Developing and maintaining end-to-end data pipelines using Azure services such as Data Factory, Databricks, Synapse, and Data Lake. Designing and optimising data models, warehouses, and lakehouse architectures to support analytics and reporting requirements. Ensuring data governance, security, and compliance across cloud platforms, implementing access … improvements to ensure reliable and accurate data availability. Mentoring junior engineers and sharing knowledge through documentation, workshops, and code reviews. What We’re Looking For Strong experience with Azure Databricks (Unity Catalog, DLT, cluster management) and other Azure services (Data Factory, Synapse, Data Lake Storage, Stream Analytics, Event Hubs). Advanced SQL knowledge with experience optimising relational databases and writing More ❯

a key role in building, optimising, and maintaining cloud-based data solutions. Responsibilities include: Developing and maintaining end-to-end data pipelines using Azure services such as Data Factory, Databricks, Synapse, and Data Lake. Designing and optimising data models, warehouses, and lakehouse architectures to support analytics and reporting requirements. Ensuring data governance, security, and compliance across cloud platforms, implementing access … improvements to ensure reliable and accurate data availability. Mentoring junior engineers and sharing knowledge through documentation, workshops, and code reviews. What We’re Looking For Strong experience with Azure Databricks (Unity Catalog, DLT, cluster management) and other Azure services (Data Factory, Synapse, Data Lake Storage, Stream Analytics, Event Hubs). Advanced SQL knowledge with experience optimising relational databases and writing More ❯

ADF) . Develop ETL/ELT processes to integrate and transform large datasets across cloud and on-prem environments. Implement and optimise data solutions in Azure Synapse, Data Lake, Databricks , and Snowflake . Write efficient SQL and Python scripts for data manipulation, validation, and automation. Collaborate with data architects and analysts to ensure data consistency and quality across systems. Troubleshoot … data ingestion and transformation workflows. Ensure compliance with data security and governance standards. Key Skills: Strong experience with Azure Data Factory (ADF) – expert level. Hands-on skills in Azure Databricks , Snowflake , and SQL . Proficiency in Python for automation and data transformation. Good debugging and problem-solving skills. Excellent communication and collaboration abilities. 6–8 years of overall data engineering More ❯

ADF) . Develop ETL/ELT processes to integrate and transform large datasets across cloud and on-prem environments. Implement and optimise data solutions in Azure Synapse, Data Lake, Databricks , and Snowflake . Write efficient SQL and Python scripts for data manipulation, validation, and automation. Collaborate with data architects and analysts to ensure data consistency and quality across systems. Troubleshoot … data ingestion and transformation workflows. Ensure compliance with data security and governance standards. Key Skills: Strong experience with Azure Data Factory (ADF) – expert level. Hands-on skills in Azure Databricks , Snowflake , and SQL . Proficiency in Python for automation and data transformation. Good debugging and problem-solving skills. Excellent communication and collaboration abilities. 6–8 years of overall data engineering More ❯

What do we do: Our mission is to combine premium consulting with deep technology and data knowledge to add value to our clients. The opportunity: Valcon is growing its Databricks community and we're looking for a Databricks Architect to help clients turn data into measurable business results. As a Databricks Elite Partner, we work on some of the most … advanced data and AI projects in Europe. You'll own the design and governance of the Databricks Lakehouse platform. You'll set technical standards, shape data architecture, and guide engineers to build secure, cost-efficient, and scalable solutions for analytics, AI, and applications. Overview of Data Capability: Every company has data challenges, easy or complex, big or small. This asks … made of 4 competence teams: Data Governance Data Management Data Platforms Data Science and Artificial Intelligence What you'll do: You'll work on projects with leading organisations using Databricks to advance their AI and data strategies. Partner with data leaders and solution architects to align Databricks design with strategy Lead, advise on and review the design of platforms, pipelines More ❯

solutions. This role requires deep expertise in enterprise architecture, AI systems design, and cloud-native platforms (specifically Microsoft Azure, leveraging services like Azure AI Studio/Foundry, Azure OpenAI, Databricks). Collaborate with C-suite executives, Directors, Business & technology stakeholders, data scientists, and engineering teams to ensure that AI initiatives are scalable, secure, ethically sound, and aligned with Ecolab's … methodologies to ensure smooth delivery and production deployment. Data and Integration: Ensure data readiness for AI initiatives, collaborating with data engineers to design robust data pipelines (leveraging tools like Databricks) that provide timely, accurate, and contextual data to AI agents. Security, Ethics, and Compliance: Embed robust security measures, data privacy, and ethical AI principles into every architectural layer. Ensure solutions More ❯

in London office And many more Role and Responsibilities Architect, develop, and continuously improve robust data pipelines to support large-scale data ingestion, transformation, and delivery. Utilize Azure and Databricks platforms to ensure high-throughput and reliable data movement across diverse data sources, enabling seamless integration, cleansing, and enrichment of data for analytics and reporting needs. Implement best practices for … and support decision-making. Enforce data quality standards, governance frameworks, and robust security protocols across all data platforms. Requirements Proven expertise in data engineering and using Azure, SQL, and Databricks, including implementing medallion architecture frameworks for scalable, reliable, and governed data solutions. Strong leadership and mentorship capabilities, guiding teams through complex deliveries, fostering collaboration, and ensuring adoption of best practices. More ❯

in London office And many more Role and Responsibilities Architect, develop, and continuously improve robust data pipelines to support large-scale data ingestion, transformation, and delivery. Utilize Azure and Databricks platforms to ensure high-throughput and reliable data movement across diverse data sources, enabling seamless integration, cleansing, and enrichment of data for analytics and reporting needs. Implement best practices for … and support decision-making. Enforce data quality standards, governance frameworks, and robust security protocols across all data platforms. Requirements Proven expertise in data engineering and using Azure, SQL, and Databricks, including implementing medallion architecture frameworks for scalable, reliable, and governed data solutions. Strong leadership and mentorship capabilities, guiding teams through complex deliveries, fostering collaboration, and ensuring adoption of best practices. More ❯

in London office And many more Role and Responsibilities Architect, develop, and continuously improve robust data pipelines to support large-scale data ingestion, transformation, and delivery. Utilize Azure and Databricks platforms to ensure high-throughput and reliable data movement across diverse data sources, enabling seamless integration, cleansing, and enrichment of data for analytics and reporting needs. Implement best practices for … and support decision-making. Enforce data quality standards, governance frameworks, and robust security protocols across all data platforms. Requirements Proven expertise in data engineering and using Azure, SQL, and Databricks, including implementing medallion architecture frameworks for scalable, reliable, and governed data solutions. Strong leadership and mentorship capabilities, guiding teams through complex deliveries, fostering collaboration, and ensuring adoption of best practices. More ❯

in London office And many more Role and Responsibilities Architect, develop, and continuously improve robust data pipelines to support large-scale data ingestion, transformation, and delivery. Utilize Azure and Databricks platforms to ensure high-throughput and reliable data movement across diverse data sources, enabling seamless integration, cleansing, and enrichment of data for analytics and reporting needs. Implement best practices for … and support decision-making. Enforce data quality standards, governance frameworks, and robust security protocols across all data platforms. Requirements Proven expertise in data engineering and using Azure, SQL, and Databricks, including implementing medallion architecture frameworks for scalable, reliable, and governed data solutions. Strong leadership and mentorship capabilities, guiding teams through complex deliveries, fostering collaboration, and ensuring adoption of best practices. More ❯

in London office And many more Role and Responsibilities Architect, develop, and continuously improve robust data pipelines to support large-scale data ingestion, transformation, and delivery. Utilize Azure and Databricks platforms to ensure high-throughput and reliable data movement across diverse data sources, enabling seamless integration, cleansing, and enrichment of data for analytics and reporting needs. Implement best practices for … and support decision-making. Enforce data quality standards, governance frameworks, and robust security protocols across all data platforms. Requirements Proven expertise in data engineering and using Azure, SQL, and Databricks, including implementing medallion architecture frameworks for scalable, reliable, and governed data solutions. Strong leadership and mentorship capabilities, guiding teams through complex deliveries, fostering collaboration, and ensuring adoption of best practices. More ❯

data products that enable self-service analytics, advanced modelling, and AI-driven decision-making across our insurance business. What you’ll do: Design and manage scalable cloud data platforms (Databricks on AWS) across development, staging, and production environments, ensuring reliable performance and cost efficiency. Integrate and model data from diverse sources – including warehouses, APIs, marketing platforms, and operational systems – using … and Delta Live Tables Strong background in building high-performance, scalable data models that support self-service BI and regulatory reporting requirements Direct exposure to cloud-native data infrastructures (Databricks, Snowflake) especially in AWS environments is a plus Experience in building and maintaining batch and streaming data pipelines using Kafka, Airflow, or Spark Familiarity with governance frameworks, access controls (RBAC More ❯

data products that enable self-service analytics, advanced modelling, and AI-driven decision-making across our insurance business. What you’ll do: Design and manage scalable cloud data platforms (Databricks on AWS) across development, staging, and production environments, ensuring reliable performance and cost efficiency. Integrate and model data from diverse sources – including warehouses, APIs, marketing platforms, and operational systems – using … and Delta Live Tables Strong background in building high-performance, scalable data models that support self-service BI and regulatory reporting requirements Direct exposure to cloud-native data infrastructures (Databricks, Snowflake) especially in AWS environments is a plus Experience in building and maintaining batch and streaming data pipelines using Kafka, Airflow, or Spark Familiarity with governance frameworks, access controls (RBAC More ❯

systems. Design serverless, event-driven workflows using Azure Functions, Logic Apps, and Power Automate. Build and optimize ML models for predictive analytics, anomaly detection, and recommendations using Azure ML, Databricks, and Python. Integrate agents with enterprise platforms such as SAP HANA, Salesforce, Snowflake, Kafka, and UiPath. Ensure observability and reliability through Azure Monitor, logging, and alerting frameworks. Define and enforce … Define use cases and validate outcomes with business stakeholders and SMEs. Support adoption and training with change management and enablement teams. Develop solutions using Python, Power Apps, Power Automate, Databricks, and Snowflake. Integrate with enterprise systems such as SAP HANA, Kafka, and UiPath. Build and deploy agents on Microsoft AI Foundry (preferred) and Copilot Studio (optional). Implement workflows with More ❯

Data EngineerLeicester£65,000 to £75,000Permanent I am currently looking for a Data Engineer to join a forward-thinking organisation, where you will play a pivotal role in building a modern, enterprise-scale data platform. Data Engineer - What will More ❯

long term project that is looking for a Data Engineering Lead to head up a team of three, driving the design and optimisation of a cutting-edge Azure/Databricks data platform. This hybrid role is perfect for an innovative and adaptable professional, ready to make an impact on turning data into real business impact. You would play your part … in improving the company's performance and scalability.*Skills and responsibilities needed:* - Databricks, SQL and Azure Data Factory.- Expert in MS Business Intelligence tools and platforms.- Proven experience in data modelling and database management.- Ability to lead and mentor a team of data engineers.- Familiarity with data warehousing and ETL processes.Looking for someone to start as soon as possible for More ❯

Databricks Engineer - SC Cleared Fully Remote 6-month initial contract Start Date: 17th November 2025 £550 per day Inside IR35 We are seeking two SC Cleared Databricks Analysts to support a high-profile data engineering and analytics programme with one of our GovTech Consultancy clients. The successful candidates will play a key role in designing, developing, and optimising data pipelines More ❯

passion for new technologies Experience in startups or top-tier consultancies is a plus Nice to Have: Familiarity with dashboarding tools, Typescript, and API development Exposure to Airflow, DBT, Databricks Experience with ERP (e.g. SAP, Oracle) and CRM systems What's On Offer: Salary: £50,000-£75,000 + share options Hybrid working: 2-3 days per week in a More ❯

Senior Machine Learning/AI Engineer Position Overview: We are seeking a Senior Machine Learning/AI Engineer with expertise in Databricks, MLOps/LLMOps, and cloud-native architecture . The candidate must have recent experience implementing data science solutions in Databricks and be comfortable deploying web applications via containerized workflows (Docker, Kubernetes). This role involves building scalable AI …/ML systems, deploying LLMs, and operationalizing models in production. Key Responsibilities: Design, develop, and deploy ML, Deep Learning, and LLM solutions. Implement scalable ML and data pipelines in Databricks (PySpark, Delta Lake, MLflow). Build automated MLOps pipelines with model tracking, CI/CD, and registry. Deploy and operationalize LLMs , including fine-tuning, prompt optimization, and monitoring. Architect secure … Jenkins). Mentor engineers, enforce best practices, and lead design/architecture reviews. Required Skills & Experience: 5+ years in ML/AI solution development. Recent hands-on experience with Databricks, PySpark, Delta Lake, MLflow . Experience with LLMs (Hugging Face, LangChain, Azure OpenAI) . Strong MLOps, CI/CD, and model monitoring experience. Proficiency in Python, PyTorch/TensorFlow, FastAPI More ❯

Senior Python Developer - Python, SQL, Databricks, AWS/Azure OB have partnered with a Global Insurance Leader, who are expanding their Python Engineering team, with Senior Python Developer, skilled with Python, SQL, Databricks and Cloud Infrastructure. In this role, you will play a key part in designing and building new capabilities, such as high-performance API's and high-frequency … event streams, as well as making improvements to their current platform. Senior Python Developer - Python, SQL, Databricks, AWS/Azure Key skills and experience: Python FastAPI SQL Databricks AWS/Azure API's Hybrid working with 3-days a week required in a Central London office Pays up to £90k + benefits To be considered, you must be UK based … Senior Python Developer - Python, SQL, Databricks, AWS/Azure More ❯

Role Title: Sr. Databricks Engineer Location: Glasgow Duration: 31/12/2026 Days on site: 2-3 MUST BE PAYE THROUGH UMBRELLA Role Description: We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on designing … building, and optimizing scalable data solutions using the Databricks platform. Key Responsibilities: • Lead the migration of existing AWS-based data pipelines to Databricks. • Design and implement scalable data engineering solutions using Apache Spark on Databricks. • Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. • Optimize performance and cost-efficiency of Databricks workloads. • Develop and … maintain CI/CD workflows for Databricks using GitLab or similar tools. • Ensure data quality and reliability through robust unit testing and validation frameworks. • Implement best practices for data governance, security, and access control within Databricks. • Provide technical mentorship and guidance to junior engineers. Must-Have Skills: • Strong hands-on experience with Databricks and Apache Spark (preferably PySpark). • Proven More ❯

Role Title: Sr. Databricks Engineer Location: Glasgow Duration: 31/12/2026 Days on site: 2-3 MUST BE PAYE THROUGH UMBRELLA Role Description: We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on designing … building, and optimizing scalable data solutions using the Databricks platform. Key Responsibilities: • Lead the migration of existing AWS-based data pipelines to Databricks. • Design and implement scalable data engineering solutions using Apache Spark on Databricks. • Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. • Optimize performance and cost-efficiency of Databricks workloads. • Develop and … maintain CI/CD workflows for Databricks using GitLab or similar tools. • Ensure data quality and reliability through robust unit testing and validation frameworks. • Implement best practices for data governance, security, and access control within Databricks. • Provide technical mentorship and guidance to junior engineers. Must-Have Skills: • Strong hands-on experience with Databricks and Apache Spark (preferably PySpark). • Proven More ❯

Role Title: Sr. Databricks Engineer Location: Glasgow Duration: 31/12/2026 Days on site: 2-3 MUST BE PAYE THROUGH UMBRELLA Role Description: We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on designing … building, and optimizing scalable data solutions using the Databricks platform. Key Responsibilities: • Lead the migration of existing AWS-based data pipelines to Databricks. • Design and implement scalable data engineering solutions using Apache Spark on Databricks. • Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. • Optimize performance and cost-efficiency of Databricks workloads. • Develop and … maintain CI/CD workflows for Databricks using GitLab or similar tools. • Ensure data quality and reliability through robust unit testing and validation frameworks. • Implement best practices for data governance, security, and access control within Databricks. • Provide technical mentorship and guidance to junior engineers. Must-Have Skills: • Strong hands-on experience with Databricks and Apache Spark (preferably PySpark). • Proven More ❯

Senior Data Engineer (Databricks) Location: London (Hybrid) Rate: Negotiable, depending on experience Duration: 6 months (initial)We’re looking for a Senior Data Engineer (Databricks) to join a world-leading energy organisation on a key transformation programme within their trading and supply division. This is an exciting opportunity to play a pivotal role in building modern, scalable data solutions using … engineering space. Required Skills & Experience Cloud Platforms: Strong expertise in AWS/Azure/SAP ETL/ELT Pipelines: Advanced proficiency Data Modelling: Expert level Data Integration & Ingestion: Skilled Databricks, SQL, Synapse, Data Factory and related Azure services Version Control/DevOps tools: GITHUB, Azure DevOps, Actions Testing & Automation tools: PyTest, SonarQube Desirable Experience Experience leading or running scrum teams … deliver a unified and standardised view of data across international operations — a key enabler for smarter, data-driven trading decisions.If you’re a data engineer with deep Azure and Databricks experience, and you enjoy solving complex challenges within a global business, this contract offers a chance to make a real impact on a high-profile initiative. Interested? Please apply now More ❯