101 to 125 of 178 Databricks Jobs in London

seeking a Databricks Implementation Consultant/Architect for an initial 4-6 weeks contract. The primary objective of this role is to assess and recommend the optimal cloud platform (Azure or Google Cloud Platform) for implementing Databricks. This will involve a detailed evaluation of both platforms against analytical requirements, cost … recommendation for senior stakeholders Role Overview You will lead a comprehensive Cloud & Data Platform Assessment focused on defining a future-ready architecture and positioning Databricks as the core analytics layer. This role requires deep expertise in Databricks implementations across Azure and Google Cloud Platform (GCP). Cloud & Data Platform Assessment ...

requires one day per week onsite. As a Data Architect you will be responsible for the following: Design & build high performing data solutions utilising Databricks Design & oversee delivery of secure data warehouses and datalakes Design & implement AI/ML Models Ensure data governance and security is managed Work with existing ...

scale. The environment looks a bit like this 👇 👉 Python (pandas, numpy, scipy, PySpark) 👉 SQL 👉 AWS or GCP (BigQuery/RedShift/Snowflake) 👉 Spark/Databricks 👉 Airflow/Dagster ...

across the data stack Ensure compliance with relevant regulations (e.g. GDPR) and ethical data use Own the Azure data platform, including Microsoft Fabric, Azure Databricks, Azure Data Lake Gen2, Azure Data Factory/Fabric Pipelines What we're looking for Proven experience in a senior data leadership role (Head ...

/C# and modern integration patterns Experience with CI/CD, monitoring tools, and DevOps practices Security and quality-first mindset Bonus Points: Azure Databricks, Data Platforms experience Enterprise system integration (Salesforce, SAP, Workday, ERP) Containerization (Docker, Kubernetes) Streaming technologies (Kafka, JMS) Why This Role? Challenging, high-impact work with ...

have a solid couple of years creating and delivering advanced analytical projects and advanced modelling techniques using Python & SQL. Bonus points for exposure to Databricks! You'll likely be someone adept at spinning multiple plates at once and experienced in taking project briefs in some capacity. A natural Data storyteller ...

structure and lead embedded data science teams, partnering effectively with senior stakeholders across multiple domains Hands-on technical expertise with tools such as Databricks, Python, Spark, and GCP/BigQuery Engineering mindset, with experience moving teams toward machine learning engineering best practices Credibility to lead long-tenured individual contributors while ...

/C# and modern integration patterns Experience with CI/CD, monitoring tools, and DevOps practices Security and quality-first mindset Bonus Points: Azure Databricks, Data Platforms experience Enterprise system integration (Salesforce, SAP, Workday, ERP) Containerization (Docker, Kubernetes) Streaming technologies (Kafka, JMS) Why This Role? Challenging, high-impact work with ...

RESPONSIBILITIES Design, build, and maintain scalable data pipelines and data integration workflows using Microsoft Azure services such as Data Factory, Synapse Analytics, Data Lake, Databricks, and related technologies. Implement and support Microsoft Fabric solutions, including dataflows, data warehouses, and real-time analytics features. Develop and maintain ETL/ELT processes … pipelines, architecture, and best practices. EXPECTATIONS IN THE ROLE Strong hands-on experience with Microsoft Azure data services (Data Factory, Synapse Analytics, Data Lake, Databricks). Direct experience delivering solutions using Microsoft Fabric. Advanced SQL skills and experience with data modelling, transformation, and integration. Familiarity with data governance, data quality ...

based data technologies. Role Overview As a Data Platform Engineer, you will design, build, and maintain scalable cloud-based data infrastructure using Azure and Databricks . Youll play a key role in ensuring that data pipelines, architecture, and analytics environments are reliable, performant, and secure. Key Responsibilities Platform Development & Maintenance … Design and implement data pipelines using Azure Data Factory , Databricks , and related Azure services. Build ETL/ELT processes to transform raw data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data ...

pipelines, architecture, and analytics environments are reliable, performant, and secure. Key Responsibilities Platform Development & Maintenance Design and implement data pipelines using Azure Data Factory, Databricks, and related Azure services. Build ETL/ELT processes to transform raw data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability … using Azure Data Lake Storage. Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake ...

central London, is undergoing an exciting data transformation programme as it invests in a new team charged with building and implementing a new Azure Databricks platform click apply for full job details ...

lineage, system of record and authority, master data and reference data. Good understanding of DAMA framework and content. Experience of Microsoft data technology stackand Databricks Understanding of defining data schemas and ETL/ELT solutions for the consumption, validation, and secure storage of data Understanding of regulatory obligations related ...

governance and security Experience working alongside architects and engineering teams to shape viable, scalable client solutions Familiarity with cloud and data ecosystems such as Databricks and/or Confluent Comfortable engaging with CTOs, Chief Architects and senior engineering stakeholders Other Attributes Executive‐level written and verbal communication skills Ability ...

including architecture, integration, governance and security Experience partnering with architects and engineering teams to shape scalable, technically sound solutions Familiarity with ecosystems such as Databricks and/or Confluent Comfortable engaging at senior technology and C‐suite level Personal Attributes Executive-level communication and stakeholder management skills Able to bridge ...

engines, evaluation frameworks, and simulators . 2. MLOps, Quality & Productionisation Design and implement robust CI/CD and MLOps pipelines using platforms such as Databricks, MLflow, Unity Catalog, Snowflake, and Azure ML. Establish model observability across performance, drift, cost controls, and operational reliability . Apply AIOps practices to enable automated … claims triage, and bordereaux . Ability to design AI solutions aligned to insurance performance and profitability metrics . Technical Environment Model Lifecycle & Governance MLflow, Databricks Model Serving, Unity Catalog Feature stores (Databricks Feature Store, Feast) Model monitoring and governance platforms Data Engineering Databricks Lakehouse, Spark Kafka/Confluent Delta Lake ...

Role Overview We are seeking an experienced Databricks Data Engineer to design and deliver cloud-based data integration and analytics solutions within our Insurance portfolio. This is a hands-on role focused on building scalable data pipelines, optimising performance, and applying best practices in data quality and governance within enterprise … into robust, production-ready data solutions. Insurance domain experience is beneficial but not essential. Key Responsibilities Design and deliver scalable data pipelines using Azure Databricks, Azure Data Factory, and Azure SQL Build and maintain ETL/ELT processes and data quality frameworks Develop consistent data models and analytics-ready datasets ...

Engineer: Design, build and maintain scalable and secure data pipelines on the Azure platform. Develop and deploy data ingestion processes using Azure Data Factory, Databricks (PySpark), and Azure Synapse Analytics. Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake (Gen2 … . Required Skills & Experience - Azure Data Engineer: Proven commercial experience as a Data Engineer delivering enterprise-scale solutions in Azure Azure Data Factory Azure Databricks (PySpark) SQL & Python Understanding of CI/CD in a data environment, ideally with tools like Azure DevOps. Experience working within consultancy or client-facing ...

Engineer: Design, build and maintain scalable and secure data pipelines on the Azure platform. Develop and deploy data ingestion processes using Azure Data Factory, Databricks (PySpark), and Azure Synapse Analytics. Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake (Gen2 … . Required Skills & Experience - Senior Data Engineer: Proven commercial experience as a Data Engineer delivering enterprise-scale solutions in Azure Azure Data Factory Azure Databricks (PySpark) SQL & Python Understanding of CI/CD in a data environment, ideally with tools like Azure DevOps. Experience working within consultancy or client-facing ...

Role Overview Role/Job title: Azure AI Architect Work Location: London, Tunbridge wells, Ipswich, Bolton Role type - Permanent/Fixed Term/Contracting: Contracting Mode of working Hybrid/office based: Hybrid If Hybrid ...

The Mission At FLOX, we believe smarter farms lead to thriving chickens and healthier lives. Our mission is simple: healthier chickens benefit everyone. That’s why we built FLOX360, a system that uses Computer Vision ...

routing, DNS, VPNs, and network security concepts is also essential. Practical experience of managing Azure Key Vault (network-restricted vaults, policies, integrations) & Azure Databricks (VNet injection, private endpoints, secure data access) is required for this role. You will ideally be a Microsoft Certified: Azure Solutions Architect. Please apply ASAP ...

wider regulatory, compliance environment for global insurance businesses (e.g. GDPR) Knowledge of Business Intelligence and Data platform technologies (e.g. Microsoft Fabric, Databricks etc.). Good knowledge of technology governance standards Good knowledge of technology best practice including SDLC Working knowledge of Enterprise and Solution Architecture frameworks and methodologies (e.g. TOGAF ...

wider regulatory, compliance environment for global insurance businesses (e.g. GDPR) Knowledge of Business Intelligence and Data platform technologies (e.g. Microsoft Fabric, Databricks etc.). Good knowledge of technology governance standards Good knowledge of technology best practice including SDLC Working knowledge of Enterprise and Solution Architecture frameworks and methodologies (e.g. TOGAF ...

central London, is undergoing an exciting data transformation programme as it invests in a new team charged with building and implementing a new Azure Databricks platform. Working five days a week in the central London office, you'll join this growing team and play a key role in building … skills in analytics engineering, responding to business and project needs rather than operating as a narrow silo. You'll work hands-on with Azure Databricks, Azure Data Factory, Delta Lake, and Power BI to create scalable data models, automated pipelines, and self-service analytics capabilities. This is a fantastic opportunity ...