51 to 75 of 91 Databricks Jobs in London

experience with vector databases and semantic search pipeline design. Experience with Model Context Protocol (MCP). Experience with large-scale data platforms such as Databricks and search engines such as Elasticsearch, in an analytical or AI feature engineering context. Demonstrated ability to design enterprise-grade AI systems with strong ...

Senior Databricks Solutions Architect | Contract | £800£900 per day | Inside IR35 4 days per week onsite Were looking for a hands-on Senior Databricks Solutions Architect to support a complex, high-performance data platform within a global organisation. Youll design and optimise Spark workloads, build production streaming pipelines and deliver … scalable Databricks solutions using Delta Live Tables, Workflows, Unity Catalog, Python, PySpark, Terraform and Databricks Asset Bundles. Key requirements: Advanced Apache Spark and Spark SQL optimisation Production Spark Structured Streaming experience Deep Databricks platform knowledge Strong Python and PySpark engineering capability Delta Live Tables, Workflows and Unity Catalog Terraform ...

modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse, and Logic Apps. You'll work across the full data lifecycle - from ingestion to transformation and delivery - enabling smarter, faster insights. Key Responsibilities: - Develop … agile environment. Collaboration With: - Data Engineers, Architects, Product Owners, Test Analysts, and BI Teams. Skills & Experience: - Proficiency in Azure tools (Data Factory, Databricks, Synapse, etc.). - Strong SQL and experience with data warehousing (Kimball methodology). - Programming skills in Python, Scala, or PySpark. - Familiarity with Power BI, SharePoint, and data ...

support business decision-making across Financial Advice Services, Marketing, Operations, Risk, and other key business functions. Operating in a modern cloud-based environment leveraging Databricks, AWS, and Infrastructure as Code, the successful candidate will lead a team of data engineers while partnering closely with Product Managers, Data Analysts, Architects … takes Must-Have Skills & Experience Deep expertise designing and building scalable data pipelines and data products in cloud environments Strong hands-on experience with Databricks, Spark, SQL, and Python Experience developing and optimizing batch and real-time data processing solutions Strong understanding of modern data architecture patterns, including Kimball, Data ...

support business decision-making across Financial Advice Services, Marketing, Operations, Risk, and other key business functions. Operating in a modern cloud-based environment leveraging Databricks, AWS, and Infrastructure as Code, the successful candidate will lead a team of data engineers while partnering closely with Product Managers, Data Analysts, Architects … takes Must-Have Skills & Experience Deep expertise designing and building scalable data pipelines and data products in cloud environments Strong hands-on experience with Databricks, Spark, SQL, and Python Experience developing and optimizing batch and real-time data processing solutions Strong understanding of modern data architecture patterns, including Kimball, Data ...

support business decision-making across Financial Advice Services, Marketing, Operations, Risk, and other key business functions. Operating in a modern cloud-based environment leveraging Databricks, AWS, and Infrastructure as Code, the successful candidate will lead a team of data engineers while partnering closely with Product Managers, Data Analysts, Architects … takes Must-Have Skills & Experience Deep expertise designing and building scalable data pipelines and data products in cloud environments Strong hands-on experience with Databricks, Spark, SQL, and Python Experience developing and optimizing batch and real-time data processing solutions Strong understanding of modern data architecture patterns, including Kimball, Data ...

Data Architect (Azure) Databricks + Purview Outside IR35 Remote based, occasional London trips Rate: market rates, outside IR35 Location: Remote, UK. Occasional London attendance Duration: 6 months initial, likely extension Start: Within 2 weeks Databricks Data Architect required for a greenfield Azure data platform build. There is no legacy estate … down the stack as the conversation needs. Responsibilities Own the target data architecture, from conceptual through logical to physical design Design the Databricks Lakehouse, including medallion layers, workspace and environment structure, and cost and performance patterns Define the governance, lineage and cataloguing approach using Unity Catalog and Microsoft Purview Produce ...

support the following systems and processes: Azure Application Services Gamma Routers DCC physical and virtual gateway connections Database storage and SQL databases Azure Databricks storage Hardware Security Modules (HSM), including code changes and upgrades Siemens EnergyIP Data cleansing activities Database backup and retention policies Oracle databases Skills and Experience Required ...

aligned with responsible AI practices. Skills and Experience Strong experience delivering Data, AI, Machine Learning and Generative AI solutions Hands-on experience with Databricks Strong experience with Microsoft Foundry and the wider Azure ecosystem Experience leading and mentoring AI or engineering teams Experience designing and delivering scalable, production-ready ...

with monitoring and observability tools (Grafana, Splunk) and diagnostics platforms (New Relic, Dynatrace). Understanding of containerisation technologies (Docker, Kubernetes) and big data platforms (Databricks). Ability to analyse complex performance issues and provide actionable recommendations. Strong scripting skills (e.g., Python, JavaScript) for test automation and data analysis. Knowledge ...

Data Science Engineer Up to £90,000+ Benefits London (Hybrid) This is a great opportunity to join a newly established R&D function within a global organisation, where you can take ownership of building the ...

modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse, and Logic Apps. You'll work across the full data lifecycle - from ingestion to transformation and delivery - enabling smarter, faster click apply for full ...

Essential Skills Strong commercial Data Science experience Proven background delivering segmentation and clustering projects Hands-on propensity modelling experience Advanced Python Experience working in Databricks and/or Microsoft Fabric Experience developing models within notebook environments Ability to quickly understand business problems and deliver at pace Insurance sector experience Highly ...

junior engineers and progress into technical architecture or leadership roles. Key Responsibilities Design, develop and maintain data pipelines using Azure Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly … technical best practices. About You You'll have: Strong experience with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills ...

junior engineers and progress into technical architecture or leadership roles. Key Responsibilities Design, develop and maintain data pipelines using Azure Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly … technical best practices. About You You'll have: Strong experience with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills ...

junior engineers and progress into technical architecture or leadership roles. Key Responsibilities Design, develop and maintain data pipelines using Azure Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly … technical best practices. About You You'll have: Strong experience with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills ...

Partner with Finance and business stakeholders to validate methodologies and ensure value estimates are reproducible and operationalised. Build scalable analytical solutions and pipelines using Databricks, Spark, and Python. Establish strong data validation, audit, and reconciliation practices to support decision-making. Required Skills Advanced SQL for large-scale customer, loyalty, payment … transaction analysis. Strong Python skills for statistical modelling, cohort analysis, weighting, matching, and reproducible analytics. Hands-on experience with Databricks, Spark/PySpark, Delta tables, and automated data workflows. Proficiency with Git, Azure DevOps, and controlled production release processes. Strong data quality, reconciliation, and audit-trail practices. Desirable Skills Experience ...

product and when a simpler analytical or process solution is more appropriate. Personally build working proofs of concept using tools such as SQL, Python, Databricks, Power BI, AI tooling, and appropriate low-code platforms. Explore and profile data to understand quality, coverage, structure, limitations, and suitability for the intended … problems and converting them into practical, evidence-based solutions. Hands-on ability to interrogate data and build working prototypes using several of SQL, Python, Databricks, Power BI, AI tooling, or low-code tools. Commercial insurance, insurance broking, specialty insurance, claims, placement, portfolio analytics, or underwriting experience. Experience with data mesh ...

Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse. The role will focus on common IDs, Golden Records, entity resolution … Design and implement MDM solutions , including common IDs, Golden Records, entity matching, deduplication, and survivorship rules. Integrate data from multiple source systems into the Databricks Lakehouse . Develop and optimize data pipelines using Databricks, PySpark, SQL, and Delta Lake . Build and enhance Bronze, Silver, and Gold data layers. Implement ...

/or industry environment Technical Skills You'll have experience with some of the following: Cloud & Data Platforms: AWS, Azure, Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held … GenAI Consultant, AI Engineer, Applied Data Scientist, Analytics Consultant, ML Engineer, Data & AI Consultant, Advanced Analytics Consultant, NLP Specialist, Python Developer, AI Transformation Consultant, Databricks Consultant, Azure AI Consultant, AWS Data Scientist, GCP Data Consultant, Agentic AI Consultant, OpenAI GPT Specialist, PySpark Developer. Deerfoot Recruitment Solutions Ltd is a leading ...

combine priority internal and external data sources, understanding quality, permissions and fitness for use. Design, build and operate reliable pipelines in Microsoft Fabric and Databricks to ingest, clean, standardise, enrich, version and publish structured, semi-structured and unstructured data as reusable data assets. Create scalable lakehouse data models, schemas, data … clients, organisations, people, matters, sectors, jurisdictions, opportunities and legal topics. Implement data-quality checks, lineage, provenance, observability, monitoring and change management within Fabric and Databricks workflows so data assets remain trusted over time. Conduct exploratory data analysis to surface patterns, gaps, anomalies and data-quality issues, and identify opportunities ...

Opportunity As a Lead Data Analyst, you'll help shape the technical direction of analytics and AI solutions, working across Microsoft Fabric, Azure Databricks, and Power BI. You'll partner with analytics teams, data engineers, platform engineers and business stakeholders to design scalable analytics solutions and AI-ready data architectures. … Strong experience designing and delivering enterprise-scale analytics solutions Excellent SQL skills Strong experience with Power BI Experience working with Microsoft Fabric and Azure Databricks Strong knowledge of dimensional modelling, semantic models and analytics data architecture Experience establishing analytics standards, best practices and reusable technical patterns Ability to combine strategic ...

Strong understanding of Generative AI, Agentic AI, Machine Learning and Data Analytics. Experience working with enterprise data platforms and modern analytics environments. Knowledge of Databricks, Data Lakehouse and cloud-based data platforms. Experience delivering AI-driven products and solutions within large organisations. Strong stakeholder management, facilitation and communication skills. Experience … Strong understanding of Agile delivery methodologies and product management practices. Desirable Skills Experience with Microsoft Copilot, GitHub Copilot and Azure AI Foundry. Knowledge of Databricks Mosaic AI and MLflow. Experience delivering RAG, AI Agent and Knowledge Assistant solutions. Background in Management Consulting or Digital Transformation. Experience working across Data Engineering ...

products using advanced analytics and machine learning Developing predictive models and analytical solutions to support business objectives Building prototypes and proof-of-concepts using Databricks and modern data platforms Translating business requirements into technical product specifications Designing data structures, feature sets, scoring methodologies, and model outputs Evaluating emerging AI technologies … products Ability to work with large-scale transactional, behavioural, or marketing datasets Understanding of data modelling, feature engineering, and analytical best practices Experience using Databricks or similar modern analytics platforms Knowledge of cloud-based data environments, ideally within Azure ecosystems Strong communication skills with the ability to explain technical concepts ...

Data Product Analyst/Manager - Adoption & Enablement 6-Month Contract | Inside IR35 | Hybrid (2 Days per Week, London) We're partnering with a Leading Global Insurer looking for a Data Product Analyst/Manager to ...