26 to 50 of 53 Databricks Jobs in the City of London

data platform that will underpin some of the organisation’s most critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality … Work closely with architecture, analytics and business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

digital reporting over the next 6–9 months (major focus of the role) Extract and model digital data using SQL (GA4, BigQuery/Databricks) Build clear, reliable dashboards in Power BI or Tableau Support verification of Tag Manager setups and onboarding of new digital vendors (e.g., AppsFlyer, attribution tools) Help ...

TensorFlow - Experience training and serving models at scale (deep learning, LLMs, or classical ML) - Hands-on with cloud ML infrastructure (AWS Sagemaker, GCP Vertex, Databricks, or similar) - Strong software engineering fundamentals (testing, code review, system design) - Track record of shipping ML systems that delivered measurable business value What ...

Data Engineer with Insurance experience to play a key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long … work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built to scale, incorporating the latest advancements in data intelligence while supporting strategic business objectives. Key Responsibilities Build & Develop – Design ...

Data Engineer – Azure - Databricks/Fabric - Remote – up to £65,000 I’m currently supporting one of the UK's fastest-growing Microsoft data consultancies as they continue to scale their team. If you're a Data Engineer who wants to work on modern Azure projects, next‐gen lakehouse architectures … role, you’ll be central to designing and delivering modern data solutions for a range of clients: Architect and deliver scalable data solutions using Databricks, Synapse, and Microsoft Fabric Build and optimise ETL/ELT pipelines and high-quality data models using SQL & Python Develop Power BI dashboards that support ...

advanced data platforms that support financial institutions in tackling fraud and financial crime. In this role, you will help design and evolve a modern Databricks + AWS lakehouse architecture , enabling analytics, machine learning, and investigative teams to generate actionable insights from large-scale datasets. This is a hands-on leadership … maintain secure AWS-based data infrastructure (S3, IAM, KMS, Glue, Lake Formation, Lambda, Step Functions, CloudWatch, etc.) Implement orchestration using tools such as Airflow, Databricks Workflows, and Step Functions Champion data quality, observability, and reliability (SLAs, monitoring, alerting, reconciliation) Drive CI/CD best practices for data platforms (infrastructure ...

advanced data platforms that support financial institutions in tackling fraud and financial crime. In this role, you will help design and evolve a modern Databricks + AWS lakehouse architecture , enabling analytics, machine learning, and investigative teams to generate actionable insights from large-scale datasets. This is a hands-on leadership … maintain secure AWS-based data infrastructure (S3, IAM, KMS, Glue, Lake Formation, Lambda, Step Functions, CloudWatch, etc.) Implement orchestration using tools such as Airflow, Databricks Workflows, and Step Functions Champion data quality, observability, and reliability (SLAs, monitoring, alerting, reconciliation) Drive CI/CD best practices for data platforms (infrastructure ...

capability. Powered by 600+ AI experts serving 50+ enterprise clients from 5 global locations, we work side-by-side with top partners - including Anthropic, Databricks, AWS, OpenAI, and Microsoft - to deliver modern AI with speed and measurable impact. The Opportunity We are seeking an experienced Client Director/Sales Director ...

best practices Optimise report performance through efficient queries and data modelling Integrate Power BI with cloud and on premise data platforms such as Azure Databricks Fabric Enable self service analytics through well structured datasets Provide guidance and mentoring to junior developers What We Are Looking For Strong hands-on experience … working with large datasets Experience with Power BI Gateways and deployment pipelines Knowledge of data security governance and RLS Exposure to Azure Databricks Microsoft Fabric or similar technologies Strong analytical thinking and stakeholder communication skills Nice to Have Experience in Finance Risk or Regulatory reporting environments Exposure to broader Power ...

Digital Data Senior Manager, Data Governance, Data Architecture, Data Engineering, Azure, Fabric, Databricks, London, Hybrid Digital Data Consultant required to work for a highly ambitious and fast-growing Consulting function, based in London on a hybrid basis. The expectation is to be in the office circa two days per week ...

improve efficiency and introduce AI-driven workflows Are highly proficient in PostgreSQL and at least one major data platform (e.g., Snowflake, BigQuery, Databricks, Firebolt) Experience with Node.js and TypeScript is a plus Thrive in fast-paced startup environments and feel energized by ambiguity Move quickly and constantly look for ways ...

L. Ideal Background: This role is ideal for engineers who have worked at the frontier of AI — at companies like OpenAI, NVIDIA, Databricks, Palantir, Snowflake, or similar organizations pushing the boundaries of intelligent systems. We especially welcome graduates from leading programs such as Harvard, Columbia, Princeton, Yale, University of Pennsylvania ...

Databricks Data Engineer – Hybrid (London) – Azure Data Services – Lloyd’s Market -Enterprise Data Platforms – up to £95,000 If you’re looking for a role where your work has impact, this is a great opportunity. You’ll be joining an organisation working with some of the most complex data challenges … help build large‐scale cloud data platforms, modernise critical data flows, and play a meaningful role in shaping long‐term Azure and Databricks strategy. The business invests heavily in wellbeing and development, offering mental‐health support and access to extensive training resources and certifications. If you enjoy solving real technical ...

between data engineering and security/IAM teams . What youll be doing Build and maintain ETL/ELT pipelines using Azure Data Factory, Databricks and SQL Server Develop and support data models, reporting layers and curated datasets for IAM/access related use cases Work with data linked … agile environment What we need Strong experience as a Data Engineer in Azure environments Strong hands-on experience with: Azure Data Factory Databricks/PySpark SQL Server/T-SQL Experience building production-grade data pipelines and data models Exposure to identity/access/security data Understanding of areas ...

lakehouse, models its core data, and shapes best practice for years to come. If you enjoy ownership, influence, and hands-on technical work across Databricks, data modelling, and pipeline development, this role offers genuine impact and long-term career growth. The Company They are investing heavily in their data capabilities … decision making across the business. The data team is still in its early stages, giving you the chance to help shape standards, strengthen their Databricks environment, and unlock more value from their growing data estate. Collaboration is central to how they work, with strong relationships across Technology, Finance, Operations ...

Digital Data Director/Consultant, Data Architecture, Data Engineering, Azure, Fabric, Databricks, London, Hybrid Digital Data Director/Consultant required to work for a highly ambitious and fast-growing Consulting function, based in London on a hybrid basis. The expectation is to be in the office circa two days ...

building and supporting secure, scalable internal engineering platforms. This is not a standard data engineer role. The work sits across Azure platform engineering, Databricks, Terraform, CI/CD, governance, identity, and secure access environments click apply for full job details ...

enable our next phase of success. Job Overview As a Senior Data Engineer , you will be developing our configuration-driven data platform in Databricks, enabling non-engineers to define regulatory logic, and our Snowflake data warehouse, ensuring scalability, auditability, and fitness for client-facing regulatory use cases. … mentorship to your colleagues. You’ll join at a pivotal stage as we modernize our data infrastructure, migrating from Python scripts and MySQL to Databricks and Snowflake. Our systems power regulatory reporting for major financial institutions, requiring precision, traceability, and reliability. What You'll Do Design and evolve our configuration ...

architecture. * Work within clients existing security framework to establish compliant connectivity to operational data sources. * Build and maintain Silver and Gold layer transformations in Databricks using Python and SQL. * Onboard datasets into Unity Catalog, ensuring proper governance, lineage, and discoverability. Platform Collaboration & Delivery * Support the ML/Data Scientist … clean, structured datasets for anomaly detection and asset performance modelling. * Contribute to technical documentation and ensure pipelines are maintainable and transferable. * Stay current on Databricks and Azure platform developments relevant to the stack. * Support the Digital & AI Strategy Manager in assessing feasibility of new data source integrations as the roadmap ...

build scalable cloud-based data platforms using Medallion Architecture (Bronze/Silver/Gold) Engineer pipelines using Python and PySpark on platforms such as Databricks Ingest and integrate data from multiple sources including policy, claims, broker, and third‐party systems Contribute to CI/CD pipelines and modern DevOps delivery … business stakeholders Required Experience Strong experience as a Senior Data Engineer within Insurance, ideally the London Market Proven hands-on expertise in: Python & PySpark Databricks Cloud platforms (Azure, AWS, or GCP) Solid understanding of Medallion Architecture and analytics-focused data modelling Strong domain knowledge across: Lloyd’s Syndicates Delegated Authority ...

Data Integration Analyst (Azure/Databricks) Hybrid – Central London | £43,000 pro rata | ⏳ up to 6-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed … Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business decision-making. Develop and maintain data tables and integrations within Azure Databricks and the Unity Catalog to enable self-serve data access. Define and deliver process maps for transferring data ingestion from internal teams to offshore partners. ...

Cross-Group Data Model. Act as the internal consultant for report makers across the business. Implement and own the Data Catalogue using Databricks Unity. Act as the direct Line Manager for Data Analysts. Map the "As-Is" data flows. Key Requirements: 5–8 years of experience in data modelling … data architecture, including at least 3 years in a leadership role. Strong Dimensional Modelling skills (Kimball). Solid experience with Databricks Unity Catalog and Microsoft Fabric/Purview. Advanced Power BI (DAX/modelling) and Excel capability to effectively support report creators. Proven ability to build a semantic layer from ...

Senior Data Engineer - Python/Databricks/GCP/MLOps Location: London Contract: Outside IR35 Day Rate: Negotiable ~ £600-£700 DW Search are partnering on a high-impact contract opportunity within a fast-paced, data-driven environment supporting portfolio company initiatives for a major asset management firm. This role sits … optimise model performance and reliability Contribute to best practices across MLOps and pipeline orchestration Required Experience Strong Python fluency Strong hands-on experience with Databricks Proven experience building production-grade data and ML pipelines Solid understanding of MLOps principles Experience working with machine learning models Experience with GCP Background ...

coach role at a pivotal moment. The business is mid-transformation, moving from a legacy environment to a modern, cloud-native platform built on Databricks and Azure. You'll define the architecture, drive execution, build the team, and set the technical culture from the ground up. … fixed fast. Responsibilities as a Senior Data Engineer: Define the directional architecture for the new data estate, including Lakehouse, Medallion and Eventing patterns on Databricks and Azure Lead discovery of the legacy estate: identify what to kill, what to keep, and how to migrate without breaking continuity Line manage, hire ...

data estate, defining the patterns and blueprints that will shape our platform for years to come. Make key decisions on how we utilise Databricks and Azure, including Lakehouse, Medallion and Eventing design patterns. Own the discovery and assessment of our legacy estate, determining what to migrate, modernise or decommission. Manage … years in data engineering or hands-on data architecture, with at least 3 years in a leadership position. Expert level proficiency in Databricks, Azure and SQL/Python, with GCP and BigQuery experience highly desirable. A proven track record of refactoring legacy data estates and migrating them to modern platforms ...