26 to 50 of 60 Databricks Jobs in Central London

data consumption and querying throughAPI logictoclient-facing UI(minimal handoffs, high autonomy). Self-source the data you needby navigating our data platform (e.g., Databricks/lakehouse patterns), writing SQL, and understanding upstream structures and quality. Build and operatescalable, secure pipelines and curated data layersthat power risk analytics and insurance ...

data platform that will underpin some of the organisation’s most critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality … Work closely with architecture, analytics and business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

digital reporting over the next 6–9 months (major focus of the role) Extract and model digital data using SQL (GA4, BigQuery/Databricks) Build clear, reliable dashboards in Power BI or Tableau Support verification of Tag Manager setups and onboarding of new digital vendors (e.g., AppsFlyer, attribution tools) Help ...

TensorFlow - Experience training and serving models at scale (deep learning, LLMs, or classical ML) - Hands-on with cloud ML infrastructure (AWS Sagemaker, GCP Vertex, Databricks, or similar) - Strong software engineering fundamentals (testing, code review, system design) - Track record of shipping ML systems that delivered measurable business value What ...

Data Engineer with Insurance experience to play a key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long … work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built to scale, incorporating the latest advancements in data intelligence while supporting strategic business objectives. Key Responsibilities Build & Develop – Design ...

Data Engineer – Azure - Databricks/Fabric - Remote – up to £65,000 I’m currently supporting one of the UK's fastest-growing Microsoft data consultancies as they continue to scale their team. If you're a Data Engineer who wants to work on modern Azure projects, next‐gen lakehouse architectures … role, you’ll be central to designing and delivering modern data solutions for a range of clients: Architect and deliver scalable data solutions using Databricks, Synapse, and Microsoft Fabric Build and optimise ETL/ELT pipelines and high-quality data models using SQL & Python Develop Power BI dashboards that support ...

advanced data platforms that support financial institutions in tackling fraud and financial crime. In this role, you will help design and evolve a modern Databricks + AWS lakehouse architecture , enabling analytics, machine learning, and investigative teams to generate actionable insights from large-scale datasets. This is a hands-on leadership … maintain secure AWS-based data infrastructure (S3, IAM, KMS, Glue, Lake Formation, Lambda, Step Functions, CloudWatch, etc.) Implement orchestration using tools such as Airflow, Databricks Workflows, and Step Functions Champion data quality, observability, and reliability (SLAs, monitoring, alerting, reconciliation) Drive CI/CD best practices for data platforms (infrastructure ...

advanced data platforms that support financial institutions in tackling fraud and financial crime. In this role, you will help design and evolve a modern Databricks + AWS lakehouse architecture , enabling analytics, machine learning, and investigative teams to generate actionable insights from large-scale datasets. This is a hands-on leadership … maintain secure AWS-based data infrastructure (S3, IAM, KMS, Glue, Lake Formation, Lambda, Step Functions, CloudWatch, etc.) Implement orchestration using tools such as Airflow, Databricks Workflows, and Step Functions Champion data quality, observability, and reliability (SLAs, monitoring, alerting, reconciliation) Drive CI/CD best practices for data platforms (infrastructure ...

capability. Powered by 600+ AI experts serving 50+ enterprise clients from 5 global locations, we work side-by-side with top partners - including Anthropic, Databricks, AWS, OpenAI, and Microsoft - to deliver modern AI with speed and measurable impact. The Opportunity We are seeking an experienced Client Director/Sales Director ...

L. Ideal Background: This role is ideal for engineers who have worked at the frontier of AI — at companies like OpenAI, NVIDIA, Databricks, Palantir, Snowflake, or similar organizations pushing the boundaries of intelligent systems. We especially welcome graduates from top computer science programs such as Stanford, MIT, Carnegie Mellon ...

best practices Optimise report performance through efficient queries and data modelling Integrate Power BI with cloud and on premise data platforms such as Azure Databricks Fabric Enable self service analytics through well structured datasets Provide guidance and mentoring to junior developers What We Are Looking For Strong hands-on experience … working with large datasets Experience with Power BI Gateways and deployment pipelines Knowledge of data security governance and RLS Exposure to Azure Databricks Microsoft Fabric or similar technologies Strong analytical thinking and stakeholder communication skills Nice to Have Experience in Finance Risk or Regulatory reporting environments Exposure to broader Power ...

Digital Data Senior Manager, Data Governance, Data Architecture, Data Engineering, Azure, Fabric, Databricks, London, Hybrid Digital Data Consultant required to work for a highly ambitious and fast-growing Consulting function, based in London on a hybrid basis. The expectation is to be in the office circa two days per week ...

improve efficiency and introduce AI-driven workflows Are highly proficient in PostgreSQL and at least one major data platform (e.g., Snowflake, BigQuery, Databricks, Firebolt) Experience with Node.js and TypeScript is a plus Thrive in fast-paced startup environments and feel energized by ambiguity Move quickly and constantly look for ways ...

L. Ideal Background: This role is ideal for engineers who have worked at the frontier of AI — at companies like OpenAI, NVIDIA, Databricks, Palantir, Snowflake, or similar organizations pushing the boundaries of intelligent systems. We especially welcome graduates from leading programs such as Harvard, Columbia, Princeton, Yale, University of Pennsylvania ...

Databricks Data Engineer – Hybrid (London) – Azure Data Services – Lloyd’s Market -Enterprise Data Platforms – up to £95,000 If you’re looking for a role where your work has impact, this is a great opportunity. You’ll be joining an organisation working with some of the most complex data challenges … help build large‐scale cloud data platforms, modernise critical data flows, and play a meaningful role in shaping long‐term Azure and Databricks strategy. The business invests heavily in wellbeing and development, offering mental‐health support and access to extensive training resources and certifications. If you enjoy solving real technical ...

between data engineering and security/IAM teams . What youll be doing Build and maintain ETL/ELT pipelines using Azure Data Factory, Databricks and SQL Server Develop and support data models, reporting layers and curated datasets for IAM/access related use cases Work with data linked … agile environment What we need Strong experience as a Data Engineer in Azure environments Strong hands-on experience with: Azure Data Factory Databricks/PySpark SQL Server/T-SQL Experience building production-grade data pipelines and data models Exposure to identity/access/security data Understanding of areas ...

lakehouse, models its core data, and shapes best practice for years to come. If you enjoy ownership, influence, and hands-on technical work across Databricks, data modelling, and pipeline development, this role offers genuine impact and long-term career growth. The Company They are investing heavily in their data capabilities … decision making across the business. The data team is still in its early stages, giving you the chance to help shape standards, strengthen their Databricks environment, and unlock more value from their growing data estate. Collaboration is central to how they work, with strong relationships across Technology, Finance, Operations ...

Digital Data Director/Consultant, Data Architecture, Data Engineering, Azure, Fabric, Databricks, London, Hybrid Digital Data Director/Consultant required to work for a highly ambitious and fast-growing Consulting function, based in London on a hybrid basis. The expectation is to be in the office circa two days ...

building and supporting secure, scalable internal engineering platforms. This is not a standard data engineer role. The work sits across Azure platform engineering, Databricks, Terraform, CI/CD, governance, identity, and secure access environments click apply for full job details ...

enable our next phase of success. Job Overview As a Senior Data Engineer , you will be developing our configuration-driven data platform in Databricks, enabling non-engineers to define regulatory logic, and our Snowflake data warehouse, ensuring scalability, auditability, and fitness for client-facing regulatory use cases. … mentorship to your colleagues. You’ll join at a pivotal stage as we modernize our data infrastructure, migrating from Python scripts and MySQL to Databricks and Snowflake. Our systems power regulatory reporting for major financial institutions, requiring precision, traceability, and reliability. What You'll Do Design and evolve our configuration ...

data systems while mentoring others and raising engineering standards. The Role You will design, build, and optimise scalable data pipelines and models across Snowflake, Databricks, and cloud environments (AWS/GCP). Working closely with Data Science, Product, and Analytics teams, youll ensure reliable, high-performance data flows that power … near shore partners as well as contribute to architectural direction and best practices. Key Responsibilities Design and maintain scalable data architectures across Snowflake and Databricks Lead schema design, dimensional modelling, and SQL performance optimisation Build robust ETL/ELT pipelines Develop resilient API ingestion workflows Implement data quality frameworks ...

Digital Data Senior Manager, Data Governance, Data Architecture, Data Engineering, Azure, Fabric, Databricks, London, Hybrid Digital Data Consultant required to work for a highly ambitious and fast-growing Consulting function, based in London on a hybrid basis. The expectation is to be in the office circa two days per week … with cloud technologies such as Microsoft Azure Good grounding in programming and data engineering languages and frameworks such as Python, SQL, Microsoft Fabric and Databricks Certifications in relevant cloud and data technologies (Azure etc.) would be beneficial Excellent communication skills and the ability to inspire confidence in both technical ...

architecture. * Work within clients existing security framework to establish compliant connectivity to operational data sources. * Build and maintain Silver and Gold layer transformations in Databricks using Python and SQL. * Onboard datasets into Unity Catalog, ensuring proper governance, lineage, and discoverability. Platform Collaboration & Delivery * Support the ML/Data Scientist … clean, structured datasets for anomaly detection and asset performance modelling. * Contribute to technical documentation and ensure pipelines are maintainable and transferable. * Stay current on Databricks and Azure platform developments relevant to the stack. * Support the Digital & AI Strategy Manager in assessing feasibility of new data source integrations as the roadmap ...

build scalable cloud-based data platforms using Medallion Architecture (Bronze/Silver/Gold) Engineer pipelines using Python and PySpark on platforms such as Databricks Ingest and integrate data from multiple sources including policy, claims, broker, and third‐party systems Contribute to CI/CD pipelines and modern DevOps delivery … business stakeholders Required Experience Strong experience as a Senior Data Engineer within Insurance, ideally the London Market Proven hands-on expertise in: Python & PySpark Databricks Cloud platforms (Azure, AWS, or GCP) Solid understanding of Medallion Architecture and analytics-focused data modelling Strong domain knowledge across: Lloyd’s Syndicates Delegated Authority ...

Digital Data Director/Consultant, Data Architecture, Data Engineering, Azure, Fabric, Databricks, London, Hybrid Digital Data Director/Consultant required to work for a highly ambitious and fast-growing Consulting function, based in London on a hybrid basis. The expectation is to be in the office circa two days … with cloud technologies such as Microsoft Azure Good grounding in programming and data engineering languages and frameworks such as Python, SQL, Microsoft Fabric and Databricks Certifications in relevant cloud and data technologies (Azure etc.) would be beneficial Excellent communication skills and the ability to inspire confidence in both technical ...