51 to 75 of 201 Databricks Jobs in London

scale; orchestration with Airflow, Prefect, or equivalent; reliability-first mindset including backfill, retry, and exactly-once semantics * Azure data platform - Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage; infrastructure as code for data workloads (Terraform or Bicep) * Databricks - Delta Lake, Unity Catalog, job cluster vs interactive … Refinitiv), tick data, trade history, reference data, or instrument master management * Apache Spark or Flink for large-scale stream and batch processing beyond the Databricks ecosystem * dbt or equivalent SQL transformation layer; experience building and maintaining dbt projects in a production data warehouse * Event streaming with Kafka or Confluent Platform ...

Senior Data Engineer – Databricks Location: Remote UK or office based (opportunity to work remotely or be office based depending on your preference) Salary: £50k - £64k plus benefits Type: Full-Time ARCA Resourcing is proud to be partnered with an innovative leading retailer that’s transforming how data powers decision-making. … Senior Data Engineer, you will drive the design and implementation of robust, high-performance data solutions. You will work hands on with Databricks to deliver industrialised pipelines and data science model feeds. You will also mentor junior engineers, champion best practices, and ensure technical excellence across all deliveries. What ...

Manchester (Hybrid, weekly - expenses are covered) Salary: £45,000 – £95,000 - dependent on level/experience (mid, senior, principle) Security Clearance: SC active Requirements: Databricks and Spark/PySpark (absolute must haves) Azure and AWS experience Data warehouses/lakehouse platforms CI/CD and modern engineering practices Public sector ...

NoSQL experience (e.g., Cosmos DB/MongoDB/DynamoDB): data modelling and operational tuning Modern analytics/lakehouse concepts (e.g., Fabric/Synapse/Databricks), pipelines, and semantic models Backup/restore, high availability, and disaster recovery (design, testing, and execution) SQL replication experience (including migration to AVG) Monitoring, diagnostics ...

full ML lifecycle Working knowledge of GitHub, including version control and CI/CD practices Experience with cloud platforms such as Azure, AWS or Databricks Strong communication skills with the ability to explain complex concepts to non-technical stakeholders ...

solutions What you bring: Deep experience with Microsoft Azure , particularly around data services Proven track record delivering with tools such as Fabric , Synapse , or Databricks Proficiency in SQL, Python, and modern data engineering patterns Leadership experience within engineering or delivery teams A consultancy mindset - adaptable, curious, and client focused Location ...

data quality practices, as well as experience working within financial markets or a similar data-intensive environment. Exposure to modern data platforms (e.g. Databricks) is highly desirable. To secure the most relevant hire, my client is prepared to offer highly competitive compensation with market-leading bonuses, alongside excellent benefits ...

Hands‐on experience writing PySpark in a Lakehouse or big data environment Strong SQL skills for building and maintaining transformation logic Experience working with Databricks or similar modern data platforms An engineering mindset with attention to data quality, reliability and maintainability Comfortable working with both technical teams and business stakeholders ...

capability, including dimensional and semantic modelling Strong PySpark development experience within a Lakehouse environment Advanced SQL skills for complex transformations Hands-on experience with Databricks, including pipelines and governance tooling A strong engineering mindset, with a focus on reliability, testing and maintainability Proven ability to mentor others and provide technical ...

curation layers Data access and productisation Ability to design for large-scale datasets. Experience supporting cloud migrations Knowledge and experience with Azure & Microsoft Fabric & Databricks would be beneficial Familiarity with event-driven and streaming-first architectures at scale. Strong stakeholder engagement and cross-team collaboration skills. Ability to operate effectively ...

manipulation Ability to work with complex, multi-source datasets Desirable: Exposure to AI tooling or applied data science techniques Experience with Snowflake Experience with Databricks (Not essential) Candidate Profile Strong Python engineer with a data-focused background Comfortable working in greenfield/build-from-scratch environments Strong stakeholder management ...

frameworks, data management principles, and data quality best practices Experience working with modern data architectures and cloud-based data platforms (e.g. AWS, Azure, Snowflake, Databricks) Background working across data, analytics, BI, or data engineering teams within transformation programmes Why apply? Opportunity to lead a high-impact data transformation within ...

implementation of data architecture and data engineering frameworks across ingestion, data layers, semantic layers, and consumption. • Own policies and standards for data platforms, including Databricks, integration, data management, and access controls. • Ensure platforms are designed for performance, scalability, reliability, and security. Data Governance, Quality & Compliance • Implement frameworks for data quality ...

products Strong experience with cloud-based data ecosystems (GCP Preferred) Hands on knowledge of tools such as BigQuery, Dataflow, Pub/Sub Experience with Databricks and/or Snowflake Strong understanding of modern data architectures (e.g. Data Mesh, event-driven systems, APIs) Experience working in Agile delivery environments with backlog ...

Kubernetes is a plus. Experience designing end to end ML data pipelines. Experience with database technologies such as PostgreSQL, MySQL, or MongoDB, Spark, Databricks and stream data processing such as Kafka, RedPanda is a plus. Direct experience in building and applying large-scale (100M+ users) machine learning solutions for personalizing ...

biomarker discovery, or trial optimization.* Experience with agentic AI or LLM orchestration in Life Sciences.* Familiarity with platforms such as AWS, Azure ML, Databricks, foundation‐model platforms (e.g., ChatGPT, Claude), or modern code/AI tooling.## ## ## **What We’re Looking For*** **Polymath mindset:** Ability to combine strategy, technical ...

. Build and optimize batch and real-time data pipelines across underwriting, pricing, claims, reinsurance, and bordereaux data. Develop scalable solutions using Python, PySpark, Databricks, and/or Snowflake . Integrate data from policy administration systems, claims platforms, broker systems, third-party providers, and market feeds. Ensure strong data quality … Insurance , ideally within the London Market ecosystem. Deep knowledge of underwriting, claims, delegated authority, pricing, and reinsurance. Hands-on expertise in Python, PySpark, Databricks, Snowflake, SQL . Experience with Azure, AWS, or GCP . Strong understanding of batch/streaming pipelines and data modelling. Familiarity with DevOps practices, CI/ ...

Azure Databricks Engineer About the Role We are seeking a Azure Databricks Engineer to join a specialist consultancy focused on transforming enterprises through modern cloud data platforms, advanced analytics and next-generation engineering capabilities. This role requires strong experience working within the Lloyd's of London or wider London Market … engineering best practice and guide delivery across cross-functional teams. Responsibilities Build and optimise Azure data platforms using ADF, Data Lake, Azure Functions and Databricks Deliver reliable, high-quality data pipelines Work with stakeholders to ensure solutions meet Lloyd's of London regulatory, audit and data governance requirements Work with ...

About The Role FDM is a global business and technology consultancy seeking a Microsoft BI Stack Developer to design, build, and support end-to-end business intelligence and analytics solutions using the Microsoft data and ...

Data Engineer (Databricks & Azure) - 3-Month Rolling Contract Rate: £400-£450 per day Location: Remote IR35 Status: Outside IR35 Duration: Initial 3 months (rolling) About the Company Join a leading Databricks Partner delivering innovative data solutions for enterprise clients. You'll work on cutting-edge projects leveraging Databricks and Azure … transform data into actionable insights. About the Role We are seeking an experienced Data Engineer with strong expertise in Databricks and Azure to join our team on a 3-month rolling contract. This is a fully remote position, offering flexibility and autonomy while working on high-impact data engineering initiatives. ...

build, scale, and mature high-performing engineering functions Strong stakeholder engagement and senior-level communication skills Technical Environment (Exposure Required) Cloud data platforms (e.g. Databricks, Azure) DevOps and agile delivery tooling What's on Offer Competitive bonus Strong pension contribution Private medical cover and wellbeing support Highly flexible working approach ...

through to modelling, experimentation, and presenting insights to stakeholders. What they’re looking for: Strong SQL & Python skills, ideally within cloud environments (GCP, AWS, Databricks) Experience building or applying models such as LTV, churn, propensity, MMM or forecasting Exposure to experimentation (A/B testing, incrementality, Bayesian methods, causal inference ...

data product management, including work with data platforms, models, or analytics products Strong technical understanding of data systems, analytics, and data governance principles SQL, databricks, AI/ML product experience Ability to collaborate effectively with both technical and non-technical stakeholders Experience with agile methodologies, product lifecycle management, and roadmap ...

Experience Proven experience designing effective modern data architecture Strong experience with Microsoft cloud data services including Microsoft Fabric Hands-on expertise in SQL Server, Databricks, Power BI, and Tableau Strong data modelling skills and experience working with large datasets Confident managing complex stakeholder relationships A passion for innovation and continuous ...

risk management Solid understanding of both traditional and modern data warehousing approaches Hands-on experience with cloud platforms such as AWS, Azure, GCP, or Databricks Proficiency in Java, Scala, or Python A strong track record of mentoring and developing technical teams Desirable Experience Knowledge of data architecture principles such ...