1 to 25 of 32 Permanent Azure Data Factory Jobs in London

Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance … cutting-edge Azure Databricks platform for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality ...

Lead Data Platform Engineer - Databricks - IAC - Terraform - Azure Data Factory - Data Lakehouse The Data Platform Engineer designs, develops, automates, and maintains secure, scalable, and compliant data platforms that enable the firm to efficiently manage, analyse … utilise data. The role ensures that data solutions are robust and reliable while meeting regulatory obligations and safeguarding client confidentiality. Key Responsibilities Design and architect scalable, secure, and compliant data platforms and solutions, producing technical documentation and securing approvals through governance bodies such as Architecture Review ...

Data Architect £70,000 About the Role We are seeking a Data Architect to support the design and delivery of modern Azure-based data solutions within a large, highly regulated organisation operating in the public and professional standards sector. This role sits … heart of a data-driven transformation programme, shaping enterprise data models, improving data quality and governance, and enabling secure, scalable and compliant cloud data capabilities. This role is ideal for someone who is confident working across conceptual, logical and physical data ...

Introduction At Gallagher Re, we bring clarity to complexity by helping clients around the world make confident, data-driven decisions in a rapidly evolving risk landscape. Here, youll be part of a team that leverages world-class analytics and deep reinsurance expertise to deliver strategic advisory services … career, and collaborate with people who are as driven and inquisitive as you are. Overview At Gallagher Re, we are seeking an experienced Data Platform and Design Lead to establish and evolve the core fundamentals of our Data Platform. This platform will support operational, transactional ...

Location: London, Watford or Bristol (Hybrid working options available) The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires strong expertise in Azure cloud services, Databricks, data … in a product or Scaled Agile delivery environment. Qualifications Degree level IT or technical/scientific subject (or equivalent experience). Microsoft Azure Data Engineer or Solutions Architect certification (desirable). Databricks Certified Data Engineer or Machine Learning Associate (desirable). Experience ...

Lead Data Platform Engineer - Databricks - IAC - Terraform - Azure Data Factory - Data Lakehouse The Data Platform Engineer designs, develops, automates, and maintains secure, scalable, and compliant data platforms that enable the firm to efficiently manage, analyse … utilise data. The role ensures that data solutions are robust and reliable while meeting regulatory obligations and safeguarding client confidentiality. Key Responsibilities Design and architect scalable, secure, and compliant data platforms and solutions, producing technical documentation and securing approvals through governance bodies such as Architecture Review ...

This is a rare opportunity to apply serious data engineering in a domain where latency, correctness, and reliability carry direct commercial weight. * Requirements * 6+ years data engineering in production environments; Python expertise - idiomatic, well-tested, production-grade code, not notebook scripts * ETL/ELT pipeline design … implementation at scale; orchestration with Airflow, Prefect, or equivalent; reliability-first mindset including backfill, retry, and exactly-once semantics * Azure data platform - Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data ...

Senior Data Engineer We’re looking for a Senior Data Engineer to lead the design and delivery of scalable, high-quality data integrations across our organisation. In this role, you’ll take ownership of building reliable, governed integration workflows using Azure Logic … Apps and a range of modern Azure services—helping ensure data flows seamlessly, securely, and efficiently across the business. You’ll play a key role in shaping our integration landscape, driving continuous improvement, championing DevOps best practices, and mentoring junior engineers to uphold high engineering standards. ...

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated … adaptability for new data sources, analytical models, and emerging technologies. What You’ll Bring ✅ Extensive hands-on experience with Databricks , and Microsoft Azure data tools (must-have: Azure Data Factory, Azure Synapse, or Azure ...

client-facing Data Consultant who can design, build, and optimise modern data platforms and analytics solutions using the Microsoft data stack, with a strong emphasis on Microsoft Fabric. You’ll work across data ingestion, transformation, modelling, governance, and visualisation—translating business needs … Power Platform/AI) to integrate analytics and data capabilities into broader solutions. Stay current with Fabric capabilities and the evolving Microsoft data ecosystem, bringing innovation into client solutions. Required Skills & Experience Microsoft Data Stack Hands-on experience delivering data solutions with ...

evolve, offering continuous opportunities for development, influence, and leadership* Serve as the primary contact for architectural aspects of IT projects* Integrate business process, data, application, technical, and information security dimensions into cohesive IT solutions* Ensure solution architectures are documented using standard templates and tooling complying with Shell … facilitate discussions* Be an active participant in the wider Tech Lead and engineering communities* Hands-on experience in architecting applications into the Azure platform, including migrations/re-platforming of legacy on-premises systems* Engineering and architecture experience in designing and building containers, Microservices, Cloud Native applications ...

Data Engineer - SC Cleared 6 Month Contract Hybrid - 2 days per week onsite Please note: Active SC Clearance is required for this role A leading organisation within the UK financial sector is embarking on a major data transformation programme. They are looking for an experienced Data Engineer to help design and deliver a modern, cloud‐first data platform that will underpin some of the organisation’s most critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory ...

Databricks Data Engineer – Hybrid (London) – Azure Data Services – Lloyd’s Market -Enterprise Data Platforms – up to £95,000 If you’re looking for a role where your work has impact, this is a great opportunity. You’ll be joining an organisation working … with some of the most complex data challenges in the insurance and financial services sector, operating in a highly regulated and analytically demanding environment. You’ll help build large‐scale cloud data platforms, modernise critical data flows, and play a meaningful role in shaping ...

working with a leading player in the insurance services space, who are looking to bring on board an experienced Data Modeller to help shape and deliver their enterprise data strategy. This role sits at the intersection of data engineering and business architecture - perfect … someone who thrives on designing scalable, integrated data ecosystems that power analytics and digital transformation. You’ll be joining a forward-thinking environment where your expertise in data modelling, Azure, and the London Market/Specialty Insurance domain will be key to driving success. ...

Senior Data Consultant Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that … specialises in modern data platforms. You’ll be working with well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Senior Data Consultant, you will be designing and delivering cutting-edge solutions across Azure ...

Data Engineer (Azure & Databricks) - 6-month Contract We are seeking an experienced Senior Data Engineer with strong Databricks expertise to design, build, and maintain a scalable cloud-based data platform for a private equity firm. This is a 6-month contract based … London with hybrid working. Key Responsibilities Design and build robust data pipelines using Azure Data Factory and Databricks Develop ETL/ELT processes to transform raw data into analytics-ready datasets Architect and maintain data lake solutions using ...

Data Engineer – London – Databricks – Azure – 75k + bonus + benefits I’m currently working with a company that continues to grow even after 60 years in operation. With more than 1,000 projects completed worldwide and a combined project value exceeding $150 billion, they’ve established … even easier, they cover all expenses for any days worked in the office, regardless of how near or far employees live. Tech Stack: Azure , Databricks , Power BI , Python They’re looking to grow their team with a Data Engineer that thrives on innovation and cutting-edge ...

Analytics Engineer London Up to £60,000 This is a great opportunity to become the key Analytics Engineer within an early-stage data function, playing a defining role in how the organisation builds its lakehouse, models its core data, and shapes best practice for years … come. If you enjoy ownership, influence, and hands-on technical work across Databricks, data modelling, and pipeline development, this role offers genuine impact and long-term career growth. The Company They are investing heavily in their data capabilities and are building out a modern data ...

Role Overview As a Data Architect, you will operate within a consultancy environment, contributing to the technical delivery of projects across areas such as data ingestion, storage, integration, warehousing, preparation, and cloud-based infrastructure. The primary objective of this role is to design and deliver scalable … secure, and cost-efficient data architectures in cloud environments. These solutions should empower clients to leverage their data effectively, enabling advanced analytics, streamlined processing, and informed decision-making. Key Requirements To succeed in this role, you should be able to: Demonstrate strong end-to-end expertise ...

recruiting for a Data Engineer on behalf of a well-respected Lloyd’s Market Insurer. This is a pivotal role sitting at the intersection of financial data integrity and cloud transformation. You will own the ETL pipeline that underpins monthly, quarterly and year-end close cycles … while simultaneously driving a strategic migration from legacy on-premise infrastructure to a modern, cloud-native data platform. Key Responsibilities Managing and monitoring the ETL pipeline to ensure timely and accurate financial reporting. Acting as the technical point of contact during the Monthly, Quarterly and Year-end Close ...

working with a global healthcare and insurance organisation who are making a real difference to people's lives. We require an experienced Senior Data Platform Engineer to join the AI and Data Platform teams. £100,000 + Bonus + Excellent Benefits Fully remote with occasional travel … their offices. You will contribute to the design and operation of a scalable, secure enterprise data platform supporting advanced analytics and business intelligence in a healthcare and insurance setting. You'll work with high autonomy, mentor junior engineers, and drive technical excellence while ensuring compliance and performance. This ...

Data Scientist Location: London Hybrid – 2 days a week Salary: Up to £70,000 + benefits Do you want to shape growth strategy at a global entertainment leader where data, AI and advanced analytics power unforgettable experiences? We’re looking for a Data Scientist … passionate about turning complex, large-scale data into predictive models and actionable insights that directly influence commercial decisions and long-term growth. What You’ll Do as a Data Scientist Take ownership of high-impact growth use cases across marketing, pricing and demand forecasting. Design, build ...

Hybrid/Remote Clearance: Active SC clearance required (minimum) Start: June Day Rate: Competitive market rates Overview We are recruiting a contract Databricks Data Engineer for a large-scale UK Government programme delivering critical, cloud-native data platforms. This is a long-term engagement within … high-profile public sector transformation, working with sensitive, mission-critical data at national scale. You must already hold active SC clearance to be considered. Responsibilities Design, build and maintain Databricks data pipelines using Apache Spark (PySpark & Spark SQL) Implement Delta Lake/Lakehouse architectures (Bronze, Silver ...

Senior Data Engineer (Microsoft Fabric/Azure) Contract | 6 Months | £600–£700/day (Outside IR35) London | Hybrid Would you be interested in a Data Engineer contract role focused on building a Microsoft Fabric based data platform used directly by investment teams … This is a role where your work is used day to day by the business. You will be building data products that drive real decisions rather than sitting in a reporting function. The role You’ll join a small, high impact team responsible for delivering production grade pipelines ...

Senior Data Engineer – Databricks Location: Remote UK or office based (opportunity to work remotely or be office based depending on your preference) Salary: £50k - £64k plus benefits Type: Full-Time ARCA Resourcing is proud to be partnered with an innovative leading retailer that’s transforming how data powers decision-making. We’re seeking a Senior Data Engineer to take a technical leadership role within their modern Enterprise Data Platform. If you thrive in shaping scalable, innovative data solutions and mentoring talented engineers, this is your opportunity to make ...