1 to 25 of 41 Azure Data Factory Jobs in London

Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance … cutting-edge Azure Databricks platform for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality ...

Lead Data Platform Engineer - Databricks - IAC - Terraform - Azure Data Factory - Data Lakehouse The Data Platform Engineer designs, develops, automates, and maintains secure, scalable, and compliant data platforms that enable the firm to efficiently manage, analyse … utilise data. The role ensures that data solutions are robust and reliable while meeting regulatory obligations and safeguarding client confidentiality. Key Responsibilities Design and architect scalable, secure, and compliant data platforms and solutions, producing technical documentation and securing approvals through governance bodies such as Architecture Review ...

Data Architect £70,000 About the Role We are seeking a Data Architect to support the design and delivery of modern Azure-based data solutions within a large, highly regulated organisation operating in the public and professional standards sector. This role sits … heart of a data-driven transformation programme, shaping enterprise data models, improving data quality and governance, and enabling secure, scalable and compliant cloud data capabilities. This role is ideal for someone who is confident working across conceptual, logical and physical data ...

Introduction At Gallagher Re, we bring clarity to complexity by helping clients around the world make confident, data-driven decisions in a rapidly evolving risk landscape. Here, youll be part of a team that leverages world-class analytics and deep reinsurance expertise to deliver strategic advisory services … career, and collaborate with people who are as driven and inquisitive as you are. Overview At Gallagher Re, we are seeking an experienced Data Platform and Design Lead to establish and evolve the core fundamentals of our Data Platform. This platform will support operational, transactional ...

Location: London, Watford or Bristol (Hybrid working options available) The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires strong expertise in Azure cloud services, Databricks, data … in a product or Scaled Agile delivery environment. Qualifications Degree level IT or technical/scientific subject (or equivalent experience). Microsoft Azure Data Engineer or Solutions Architect certification (desirable). Databricks Certified Data Engineer or Machine Learning Associate (desirable). Experience ...

Lead Data Platform Engineer - Databricks - IAC - Terraform - Azure Data Factory - Data Lakehouse The Data Platform Engineer designs, develops, automates, and maintains secure, scalable, and compliant data platforms that enable the firm to efficiently manage, analyse … utilise data. The role ensures that data solutions are robust and reliable while meeting regulatory obligations and safeguarding client confidentiality. Key Responsibilities Design and architect scalable, secure, and compliant data platforms and solutions, producing technical documentation and securing approvals through governance bodies such as Architecture Review ...

This is a rare opportunity to apply serious data engineering in a domain where latency, correctness, and reliability carry direct commercial weight. * Requirements * 6+ years data engineering in production environments; Python expertise - idiomatic, well-tested, production-grade code, not notebook scripts * ETL/ELT pipeline design … implementation at scale; orchestration with Airflow, Prefect, or equivalent; reliability-first mindset including backfill, retry, and exactly-once semantics * Azure data platform - Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data ...

Senior Data Engineer We’re looking for a Senior Data Engineer to lead the design and delivery of scalable, high-quality data integrations across our organisation. In this role, you’ll take ownership of building reliable, governed integration workflows using Azure Logic … Apps and a range of modern Azure services—helping ensure data flows seamlessly, securely, and efficiently across the business. You’ll play a key role in shaping our integration landscape, driving continuous improvement, championing DevOps best practices, and mentoring junior engineers to uphold high engineering standards. ...

technology consultancy seeking a Microsoft BI Stack Developer to design, build, and support end-to-end business intelligence and analytics solutions using the Microsoft data and analytics ecosystem. This is initially a 3 month contract with potential to extend and will be a hybrid role based in London … Power BI. Ensure data accuracy, consistency, and reconciliation across sources. Microsoft and Azure Data Stack: Work with Microsoft data services such as: Azure SQL Database/SQL Server Azure Synapse Analytics Azure Data Factory ...

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated … adaptability for new data sources, analytical models, and emerging technologies. What You’ll Bring ✅ Extensive hands-on experience with Databricks , and Microsoft Azure data tools (must-have: Azure Data Factory, Azure Synapse, or Azure ...

client-facing Data Consultant who can design, build, and optimise modern data platforms and analytics solutions using the Microsoft data stack, with a strong emphasis on Microsoft Fabric. You’ll work across data ingestion, transformation, modelling, governance, and visualisation—translating business needs … Power Platform/AI) to integrate analytics and data capabilities into broader solutions. Stay current with Fabric capabilities and the evolving Microsoft data ecosystem, bringing innovation into client solutions. Required Skills & Experience Microsoft Data Stack Hands-on experience delivering data solutions with ...

Data Engineer IAM/Security Data London/Hybrid 12 month contract Were looking for a hands-on Data Engineer to support a major Identity & Access Management data programme within a complex enterprise environment. This is not a generic data engineering role. Youll be working on data pipelines, models and automation tied to identity, access, privileged accounts, controls, metrics and reporting . The right person will be comfortable sitting between data engineering and security/IAM teams . What youll be doing Build ...

evolve, offering continuous opportunities for development, influence, and leadership* Serve as the primary contact for architectural aspects of IT projects* Integrate business process, data, application, technical, and information security dimensions into cohesive IT solutions* Ensure solution architectures are documented using standard templates and tooling complying with Shell … facilitate discussions* Be an active participant in the wider Tech Lead and engineering communities* Hands-on experience in architecting applications into the Azure platform, including migrations/re-platforming of legacy on-premises systems* Engineering and architecture experience in designing and building containers, Microservices, Cloud Native applications ...

Data Engineer - SC Cleared 6 Month Contract Hybrid - 2 days per week onsite Please note: Active SC Clearance is required for this role A leading organisation within the UK financial sector is embarking on a major data transformation programme. They are looking for an experienced Data Engineer to help design and deliver a modern, cloud‐first data platform that will underpin some of the organisation’s most critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory ...

Databricks Data Engineer – Hybrid (London) – Azure Data Services – Lloyd’s Market -Enterprise Data Platforms – up to £95,000 If you’re looking for a role where your work has impact, this is a great opportunity. You’ll be joining an organisation working … with some of the most complex data challenges in the insurance and financial services sector, operating in a highly regulated and analytically demanding environment. You’ll help build large‐scale cloud data platforms, modernise critical data flows, and play a meaningful role in shaping ...

working with a leading player in the insurance services space, who are looking to bring on board an experienced Data Modeller to help shape and deliver their enterprise data strategy. This role sits at the intersection of data engineering and business architecture - perfect … someone who thrives on designing scalable, integrated data ecosystems that power analytics and digital transformation. You’ll be joining a forward-thinking environment where your expertise in data modelling, Azure, and the London Market/Specialty Insurance domain will be key to driving success. ...

seeking an experienced Senior Data Engineer with strong Databricks expertise to design, build, and maintain a scalable cloud-based data platform for a private equity firm. This is a 6-month contract based in London with hybrid working. Key Responsibilities Design and build robust data pipelines using Azure Data Factory and Databricks Develop ETL/ELT processes to transform raw data into analytics-ready datasets Architect and maintain data lake solutions using Azure Data Lake Storage Implement Databricks solutions ...

Senior Data Consultant Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that … specialises in modern data platforms. You’ll be working with well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Senior Data Consultant, you will be designing and delivering cutting-edge solutions across Azure ...

Data Engineer (Azure & Databricks) - 6-month Contract We are seeking an experienced Senior Data Engineer with strong Databricks expertise to design, build, and maintain a scalable cloud-based data platform for a private equity firm. This is a 6-month contract based … London with hybrid working. Key Responsibilities Design and build robust data pipelines using Azure Data Factory and Databricks Develop ETL/ELT processes to transform raw data into analytics-ready datasets Architect and maintain data lake solutions using ...

Data Engineer – London – Databricks – Azure – 75k + bonus + benefits I’m currently working with a company that continues to grow even after 60 years in operation. With more than 1,000 projects completed worldwide and a combined project value exceeding $150 billion, they’ve established … even easier, they cover all expenses for any days worked in the office, regardless of how near or far employees live. Tech Stack: Azure , Databricks , Power BI , Python They’re looking to grow their team with a Data Engineer that thrives on innovation and cutting-edge ...

Analytics Engineer London Up to £60,000 This is a great opportunity to become the key Analytics Engineer within an early-stage data function, playing a defining role in how the organisation builds its lakehouse, models its core data, and shapes best practice for years … come. If you enjoy ownership, influence, and hands-on technical work across Databricks, data modelling, and pipeline development, this role offers genuine impact and long-term career growth. The Company They are investing heavily in their data capabilities and are building out a modern data ...

seeking a highly detail-oriented and experienced VP-level Technical Systems Analyst to support the analysis and implementation of a new enterprise data platform with a focus on Risk and ESG reporting . The successful candidate will bring 5 + years of experience in business and systems analysis … within banking or financial services , with strong capability across technical requirements definition, data architecture, and database-driven solution design . This role will play a critical part in supporting regulatory and ESG-driven data initiatives in a complex, multi-stakeholder environment. Key Responsibilities Contribute ...

Data Analyst 6 months Hybrid - 1-2 Days per week on site in London £(Apply online only) per day (Inside IR35) ***The selected candidate MUST HAVE experience in London Markets*** Key Skills & Experience Draft the scope for the data and analytics workstream with understanding … user requirements and KPIs Develop BRDs, data mapping specifications, refined PBIs with clear articulation of user stories and acceptance criteria for data modellers and data engineers Analyse delegated authority data source through profiling, exploratory queries including quality validation to support medallion layer ...

Role Overview As a Data Architect, you will operate within a consultancy environment, contributing to the technical delivery of projects across areas such as data ingestion, storage, integration, warehousing, preparation, and cloud-based infrastructure. The primary objective of this role is to design and deliver scalable … secure, and cost-efficient data architectures in cloud environments. These solutions should empower clients to leverage their data effectively, enabling advanced analytics, streamlined processing, and informed decision-making. Key Requirements To succeed in this role, you should be able to: Demonstrate strong end-to-end expertise ...

Rate: Competitive day rate Location: Remote Contract: 3 months Start date: ASAP Overview of the Data Engineer role Sellick Partnership is supporting an organisation within the financial services sector to recruit two experienced Data Engineers on a contract basis. This is a short-term project focused … enhancing and rebuilding key data extract processes within a pricing function, supporting efficient data delivery and reporting. Key responsibilities of the Data Engineer will include Rewriting and optimising complex SQL code Building and transforming data extracts into structured output files Reviewing ...