1 to 25 of 33 Permanent Azure Data Factory Jobs in London

Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance … cutting-edge Azure Databricks platform for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality ...

Lead Data Platform Engineer - Databricks - IAC - Terraform - Azure Data Factory - Data Lakehouse The Data Platform Engineer designs, develops, automates, and maintains secure, scalable, and compliant data platforms that enable the firm to efficiently manage, analyse … utilise data. The role ensures that data solutions are robust and reliable while meeting regulatory obligations and safeguarding client confidentiality. Key Responsibilities Design and architect scalable, secure, and compliant data platforms and solutions, producing technical documentation and securing approvals through governance bodies such as Architecture Review ...

Location: London, Watford or Bristol (Hybrid working options available) The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires strong expertise in Azure cloud services, Databricks, data … in a product or Scaled Agile delivery environment. Qualifications Degree level IT or technical/scientific subject (or equivalent experience). Microsoft Azure Data Engineer or Solutions Architect certification (desirable). Databricks Certified Data Engineer or Machine Learning Associate (desirable). Experience ...

financial and tax planning, offering home finance and annuities propositions, and providing collective fund solutions to third party customers. Job Purpose The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. … in a product or Scaled Agile delivery environment. Qualifications Degree level IT or technical/scientific subject (or equivalent experience). Microsoft Azure Data Engineer or Solutions Architect certification (desirable). Databricks Certified Data Engineer or Machine Learning Associate (desirable). Experience ...

Lead Data Platform Engineer - Databricks - IAC - Terraform - Azure Data Factory - Data Lakehouse The Data Platform Engineer designs, develops, automates, and maintains secure, scalable, and compliant data platforms that enable the firm to efficiently manage, analyse … utilise data. The role ensures that data solutions are robust and reliable while meeting regulatory obligations and safeguarding client confidentiality. Key Responsibilities Design and architect scalable, secure, and compliant data platforms and solutions, producing technical documentation and securing approvals through governance bodies such as Architecture Review ...

This is a rare opportunity to apply serious data engineering in a domain where latency, correctness, and reliability carry direct commercial weight. * Requirements * 6+ years data engineering in production environments; Python expertise - idiomatic, well-tested, production-grade code, not notebook scripts * ETL/ELT pipeline design … implementation at scale; orchestration with Airflow, Prefect, or equivalent; reliability-first mindset including backfill, retry, and exactly-once semantics * Azure data platform - Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data ...

other consulting practices, and they are looking to build a team that is equally ambitious. Position Overview Our client is seeking a Senior Data Engineer who thrives on building scalable, cloud-first data systems. In this role, you will design and manage data pipelines … development Strong understanding of data architecture, APIs, and modern data pipeline design Hands-on experience within Microsoft's Azure ecosystem, with an interest in emerging technologies such as Fabric, AI-enhanced ETL, and real-time data streaming Proven ability ...

environment where development is encouraged and individuals are supported to grow with the organisation. Position Overview Our client is seeking a Senior Data Engineer who thrives on building scalable, cloud-first data systems. In this role, you will design and manage data pipelines that … development Strong understanding of data architecture, APIs, and modern data pipeline design Hands-on experience within Microsoft’s Azure ecosystem, with an interest in emerging technologies such as Fabric, AI-enhanced ETL, and real-time data streaming Proven ability ...

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated … adaptability for new data sources, analytical models, and emerging technologies. What You’ll Bring ✅ Extensive hands-on experience with Databricks , and Microsoft Azure data tools (must-have: Azure Data Factory, Azure Synapse, or Azure ...

client-facing Data Consultant who can design, build, and optimise modern data platforms and analytics solutions using the Microsoft data stack, with a strong emphasis on Microsoft Fabric. You’ll work across data ingestion, transformation, modelling, governance, and visualisation—translating business needs … Power Platform/AI) to integrate analytics and data capabilities into broader solutions. Stay current with Fabric capabilities and the evolving Microsoft data ecosystem, bringing innovation into client solutions. Required Skills & Experience Microsoft Data Stack Hands-on experience delivering data solutions with ...

Data Engineer - SC Cleared 6 Month Contract Hybrid - 2 days per week onsite Please note: Active SC Clearance is required for this role A leading organisation within the UK financial sector is embarking on a major data transformation programme. They are looking for an experienced Data Engineer to help design and deliver a modern, cloud‐first data platform that will underpin some of the organisation’s most critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory ...

Overview: We are working with a leading UK-based wealth and investment management firm seeking a skilled Data Engineer to support the build and evolution of their modern data platform. This role will focus on developing scalable data pipelines and contributing to a cloud … native lakehouse architecture. Key Responsibilities: Design, build, and maintain robust data pipelines using Azure-based services Develop and optimize data workflows within Databricks Implement and manage data ingestion processes, including real-time streaming with Kafka Structure and maintain data across ...

Senior Data Consultant Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that … specialises in modern data platforms. You’ll be working with well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Senior Data Consultant, you will be designing and delivering cutting-edge solutions across Azure ...

Title: Data Engineer Location: London Type: Permanent, Full-time Department: Group IT Reports to: Software Development Manager **IDEALY HAS PHINSYS EXPERIENCE** About the Role We are looking for a skilled Data Engineer to join a dynamic IT team within a well-established, regulated organisation. This role … offers the opportunity to work on critical data platforms, support financial reporting processes, and play a key part in a strategic transition to cloud-based technologies. You will be responsible for maintaining and developing data solutions, supporting SQL Server environments, and contributing to the design ...

Analytics Engineer London Up to £60,000 This is a great opportunity to become the key Analytics Engineer within an early-stage data function, playing a defining role in how the organisation builds its lakehouse, models its core data, and shapes best practice for years … come. If you enjoy ownership, influence, and hands-on technical work across Databricks, data modelling, and pipeline development, this role offers genuine impact and long-term career growth. The Company They are investing heavily in their data capabilities and are building out a modern data ...

close the advertisement and interview earlier than stated. Join our Software Engineering Team at L&Q: We are building the next generation of data-driven reporting and analytics solutions - and this role puts you at the centre of it. You will develop and manage Power BI reports, dashboards … data models that turn complex information into clear insights for the organisation. Working as part of a collaborative agile squad, you will design and maintain enterprise-level BI solutions using Power BI, SQL, DAX, KQL and Power Query (M). You will help shape our reporting standards, data ...

hands-on, technically expert role for someone who builds best-in-class Power BI solutions and is fluent in the full Microsoft data stack. You will be the primary developer of enterprise reporting across commercial, financial, operational, and project performance domains - working directly with business stakeholders to turn … properly engineered long-term solution. Continuous Improvement: You actively seek better ways to build, automate, and govern reporting — and stay current with the Microsoft data stack. ...

Overview Join Chambers as a Junior Data Engineer. This is a fantastic opportunity to gain practical experience in our growing Data team and also study towards an accredited Level 5 Data Engineer Apprenticeship. If you are keen to learn, develop your data … hear from you! Main Duties and Responsibilities Write clean and testable code using SQL and Python scripting languages, to enable our customer data products and business applications Build and manage data pipelines and notebooks, deploying code in a structured, trackable and safe manner Effectively create, optimise ...

recruiting for a Data Engineer on behalf of a well-respected Lloyd’s Market Insurer. This is a pivotal role sitting at the intersection of financial data integrity and cloud transformation. You will own the ETL pipeline that underpins monthly, quarterly and year-end close cycles … while simultaneously driving a strategic migration from legacy on-premise infrastructure to a modern, cloud-native data platform. Key Responsibilities Managing and monitoring the ETL pipeline to ensure timely and accurate financial reporting. Acting as the technical point of contact during the Monthly, Quarterly and Year-end Close ...

Data Engineering Manager with a strong professional services/consulting background to lead client-facing data engagements across the Microsoft Azure and Fabric stack . This is a hands-on leadership role for someone who enjoys owning client relationships, leading delivery … professional services background with proven ownership of customer projects and relationships 5+ years' client-facing data engineering experience Solid experience across Microsoft Azure , including services such as Azure Data Factory and secure network design Hands-on capability with Microsoft Fabric ...

working. Salary up to £66,000 depending on experience. This is an exciting opportunity to play a key role in shaping a modern data ecosystem for a forward‐thinking organisation. You will help transform complex data into clear, accessible and high‐quality datasets that enable better … reporting, analytics, digital tools and emerging AI initiatives. The Company They are a global, design‐driven organisation investing heavily in their data capabilities to enhance decision making, project delivery and innovation. With a strong focus on digital transformation, they are building a modern data platform that ...

Data Engineer passionate about building scalable, cloud-first data platforms that power business insights and innovation? Our client is seeking an experienced engineer to design robust, secure, and future-ready data solutions that support analytics, AI, and strategic decision-making. What Youll Do: Build … test, and maintain ETL/ELT pipelines for structured and unstructured data. Design and optimise data warehouses, lakes, and cloud-native platforms . Implement monitoring, security, and compliance frameworks in line with regulations (e.g., GDPR, financial standards). Deliver high-quality datasets to analysts, data scientists ...

ASAP for 6 months - likely to extend About the Role We’re partnering with a financial client that’s undertaking a large-scale data transformation, modernising legacy systems and building a unified analytics platform in the cloud. As part of this initiative, you’ll play a key role … developing and optimising a Snowflake-based data warehouse and delivering high-quality visualisations and reporting through Power BI. The role offers the chance to work on greenfield architecture, migrate legacy SQL Server solutions and collaborate closely with senior stakeholders on complex, high-impact data initiatives. What ...

D365 Technical Architect – Integration & Data Migration Role Overview We are looking for a seasoned Microsoft Dynamics 365 Technical Architect specializing in integrations and data migration to design, govern, and deliver scalable enterprise solutions. The role drives technical architecture across D365, Azure, and Power Platform … leading complex integrations and large data migration programs. Key Responsibilities Architecture & Leadership Define end‐to‐end technical architecture for D365 implementations and upgrades Own integration and data migration strategies aligned with Microsoft best practices Act as technical authority across design, build, testing, and go‐live Review ...

design and develop BI solutions that deliver meaningful insights to teams across underwriting, claims, actuarial, and finance. Your deep understanding of insurance data—particularly bordereaux, policy, and claims data in the Lloyd’s and London Market—is essential. What You’ll Do Build and maintain advanced … complex SQL queries , stored procedures, and ETL workflows Translate business needs into technical BI solutions by working closely with stakeholders Model and structure data for analytics aligned with London Market standards Integrate and reconcile data from multiple sources including bordereaux and third-party feeds Ensure data ...