1 to 25 of 45 Azure Data Factory Jobs in the City of London

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform … for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. More ❯

in the digital lifecycle and helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation … Data Solution Architect (Azure) Location: London, UK The Role We are looking for an experienced Data Solution Architect with deep expertise in Microsoft Azure data services and cloud-native architecture . This role is ideal for someone who thrives at the intersection of strategy and delivery — designing modern, scalable, and … management skills, capable of articulating technical concepts to non-technical audiences. Strong analytical mindset with proven problem-solving ability. Experience working in agile delivery environments. Preferred Qualifications Microsoft Certified: Azure Solutions Architect Expert or Azure Data Engineer Associate certifications. Experience with data governance, lineage, and compliance frameworks (e.g., Purview, GDPR). Knowledge More ❯

Azure Data Engineer – Hybrid/London – Up to £72k + 10% bonus Recann is recruiting on behalf of a leading international professional services firm seeking a skilled and proactive Azure Data Engineer to join its collaborative Data team. This role will be at the forefront of optimising the organisation’s data infrastructure on Microsoft Azure, enabling data-driven decision-making and supporting critical business functions. What you’ll be doing Building and maintaining scalable data pipelines using Azure Data Factory, Azure Data Fabric, and Azure Synapse Analytics. Developing robust ELT/ETL processes to integrate data from multiple business systems. Ensuring data consistency, security, and compliance (including GDPR). Supporting analytics/reporting teams with clean, structured datasets. Collaborating with IT, Finance More ❯

Data Engineer Job Type : Permanent Location: Hub Location (London/Reading/Birmingham/Leeds/Glasgow) Hours of work: Full time (35 hours) with 3 days per week in the office Salary: £50,000 - £55,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK … are delivering an excellent and reliable service to their continuously expanding client base. They are providing the utmost level of quality and security in everything they do. The Data Engineer will play a key role in developing and maintaining Power BI reports and dashboards to support the business’s operational MI, while contributing to broader data initiatives within Azure Data Factory, Synapse Analytics, and the ongoing migration to Microsoft Fabric. This is a hands-on delivery role suited to a mid-level engineer with strong technical ability and a desire to grow within a modern cloud data environment. Key Responsibilities Build and maintain Power BI reports More ❯

/day (Inside IR35) Databricks Engineer needed with active SC Security Clearance for 6 Month Contract based in Central London (Hybrid). Developing a cutting-edge Azure Databricks platform for economic data modelling, analysis, and forecasting. Start ASAP in Nov/Dec 2025. Hybrid Working - 2 days/week remote (WFH), and 3 days/week … working on-site from the Central London office. A chance to work with a leading global IT and Digital transformation business specialising in Government projects: In-depth Data Engineering + strong hands-on Azure Databricks expertise. Azure Data Services, Azure Data Factory, Azure Blob … Storage + Azure SQL Database. Designing, developing, building + optimising data pipelines, implementing data transformations, ensuring data quality and reliability. Deep Data Warehousing knowledge including data modelling techniques + data integration patterns. Experience of working with complex data pipelines, large data sets More ❯

deep business knowledge, operational excellence, and cutting-edge solutions – we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook. Inviting Applications for the role of Senior Principal Consultant … Azure AI Engineer/Lead In this role, we are seeking a highly skilled and passionate Azure AI Engineer …/Lead to join our dynamic Cora Sequence team. In this role, you will be instrumental in designing, developing, deploying, and managing AI/ML solutions on the Microsoft Azure platform. You will work closely with data scientists, researchers, and product managers to translate complex analytical models into production-ready, scalable applications. Your expertise in Azure More ❯

Senior Data Engineer Job Type : Permanent Location: Hub Location (London/Reading/Birmingham/Glasgow/Leeds) Salary: £60,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge technology, and exceptional … reliable service to their continuously expanding client base. They are providing the utmost level of quality and security in everything they do. Key Responsibilities Design, build, and maintain Azure Data Factory (ADF) pipelines to support complex data integration and transformation needs. Develop scalable and optimised data models in Azure … for analytical and operational reporting. Govern and enhance Power BI datasets and semantic models, ensuring best practice in DAX, performance tuning, and report design. Lead the development of data architecture and standards across Azure Data Lake and Synapse environments. Contribute to the migration to Microsoft Fabric, shaping platform architecture and integration patterns. Implement and More ❯

Data Engineer. Permanent. T6/MN/1292110-3. Remote - London *Cannot Provide Sponsorship - Must be Eligible to work in the UK Long Term* International Manufacturing organisation is seeking to secure a Data Engineer. Member of a small Data Engineering Team which is part of a much larger IT function. Role: Data Movement & Transformation processes between Application/Services/Solutions. Azure Data Factory Pipelines & SSRS reporting solutions - maintenance & optimization ETL - Design, implement & manage ETL processes - ensure accuracy, quality & consistency. Monitor daily Data Loads & ETL workflows. AWS - Support the migration of Data Services to AWS - scalable & cloud-first solutions. Deliver … UK Data Roadmap - aligned to Data Infrastructure & Business Strategy. Gather & Define Requirements - identify new opportunities for the business/internal teams. Troubleshoot & resolve pipeline failures, reporting errors & performance bottlenecks. Validate & Reconcile Data - ensuring accuracy. SSRS, Power BI & other BI tools - User Support. Provide Governance, Security & Compliance - aligned to Data best practices. Liaison More ❯

Job Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are … looking for an experienced Databricks Data Engineer to design, develop, and manage data pipelines using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business and technical … teams to deliver robust data models and transformations in support of analytics and reporting needs. • Responsibilities: • Design and develop ETL pipelines using ADF for data ingestion and transformation. • Collaborate with Azure stack modules like Data Lakes and SQL DW to handle large volumes of data. • Write SQL, Python, and PySpark code to More ❯

Senior Data Architect - London - Hybrid - £100,000 - £110,000 My client is an agile, data-driven company who are continuing to expand their thriving data team. They are looking to hire a senior data architect with expert data modelling and technical experience across the full Azure data … Flexible working hours 26 days annual leave, plus bank holidays Private medical insurance Company pension scheme And many more Key Responsibilities Design and implement scalable database solutions and data models that enable efficient data storage, integration, and retrieval. Review and optimise database implementation processes to ensure compliance with GDPR and wider data governance standards. … driven ingestion and transformation pipelines. Hands-on experience with Master Data Management (MDM), data cataloguing, and data lineage tracking. Advanced proficiency with Microsoft Azure data services, including Databricks, Azure Data Factory, Azure SQL, CosmosDB, and related technologies. Extensive experience with Microsoft SQL More ❯

Job Title: Data Architect/Data Modeler Contract/Permanent – Open for Both Mode of work: Hybrid 3 days onsite/week Roles and responsibilities • Lead the design and implementation of scalable data architecture supporting analytics and digitalization agenda in a cross-functional team of architects from business and technology • Develop and maintain data models (Logical and Physical) to support business needs ensuring data integrity and efficiency. • Design and govern data architecture and integration standards across Azure Data Factory and Databricks to enable integrated analytics solutions. • Manage the Information Management framework, architecture, processes, and solutions • Be responsible for strategic roadmaps that describe … the journey to target state for all Data & Analytics domains • Review high-level designs and implementations to ensure quality, coherence and consistency with Enterprise Data architecture • Deliver standards and patterns, controls to deploy services in a standard and repeatable way Key skills Needed Hands-on experience in Data Architecture and Data modeling More ❯

support EQ's transition into a stronger, more profitable, product-led business, driven by real insights and the needs of its customers. We are looking for a skilled Data Engineer to join our Data team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines … using Microsoft Fabric and Databricks. You will work closely with our Product and Engineering teams to ensure data flow and integration across our data ecosystem. Your expertise will help us to improve our data infrastructure, improve data quality, and enable data-driven decision-making across the organization. Core Duties and … Data Lake Storage, or other Azure data services Experience with agile development methodologies and version control systems such as Git Certification in Microsoft Azure, Databricks, or other relevant technologies What We Offer Save For Your Future - Equiniti Pension Plan; Equiniti matches your pension contributions up to 10% All Employee Long Term Incentive More ❯

Essential Skills & Experience:  10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks.  Strong proficiency in Python and Spark (PySpark) or Scala.  Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns.  Extensive experience with Azure data services, including Azure Data Factory, Azure Blob Storage, and Azure SQL Database.  Experience working with large datasets and complex data pipelines.  Experience with data architecture design and data pipeline optimization.  Proven expertise with Databricks, including hands-on implementation experience … and certifications.  Experience with SQL and NoSQL databases.  Experience with data quality and data governance processes.  Experience with version control systems (e.g., Git).  Experience with Agile development methodologies.  Excellent communication, interpersonal, and problem-solving skills.  Experience with streaming data technologies (e.g., Kafka, Azure Event Hubs).  Experience with data More ❯

Data Engineer – Python | SQL | Azure | Microsoft Fabric Location: London Salary: £90,000 + benefits Financial Services Are you a skilled Data Engineer with strong coding expertise and a passion for building scalable data solutions? We’re looking for a talented professional to join our team and play a key role in designing … developing, and optimising modern data platforms on Azure Cloud — with a focus on an exciting Microsoft Fabric implementation. What you’ll do Design and build robust data pipelines and ETL processes using Python and SQL. Contribute to the rollout and optimisation of Microsoft Fabric, shaping the next-generation data platform. Work across … Azure services (Data Factory, Synapse, Databricks, Data Lake, Functions) to deliver secure and scalable data solutions. Optimise data workflows for performance, reliability, and cost efficiency. Collaborate with analysts, data scientists, and business stakeholders to ensure high-quality, trusted data is available for decision-making. More ❯

140K base + Bonus Private Equity AI and Data projects Azure Fabric integrated ML Must be living within commuting distance to the central London office Exciting new role within Private Equity, joining a new Data & AI software team to work with the Portfolio clients, including high profile legacy brands, working on cutting edge development … like Autogen, Swarm, or LangGraph. OpenAI GPT Integration MLOps Expertise utilising Azure Machine Learning Responsible for designing, developing, and implementing data solutions on the Microsoft Azure platform, including data pipelines and architectures Azure services: Expertise in Azure services such as Azure Data Factory … Lake, Data models Experience Strong Python skills ML frameworks, and hands-on experience with LLM toolchains, OpenAI APIs, embeddings, and vector stores. Experience within Microsoft Azure, Azure AI and MLOps Experience with Azure AI/ML services and MLOps Ideally LLMs, in enterprise environments. AI-enabled products and driving CoPilot More ❯

Lead Data Engineer (Azure Stack) £95k + 10% bonus Hybrid – 1 day a week Central London I’m helping a growing fintech find their next Lead Data Engineer, they are looking for someone who loves building modern data platforms in Azure and wants to make a genuine impact. This role … by allowing you to lead from the front while staying hands-on with the tech. You’ll shape the architecture, mentor the team, and help drive a modern, data-driven culture all within a collaborative environment that values innovation and ownership. Tech you’ll be working with: Azure Data Lake Azure Synapse … Databricks Data Factory Python, SQL, PySpark Terraform, GitHub Actions, CI/CD pipelines You’ll thrive here if you: Have strong experience building and leading Azure-based data platforms Enjoy mentoring and guiding other engineers Love designing scalable, automated data pipelines Bring a hands-on approach and enjoy problem-solving More ❯

We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a … high-performing data engineering team, you will contribute to large-scale transformation initiatives within the P&C Insurance space by developing robust data models, optimising data flows, and ensuring the accuracy and accessibility of critical information. The position requires close collaboration with both technical and business stakeholders, and is an excellent opportunity to join … team that invests in your growth, with comprehensive training and certification programs and a real opportunity to showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large More ❯

Your Role We are looking for strong Azure Solution Architects who are passionate and focused on data solutions and Microsoft technology and who ideally have skills in many of the following areas: Partners with other solution architects to assess solution alignment to the overall architectural blueprint – and drive proposal writing, solution direction, pricing and costing Owns … teams. Serve as technical liaison between Sales team, Clients, Delivery & support teams up to and including Contract negotiations Have experience of designing architecture for data focused Microsoft Azure projects, Cooperate with sales team to formulate/execute a sales strategy to exceed revenue objectives Working on Microsoft Azure PaaS and IaaS, specifically: App Services … Azure SQL Database, SQL Server, Storage, Synapse Analytics, Purview, Databricks, Azure data Factory, Azure data lake. Understand which Azure data focused components to use for which purpose Your Skills and Experience Our projects are varied, sometimes you may be asked to help define a More ❯

We’re working with a leading player in the insurance services space, who are looking to bring on board an experienced Data Modeller to help shape and deliver their enterprise data strategy. This role sits at the intersection of data engineering and business architecture - perfect for someone who thrives on designing scalable, integrated data ecosystems that power analytics and digital transformation. You’ll be joining a forward-thinking environment where your expertise in data modelling, Azure, and the London Market/Specialty Insurance domain will be key to driving success. Key Responsibilities: Lead the design and implementation of scalable data architectures supporting analytics and digital initiatives … Develop and maintain logical and physical data models to support business needs. Define and govern data architecture standards across Azure Data Factory and Databricks Oversee data integration frameworks and manage the Information Management architecture Shape strategic data roadmaps aligned with the company’s long-term goals More ❯

deep technical expertise in Microsoft’s data stack with the ability to translate business requirements into end-to-end Microsoft architectures, operating at the intersection of Microsoft Data, AI, and Application technologies. Responsibilities: Engaging with clients and internal teams to define data architecture and strategy within the Microsoft ecosystem. Designing and presenting end-to … end Microsoft data architectures that integrate data technologies like Azure Synapse Analytics, Fabric and Power BI with Dynamics 365, Power Platform, AI Foundry, and Copilot Studio. Supporting sales and solution design processes by creating Microsoft-aligned proposals, solution diagrams, and proofs of concept. Acting as a trusted Microsoft data advisor, ensuring that … leveraging Azure ML, AI Foundry, or OpenAI on Azure. Contributing to the Microsoft Partner ecosystem by staying current on new releases, patterns, and certifications across the Microsoft Data and AI stack. Required: 3–6 years’ experience in Microsoft Data Solution Architecture, Pre-Sales, or Solution Design roles. Deep understanding of Microsoft Fabric, Azure More ❯

Data Engineer - London - Databricks - Azure - 75k + bonus + benefits Tech Stack: Azure | Databricks | Power BI | Python Are you ready to shape the future of data? We're looking for a Data Engineer to join a team that thrives on innovation and cutting-edge technology. If you love solving complex … data challenges and building scalable solutions, this is your chance to make an impact. What You'll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards ETL & Data Modelling: T-SQL, metadata-driven pipelines DevOps: CI/… CD Bonus: Python What you'll do Design and implement scalable Azure-based data solutions Build and optimize data pipelines for integration and transformation Develop Power BI dashboards for global stakeholders Ensure data quality, governance, and security Collaborate in an Agile environment with cross-functional teams What We're Looking For Hands More ❯

Head of Data – Azure & Databricks | Permanent | Hybrid (2–3 Days in London) Flexible salary + comprehensive benefits package – contact us to learn more! Are you ready to lead the evolution of a cutting-edge data platform? My client is seeking a visionary Head of Data to define and drive their data strategy, leveraging Azure and Databricks to deliver scalable, high-performance solutions that empower analytics and decision-making across the business. What You’ll Do Own the data strategy : Shape and evolve a modern hybrid data platform to meet current and future business needs. Architect and optimize : Design robust data pipelines … for large-scale ingestion, transformation, and delivery across diverse sources. Champion best practices : Ensure orchestration, monitoring, and governance standards for reliable, secure data flows. Drive innovation : Implement smart storage, compute allocation, and caching techniques for performance and cost efficiency. Lead and inspire : Manage and mentor a team of data engineers and BI developers, fostering collaboration and More ❯

Data Engineer | Social Impact Tech | Hybrid (London) | £60k Want to use your data skills for real social impact? 🌍 Join a purpose-driven tech company helping frontline workers prevent issues like homelessness and child neglect — where your work genuinely changes lives. You’ll help build and scale secure, high-performance data pipelines (Azure Data Factory, SQL, Python) that power products used across the public sector. Expect plenty of ownership, collaboration, and the chance to shape engineering practices in a growing team. What you’ll bring: 3+ years’ experience in data/platform engineering Strong SQL + Python skills Hands-on with Azure Data Factory (or similar ETL tools) A proactive, collaborative mindset Nice to have: CI/CD, Power BI, Azure DevOps, or public sector data experience. Why join: ✨ Work on tech that makes a real difference 💻 Hybrid setup (1–2 days/week in London) 💰 Competitive pay, private healthcare, 25 days’ holiday, enhanced parental More ❯

Data Engineering Lead – Azure & Databricks | Full Time Role - Hybrid 2/3 days per week London This role has a Flexible salary and company benefits as well get in touch to learn more! My client is looking for a hands-on Data Engineering Lead to shape and evolve a modern hybrid data platform built on Azure and Databricks. This role is central to enabling scalable, high-performance data solutions that drive analytics and reporting across the organisation. What does the role consist of? Design and enhance data pipelines that support large-scale ingestion, transformation, and delivery across varied sources. Leverage Azure and … Databricks to ensure reliable, high-throughput data movement and integration for analytics and BI. Apply best practices in orchestration, monitoring, and error handling to maintain consistent and dependable data flows. Optimise hybrid cloud architecture for performance, scalability, and cost-efficiency. Implement smart storage strategies, compute resource allocation, and caching techniques to support growing data More ❯

Data Architect x1 days in office a week (open to more flexible options potentially) A blended strategic & 'hands-on' opportunity to lead data architecture at an established and globally respected brand who are undergoing major digital transformation (x10 data engineers already in place, wider 50 person engineering group). This role sits at the … heart of their data function, helping to design and evolve a modern, scalable data platform that will underpin key business decisions and digital products for years to come. As Data Architect, you’ll be the technical authority for how data is structured, integrated, and governed, working across engineering, product, and business stakeholders … in data modelling, platform strategy, and pipeline design Support analytics and digital product teams through robust architecture and integration patterns Tech Environment & Tooling Deep focus on Microsoft Azure and associated services: Azure Data Factory, DataBricks, CosmosDB, Azure SQL Strong usage of SQL Server and modern data More ❯