1 to 25 of 117 Azure Data Factory Jobs in London

Position: Data Engineer Overview of the Role An established organisation is currently undergoing a data transformation and is seeking a skilled Data Engineer to join its growing data team. This role plays a key part in building and deploying modern data solutions based on Azure Databricks, enabling faster … and more informed business decisions. You'll work hands-on with Azure Databricks, Azure Data Factory, Delta Lake, and Power BI to design scalable data pipelines, implement efficient data models, and ensure high-quality data delivery. This is a great opportunity to shape the future of … data within the organisation while working with advanced cloud technologies. Key Responsibilities and Deliverables Design, develop, and optimise end-to-end data pipelines (batch & streaming) using Azure Databricks, Spark, and Delta Lake. Implement Medallion Architecture to structure raw, enriched, and curated data layers efficiently. Build scalable ETL/ELT processes with Azure More ❯

achieving their strategic goals and empower our people to make an impact and develop their own unique career path. About the team and your role Our Digital and Data Advisory practice, as part of our broader Business Transformation client offering, consists of three teams: Digital Finance team working with clients to understand how their finance functions work, assisting … throughout their digital transformation journey from defining a digital strategy and roadmap, creating a business case, selecting the right software, documenting user stories, to managing and assuring projects. Data analytics and insights team working with clients to help them understand their level of data analytics maturity and to develop a data analytics strategy that … of maturity. We work with clients to identify KPIs and metrics they can use to track progress against their strategic objectives and to assess the quality of their data needed for those KPIs and metrics. We support clients with full life cycle data warehouse and business intelligence/analytics implementations including data warehouse design More ❯

that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … re underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure More ❯

JOB DESCRIPTION Job title: Data Analytics Engineer (BI-Focused) Reports to: Lead Data Manager Location: London (Holborn), remote 2d/w. JOB SUMMARY This role contributes to the success of SOFYNE by designing and implementing robust data pipelines, transforming and modelling data, and delivering insightful dashboards and reports. The Data Analytics Engineer will collaborate with stakeholders across all departments to gather business requirements, design scalable data solutions using Microsoft technologies, and deliver training to empower end users. PRINCIPAL MISSIONS Design and implement data pipelines using Azure Data Factory or Microsoft Fabric. Develop and maintain SQL-based transformations and … data models (e.g., star schema, snowflakes) in SQL Server, Fabric Datawarehouse/Lakehouse. Build and optimize Power BI dashboards and reports to support business decision-making. Collaborate with stakeholders to gather requirements and translate them into technical solutions. Perform basic data analysis using Python (e.g., pandas, matplotlib) when needed. Ensure data quality, governance, and More ❯

Senior Data Engineer (Azure) I am recruiting for a Senior Data Engineer (Azure) to work for a client who is driven by SaaS products and solutions. This is a crucial hands on data engineer role and for someone to come into the business and make an impact. Experience Lead the … design and implementation of robust and scalable data architecture solutions on the Azure platform. Strong Data Warehouse experience, hands-on experience with designing, building, and managing DW ideally using Kimball methodology. Hands on with Azure tooling, expertise in Azure Data Factory ADF (ETL processes), Azure SQL Server, Azure DevOps, Key Vaults, and Logic Apps. Experience in optimizing data loads to ensure reliability, scalability, and high performance, with a focus on reducing processing times and improving efficiency. Data Modelling skills such as proven ability to design efficient and scalable DW architectures, creation of robust staging and production layers. More ❯

to Content Link Select how often (in days) to receive an alert: As part of the Digital Transformation team, you will be helping us build the best shipping data platform and reporting, enabling us to provide accurate and timely insights to the business and our clients. We've been building out a central data platform for … worth. We are now looking for an individual to help scale the platform and accelerate its roll out across the business. What you'll be doing Work with data engineers & analysts to problem solve, build & deliver data products from ideation to production. Lead and own the full lifecycle of data engineering deliverables. Deliver complex … data flows to process external data sources to provide the company with a competitive edge. Act as a consultant to the business to meet their needs. Maintain existing data products to ensure reliability and high data quality to maximise the utility of data within the business. Innovate by recommending opportunities More ❯

Data Engineer London/Hybrid Circa £90k + bonus + benefits Azure, Lakehouse, SQL We’re looking for a Data Engineer with strong hands-on experience in data management and Azure technologies, ideally with a background in MGA or (re)insurance environments. You’ll help design, build, and enhance a … strategic Data Lakehouse platform to support advanced analytics and decision-making. This is a fast-paced, agile role that requires attention to detail, the ability to manage multiple projects, and a collaborative approach to working with regional and group teams. Key Responsibilities: Develop and maintain scalable data solutions on Azure (ADF, Databricks, Synapse, etc. … Maintain and enhance the integrity of the Data Lakehouse in partnership with regional and group data teams. Partner with analytical and reporting teams to ensure data is presented accurately for performance insights. Ensure best practices in data governance, quality, and security Collaborate with business analysts, data scientists, and stakeholders across More ❯

Head of Data & Analytics Architecture and AI page is loaded Head of Data & Analytics Architecture and AI Apply locations Chiswick Park time type Full time posted on Posted 30+ Days Ago job requisition id JR19765 Want to help us bring happiness to the world? Want to join an ambitious and fast growing global biscuits and confectionery … offers global ambition, a clear Vision and roadmap for success, challenge, and unrivalled opportunities to learn and make an impact Click "Apply" to get started. The Head of Data & Analytics Architecture and AI mission has three facets. 1) To own the D&A Architecture ensuring alignment with business objectives and the technology transformation agenda for D&A to … Technology Capability Enhancement: Design and oversee the implementation of the PDP 2.0 Tech stack. Design and oversee data architecture to harmonise external, internal and Microsoft Graph data to deliver AI use cases Champion engineering standards and ensure new engineers' quick integration and productivity. Lead engineering problem solving and provide technical guidance to squad engineers. Foster More ❯

that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … re underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure More ❯

This is an exciting contract opportunity for an SC Cleared Azure Data Engineer with a strong focus on Databricks to join an experienced team in a new customer engagement working at the forefront of data analytics and AI. This role offers the chance to take a key role in the design and delivery of … advanced Databricks solutions within the Azure ecosystem. Responsibilities: Design, build, and optimise end-to-end data pipelines using Azure Databricks, including Delta Live Tables. Collaborate with stakeholders to define technical requirements and propose Databricks-based solutions. Drive best practices for data engineering. Help clients realise the potential of data science … machine learning, and scaled data processing within Azure/Databricks ecosystem. Mentor junior engineers and support their personal development. Take ownership for the delivery of core solution components. Support with planning, requirements refinements, and work estimation. Skills & Experiences: Proven experience designing and implementing data solutions in Azure using Databricks as a core More ❯

Robert Half Technology are assisting a market leading financial services organisation to recruit a Junior Data Engineer. Hybrid working - London based Role The Junior Data Engineer will assist in the design, development, and maintenance of scalable data pipelines and ETL/ELT processes in Azure. Write efficient and reliable SQL queries for data extraction, transformation, and analysis. Support data integration from various sources (internal systems, third-party vendors) into centralised data platforms. Monitor and troubleshoot data jobs and pipelines to ensure consistent and reliable delivery. Collaborate with analytics and reporting teams to deliver high-quality datasets for business intelligence. Participate in code reviews, documentation, and … team discussions as part of a collaborative engineering culture. Ensure data quality, integrity, and security best practices are upheld. Profile The Junior Data Engineer will ideally have a degree in Computer Science, Engineering, Mathematics, or a related field. 1-3 years of experience in a data engineering, data analytics, or software engineering More ❯

Role Description : As a Senior Lead within Software Engineering, you'll design and implement functionalities, focusing on Data Engineering tasks. You'll be working with semi-structured data to ingest and distribute it on a Microsoft Fabric-based platform, modernizing data products and distribution channels. You'll drive the software development lifecycle for continuous … data delivery and lead the evaluation and adoption of emerging technologies. Key Responsibilities : Provide partnership and support to SME's and Tech Leads to ensure delivery on commitments Build and maintain secure and compliant production data processing pipelines on Microsoft fabric and azure to ingest, land and transform data to on data product. Ensure that data pipelines and data stores are high-performing, efficient, organized, and reliable, given a set of business requirements and constraints. Design, implement, monitor, and optimize data platforms to meet the data pipelines needs from functional and non-functional requirements Responsible for data-related implementation tasks More ❯

Company Description Hitachi Solutions Europe is a global Digital, Data and Technology consultancy, Microsoft Gold partner and Cloud Services partner, specialising in end-to-end transformation. As a global consultancy firm working across the private and public sectors, we specialise in Dynamics 365 Business Applications, Power Platform, including Azure, Application Modernisation and Data & Analytics. … practices, ensuring delivery of scalable and efficient solutions. Define high-value business scenarios that can benefit from AI solutions (Machine Learning and Gen AI). Explore and analyse data from various sources and formats using tools such as Microsoft Fabric, Azure Databricks, Azure Synapse Analytics, and Azure Machine Learning Implement data pipelines and workflows to automate and operationalize machine learning solutions using tools such as Azure ML Pipelines, Azure DevOps. Run experiments and monitor performance of machine learning solutions using tools such as Azure Azure ML, and Azure Application Insights. Operationalise and deploy AI solutions, ensuring that coding, security More ❯

Are you an experienced Data Engineer looking to make a real impact in a high-growth, data-driven environment? We're exclusively partnered with a major UK construction and infrastructure company to find a technically strong and collaborative Data Engineer to join their team. Why This Role? This is a chance to shape the … future of data engineering within a business that's investing heavily in its data strategy. With a newly appointed Head of Data and a strong architectural lead in place, you'll be working side-by-side with other data professionals and senior stakeholders to build scalable, modern data solutions that … either in their Central London office or in their Hertfordshire office to collaborate with your team and business stakeholders. What You'll Be Doing: Designing and orchestrating robust data pipelines using Azure Data Factory and Databricks. Ingesting and transforming data from diverse sources including CRM (D365), finance, procurement, and fleet More ❯

Are you an experienced Data Engineer looking to make a real impact in a high-growth, data-driven environment? We're exclusively partnered with a major UK construction and infrastructure company to find a technically strong and collaborative Data Engineer to join their team. Why This Role? This is a chance to shape the … future of data engineering within a business that's investing heavily in its data strategy. With a newly appointed Head of Data and a strong architectural lead in place, you'll be working side-by-side with other data professionals and senior stakeholders to build scalable, modern data solutions that … either in their Central London office or in their Hertfordshire office to collaborate with your team and business stakeholders. What You'll Be Doing: Designing and orchestrating robust data pipelines using Azure Data Factory and Databricks. Ingesting and transforming data from diverse sources including CRM (D365), finance, procurement, and fleet More ❯

Location: Central London (Hybrid - 3 days in office) Salary: Up to £62,000 per annum Contract Type: Fixed Term (18 months) Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're … looking for a hands-on Data Engineer to help build the foundations of their future data estate. This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from … across the organisation - including CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets. You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation. What You'll Be Doing: Design and build robust, automated data pipelines using Azure More ❯

Location: Central London (Hybrid - 3 days in office) Salary: Up to £62,000 per annum Contract Type: Fixed Term (18 months) Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're … looking for a hands-on Data Engineer to help build the foundations of their future data estate. This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from … across the organisation - including CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets. You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation. What You'll Be Doing: Design and build robust, automated data pipelines using Azure More ❯

Location: Central London (Hybrid - 3 days in office) Salary: Up to £62,000 per annum Contract Type: Fixed Term (18 months) Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're … looking for a hands-on Data Engineer to help build the foundations of their future data estate. This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from … across the organisation - including CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets. You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation. What You'll Be Doing: Design and build robust, automated data pipelines using Azure More ❯

Location: Central London (Hybrid - 3 days in office) Salary: Up to £62,000 per annum Contract Type: Fixed Term (18 months) Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're … looking for a hands-on Data Engineer to help build the foundations of their future data estate. This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from … across the organisation - including CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets. You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation. What You'll Be Doing: Design and build robust, automated data pipelines using Azure More ❯

Data Engineer - 18-Month Fixed-Term - London About the Role My client is seeking an experienced Data Engineer to join their Technology team on an 18-month fixed-term contract. You'll play a key role in building and optimising data pipelines, enabling analytics and AI, and integrating enterprise systems like CRM, HR, and … Finance. Key Responsibilities Design and develop scalable data pipelines using Azure Data Factory, dbt, and Synapse Build enriched datasets for Power BI and AI/ML use cases Implement CI/CD workflows Ensure GDPR compliance and secure data handling Requirements: 5+ years in data engineering or Strong … experience with Azure, Databricks, Microsoft Fabric, and Snowflake Proficiency in SQL, Python, and tools like dbt and Airflow Familiarity with DevOps practices in a data context Benefits: Work on impactful, enterprise-wide data projects Collaborate with architects, analysts, and data scientists Be part of a supportive, innovative, and forward-thinking team Competitive More ❯

Data Engineer - 18-Month Fixed-Term - London About the Role My client is seeking an experienced Data Engineer to join their Technology team on an 18-month fixed-term contract. You'll play a key role in building and optimising data pipelines, enabling analytics and AI, and integrating enterprise systems like CRM, HR, and … Finance. Key Responsibilities Design and develop scalable data pipelines using Azure Data Factory, dbt, and Synapse Build enriched datasets for Power BI and AI/ML use cases Implement CI/CD workflows Ensure GDPR compliance and secure data handling Requirements: 5+ years in data engineering or Strong … experience with Azure, Databricks, Microsoft Fabric, and Snowflake Proficiency in SQL, Python, and tools like dbt and Airflow Familiarity with DevOps practices in a data context Benefits: Work on impactful, enterprise-wide data projects Collaborate with architects, analysts, and data scientists Be part of a supportive, innovative, and forward-thinking team Competitive More ❯

support EQ's transition into a stronger, more profitable, product-led business, driven by real insights and the needs of its customers. We are looking for a skilled Data Engineer to join our Data team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines … using Microsoft Fabric and Databricks. You will work closely with our Product and Engineering teams to ensure data flow and integration across our data ecosystem. Your expertise will help us to improve our data infrastructure, improve data quality, and enable data-driven decision-making across the organization. Core Duties and … Data Lake Storage, or other Azure data services Experience with agile development methodologies and version control systems such as Git Certification in Microsoft Azure, Databricks, or other relevant technologies What We Offer Save For Your Future - Equiniti Pension Plan; Equiniti matches your pension contributions up to 10% All Employee Long Term Incentive More ❯

Lead Data Engineer | Location: London (Hybrid - 1-2 day a month in office) | Salary: £90,000-£110,000 | London Market Insurance The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Lead Data Engineer with Insurance … experience to play a key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You … data platform, ensuring adaptability for new data sources, analytical models, and emerging technologies. What You’ll Bring ✅ Extensive hands-on experience with Databricks , and Microsoft Azure data tools (must-have: Azure Data Factory, Azure Synapse, or Azure SQL). ✅ Dimensional modelling expertise More ❯

Lead Data Engineer | Location: London (Hybrid - 1-2 day a month in office) | Salary: £90,000-£110,000 | London Market Insurance The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Lead Data Engineer with Insurance … experience to play a key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You … data platform, ensuring adaptability for new data sources, analytical models, and emerging technologies. What You’ll Bring ✅ Extensive hands-on experience with Databricks , and Microsoft Azure data tools (must-have: Azure Data Factory, Azure Synapse, or Azure SQL). ✅ Dimensional modelling expertise More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration … and optimization of diverse business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or More ❯