1 to 25 of 60 Azure Data Factory Jobs in the City of London

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform … for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. More ❯

customer outcomes. Innovation, continuous improvement, and courage drive them forward in a rapidly evolving industry. What You'll Be Doing Lead and coordinate a team of MI Analysts, Data Analysts, and BI Developers to deliver insightful analysis and reporting supporting business managers. Own the MI, BI, and Analytics function, working with operational leaders to ensure reporting meets business … needs. Ensure compliance with policies, procedures, legislative, and regulatory requirements while maintaining excellent internal customer service. Develop and execute the roadmap for data platforms and reporting solutions. Manage data governance, ensuring data collection, storage, security, and accessibility. Create and implement a MI and BI framework to standardise team practices and ensure data quality. Lead design, implementation, and operation of BI data analysis systems, driving the BI strategy to meet organisational goals. Manage BI/MI lifecycle with business user involvement in design processes, data modelling, and integration. Prioritise and deliver data-driven initiatives and incremental improvements. Optimise the use of commercial and enterprise data More ❯

Job Title: QA Tester – ETL Testing (Informatica) & Azure Data Engineering Location: Westminster, London Type: Full-time Department: Quality Assurance/Data Engineering Reporting to: Data Engineering Lead Job Summary: We are looking for a skilled and detail-oriented QA Tester with hands-on experience in ETL testing (Informatica or Microsoft Fabric) and … a strong understanding of Azure Data Engineering tools such as Azure SQL Database , Azure Blob Storage , and Azure Data Factory . The ideal candidate will possess good hands-on knowledge of writing and executing SQL queries to validate data across systems. Experience in Microsoft … Fabric is considered a strong bonus. Key Responsibilities: Perform ETL/data pipeline testing using Informatica PowerCenter or IICS . Validate data ingestion , transformation , and loading processes across Azure services. Execute source-to-target data validation , data profiling, and data reconciliation. Write and execute complex SQL queries to More ❯

day-to-day life at Clarksons, visit us at www.clarksons.com Role Summary As part of the Digital Transformation team, you will be helping us build the best shipping data platform and reporting, enabling us to provide accurate and timely insights to the business and our clients. We’ve been building out a central data platform for … worth. We are now looking for an individual to help scale the platform and accelerate its roll out across the business. What you’ll be doing Work with data engineers & analysts to problem solve, build & deliver data products from ideation to production. Lead and own the full lifecycle of data engineering deliverables. Deliver complex … data flows to process external data sources to provide the company with a competitive edge. Act as a consultant to the business to meet their needs. Maintain existing data products to ensure reliability and high data quality to maximise the utility of data within the business. Innovate by recommending opportunities More ❯

My client, a leading private capital asset manager, is seeking a talented Data Engineer to join their growing Technology team based in London. As a Data Engineer, you will work at the heart of the firm’s data operations, building robust pipelines, modernising reporting frameworks, and enhancing data automation across business-critical … functions. This is a collaborative, hands-on role interfacing with stakeholders across the business to deliver efficient, scalable data solutions. You’ll join a close-knit and dynamic team with direct exposure to senior leadership and the chance to influence Pollen Street’s data architecture as the firm expands its private credit and equity platforms. Responsibilities … Develop and support data pipelines to ingest, transform and manage data in the data lake and warehouse. Design and deliver insightful MI and BI reports from a variety of sources including SQL databases and Excel. Translate business needs into technical reporting requirements, liaising with users to resolve data queries. Manage and maintain More ❯

Social network you want to login/join with: Data Engineer – Leading Boutique Asset Manager – Discrete Search – Excellent Compensation + Benefits, london (city of london) col-narrow-left Client: Location: london (city of london), United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 26.06.2025 Expiry Date: 10.08.2025 col-wide Job … Description: My client, a leading private capital asset manager, is seeking a talented Data Engineer to join their growing Technology team based in London. As a Data Engineer, you will work at the heart of the firm’s data operations, building robust pipelines, modernising reporting frameworks, and enhancing data automation across business … critical functions. This is a collaborative, hands-on role interfacing with stakeholders across the business to deliver efficient, scalable data solutions. You’ll join a close-knit and dynamic team with direct exposure to senior leadership and the chance to influence Pollen Street’s data architecture as the firm expands its private credit and equity platforms. More ❯

Job Title: Data Engineer (Fabric, Synapse & ADF) Location: Remote (UK-based candidates only) Contract: 3–6 Month Rolling Contract IR35 Status: Outside IR35 Day Rate: £500–£600 per day Overview: We’re looking for an experienced Data Engineer to join a dynamic team working across a variety of exciting data projects. This role involves … position, open to UK-based candidates only, and is offered on an Outside IR35 basis. Key Responsibilities: Design, build, and maintain scalable data pipelines using Microsoft Fabric, Azure Synapse, and Azure Data Factory (ADF). Develop and optimise ETL/ELT processes to support business intelligence and analytics solutions. Collaborate … followed throughout. Troubleshoot performance issues and support existing solutions as needed. Key Skills & Experience: Proven experience as a Data Engineer working in cloud-native environments. Microsoft Fabric Azure Synapse Analytics Azure Data Factory (ADF) Strong understanding of data modelling, ETL/ELT development, and data warehouse More ❯

Senior Data Engineering Consultant - MS Fabric - London - Hybrid - £80k My client are an emerging Microsoft-partnered consultancy looking to expand their data engineering team. If you are an expert data engineer with Microsoft products and a consultancy background, this should be a great fit for you. Salary and Benefits Competitive salary of up to … working (2-3 days in London-based office) Competitive annual leave package Private medical care Health insurance And many more Role and Responsibilities Possess a wide range of data engineering skills, with a focus on having delivered in Microsoft Fabric Develop good working relationships with clients on a project including interpersonal skills with both business and technical focused … colleagues. Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment. Delivering high-quality pieces of work, proven ability to escalate problems to client/senior team members where necessary and propose possible solutions. Support building the Consulting practice through contribution to ongoing initiatives. This can include contributing to knowledge More ❯

Data Engineer London/Hybrid Circa £90k + bonus + benefits Azure, Lakehouse, SQL We’re looking for a Data Engineer with strong hands-on experience in data management and Azure technologies, ideally with a background in MGA or (re)insurance environments. You’ll help design, build, and enhance a … strategic Data Lakehouse platform to support advanced analytics and decision-making. This is a fast-paced, agile role that requires attention to detail, the ability to manage multiple projects, and a collaborative approach to working with regional and group teams. Key Responsibilities: Develop and maintain scalable data solutions on Azure (ADF, Databricks, Synapse, etc. … Maintain and enhance the integrity of the Data Lakehouse in partnership with regional and group data teams. Partner with analytical and reporting teams to ensure data is presented accurately for performance insights. Ensure best practices in data governance, quality, and security Collaborate with business analysts, data scientists, and stakeholders across More ❯

Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to some of the most complex infrastructure projects across the UK and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock … the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at various seniority levels — from experienced engineers to those ready to step into leadership roles. The Role As a Data Engineering Consultant … you will: Collaborate with stakeholders across development, analytics, and business teams to define and implement components of the data landscape in line with strategic data goals Translate business and end-user needs into robust technical solutions, delivery plans, and architectural designs Build and maintain highly automated, scalable data pipelines using modern cloud-based tools More ❯

Senior Data Engineer - 12-Month FTC - Finance and Actuarial Data Integration - Lloyd's Market Overview: This role will provide data engineering expertise to integrate Finance and Actuarial modules into a new Azure Data Platform. The ideal candidate will have deep technical expertise in Azure technologies, SQL Server, and … Finance/Actuarial data processes within insurance, with a focus on delivering solutions while engaging with senior business stakeholders. Key Responsibilities: Develop and implement data solutions on the Microsoft Azure platform (Azure Databricks, Azure SQL Database). Provide technical guidance to the project development team. Bridge communication gaps between offshore … Ensure solutions are properly tested, documented, and meet business needs. Manage tasks and ensure agreed-upon delivery timelines. Key Skills & Experience: Expertise in database design, performance optimization, and data warehousing. Strong experience with Azure data technologies, including Azure Databricks, SQL Database, Data Factory, and T-SQL. In-depth More ❯

My client, a leading multi-strategy hedge fund, is seeking a mid-level Data Engineer to join their dynamic and rapidly growing team based in London. This is an exciting opportunity to join a high-performing investment firm that places technology and innovation at the core of its operations. You’ll play a key role in empowering the … front-office investment team through the delivery of data solutions - enabling informed decision-making across the board. The successful individual will take ownership of MI & BI reporting and data analysis, partnering closely with front-office teams. Your work will support business-critical initiatives through the design, maintenance, and enhancement of ETL pipelines, while also contributing to … the development of automation solutions to streamline key workflows. You’ll also be responsible for: Migrating and enhancing business reports using Power BI Managing data ingestion into the firm’s data lake and data warehouse Troubleshooting data issues, performing log analysis, and owning resolution processes Supporting both manual and automated testing for More ❯

Data Engineer – Tech for Good Location: Hybrid (UK-based) | Full-Time Join a purpose-driven organisation using data to improve public services and protect the public. We’re looking for a Data Engineer to help modernise our clients new data platform, integrate key systems like Microsoft Dynamics 365, and support enterprise-wide … data initiatives. What You’ll Do Integrate new data sources (e.g. D365) into the enterprise data warehouse Design scalable data models and perform source-to-target mapping Build and automate ETL pipelines using SQL, SSIS, and Azure Data Factory Support BI delivery, UAT testing, and project … Other: Power Apps, Power Automate, Python or R About You Experienced Data Engineer with strong ETL, SQL, and data modelling skills Proficient in the Microsoft data stack Confident working in Agile teams and regulated environments Strong communicator with a collaborative, problem-solving mindset Why Join Us? Work in a flexible, supportive, and mission-led More ❯

Data Engineering Manager | Top Brokerage in London | £110,000 - £120,000 Base + Bonus I'm looking for an experienced Data Engineering Manager to join a leading Brokerage in Central London and lead an initial team of 2 Senior Data Engineers. You will be responsible for managing … large-scale data pipelines, ensuring data quality and integrity, and supporting cross-functional teams with reliable and scalable data solutions—primarily using Microsoft Azure, Python, Databricks , as well as the integration of Microsoft Fabric . This role will require 3 days a week onsite in their state of the art office and … will remain a technically hands on role. Key Responsibilities Design, build, and manage scalable data pipelines and ETL/ELT processes in Azure Data Factory , Databricks , and other Azure services. Develop and maintain data models, data lakes, and data warehouses (e.g., Azure More ❯

support EQ's transition into a stronger, more profitable, product-led business, driven by real insights and the needs of its customers. We are looking for a skilled Data Engineer to join our Data team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines … using Microsoft Fabric and Databricks. You will work closely with our Product and Engineering teams to ensure data flow and integration across our data ecosystem. Your expertise will help us to improve our data infrastructure, improve data quality, and enable data-driven decision-making across the organization. Core Duties and … Data Lake Storage, or other Azure data services Experience with agile development methodologies and version control systems such as Git Certification in Microsoft Azure, Databricks, or other relevant technologies What We Offer Save For Your Future - Equiniti Pension Plan; Equiniti matches your pension contributions up to 10% All Employee Long Term Incentive More ❯

Lead Data Engineer | Location: London (Hybrid - 1-2 day a month in office) | Salary: £90,000-£110,000 | London Market Insurance The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Lead Data Engineer with Insurance … experience to play a key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You … data platform, ensuring adaptability for new data sources, analytical models, and emerging technologies. What You’ll Bring ✅ Extensive hands-on experience with Databricks , and Microsoft Azure data tools (must-have: Azure Data Factory, Azure Synapse, or Azure SQL). ✅ Dimensional modelling expertise More ❯

As a Senior Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Airflow, etc.) and automation. The Senior Data Engineer will work closely with the data, Architecture … Business Analyst, Data Stewards to integrate and align requirements, specifications and constraints of each element of the requirement. They will also need to help identify gaps in resources, technology, or capabilities required, and work with the data engineering team to identify and implement solutions where appropriate. Work type: Contract Length: initial 6 months Work structure: hybrid … days a week in London. Primary Responsibilities: Integrate data from multiple on prem and cloud sources and systems. Handle data ingestion, transformation, and consolidation to create a unified and reliable data foundation for analysis and reporting. Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques More ❯

join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by a huge Multi National equity firm who are looking to bolster my client's financial position. They are expected to … and utilise the most in-demand and cutting-edge technology on the market right now. Your role will include: Collaborate closely with stakeholders to understand and interpret their data and analytics needs. Design and deploy end-to-end data solutions using Microsoft Fabric, encompassing data ingestion, transformation, and visualisation workflows. Construct and refine data models, pipelines, and ETL frameworks within the Fabric ecosystem. Leverage Fabric’s suite of tools to build dynamic reports, dashboards, and analytical applications. Maintain high standards of data integrity, consistency, and system performance across the data environment. Advise on data governance, security protocols, and compliance strategies aligned with industry best practices. Diagnose and More ❯

Social network you want to login/join with: Azure Data Architect, london (city of london) col-narrow-left Client: Amber Labs Location: london (city of london), United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 2 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: The Company: At Amber … analysts, and support staff. Mostly remote some Ad hoc travel (London) Eligble for BPSS or SC clearance Digital Transformation Project About the Role: We are seeking highly skilled Azure Data Architects who have worked for the NHS to join our dynamic team. In this role, you will be responsible for designing and implementing end-to-end … healthcare applications. Knowledge of NHS Digital initiatives, including Shared Care Records, the NHS App, and Population Health projects. Certifications in Azure Data Architecture (Microsoft Certified: Azure Solutions Architect, DP-203, DP-900, etc.). Competitive salary and performance-based bonus structure. Join a rapidly expanding start-up where personal growth is a part of More ❯

Manager, Data & Analytics, Global Insight (London-based) Hybrid working – Central London office Salary and benefits in line with industry Job Reference J12978 Reporting to: VP, Data & Analytics (New York) About Fremantle Join the place creatives call home! Fremantle is a world leader in creating, producing and distributing across Entertainment, Drama, Film and Documentary content. Our formats … all that we do. The Role and the team Fremantle’s Global Insight Department plays a pivotal role in analysing performance metrics, audience behaviours, and content trends. The Data & Analytics team within this department is responsible for developing and maintaining the company’s performance data infrastructure and delivering actionable insights across a wide range of business … areas using Microsoft Fabric, Power BI, Azure Data Factory and other tools. We are looking for a Manager, Data & Analytics to lead a London-based team within our Insights division, reporting directly to the VP of Data & Analytics based in New York. This is a newly created role designed to More ❯

Manager, Data & Analytics, Global Insight (London-based) Hybrid working – Central London office Salary and benefits in line with industry Job Reference J12978 Reporting to: VP, Data & Analytics (New York) About Fremantle Join the place creatives call home! Fremantle is a world leader in creating, producing and distributing across Entertainment, Drama, Film and Documentary content. Our formats … all that we do. The Role and the team Fremantle’s Global Insight Department plays a pivotal role in analysing performance metrics, audience behaviours, and content trends. The Data & Analytics team within this department is responsible for developing and maintaining the company’s performance data infrastructure and delivering actionable insights across a wide range of business … areas using Microsoft Fabric, Power BI, Azure Data Factory and other tools. We are looking for a Manager, Data & Analytics to lead a London-based team within our Insights division, reporting directly to the VP of Data & Analytics based in New York. This is a newly created role designed to More ❯

Social network you want to login/join with: Senior Data Engineer (FTC), london (city of london) col-narrow-left Client: Location: london (city of london), United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 6 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Job Title: Senior Data Engineer … FTC Location: London/Hybrid (2 days per week onsite) Salary: Competative market rate + bonus + benefits Why Apply? This is an exciting opportunity for an experienced Azure Data Engineer to play a key role in delivering the next phase of a business-critical data programme. You'll apply your technical expertise across … Azure Databricks, Data Factory, Azure SQL, and SQL Server, contributing directly to the integration of financial data into a new Azure Data Platform. Responsibilities: Design, build and optimise scalable data solutions using Azure cloud technologies. Lead the development of data More ❯

Xcede is excited to be partnering with a leading global consultancy to grow their Data Engineering capability across the UK. They’re hiring a Data Engineering Consultant to join their dynamic, fast-growing Data & Analytics team. You’ll work on high-impact infrastructure projects, designing and building scalable cloud data solutions that … enable clients to unlock real value from their data assets. 🔧 Tech you’ll be working with: • Azure Data Factory, Data Lake, Synapse, Databricks • SQL, Python, Spark, DAX • Azure DevOps, CI/CD, Git • Bonus: MLflow, Kubernetes, Kimball modelling, MLOps 🧠 What you’ll do: • Build & maintain modern cloud-based … data pipelines • Translate business needs into scalable data solutions • Solve data quality issues and improve infrastructure • Collaborate with cross-functional teams • Mentor others and shape team best practices 💡 Why join? You’ll be part of a forward-thinking team working on some of the most exciting infrastructure projects in the world. Expect great tech More ❯

Xcede is excited to be partnering with a leading global consultancy to grow their Data Engineering capability across the UK. They’re hiring a Senior Data Engineering Consultant to join their dynamic, fast-growing Data & Analytics team. You’ll work on high-impact infrastructure projects, designing and building scalable cloud data solutions … that enable clients to unlock real value from their data assets. 🔧 Tech you’ll be working with: • Azure Data Factory, Data Lake, Synapse, Databricks • SQL, Python, Spark, DAX • Azure DevOps, CI/CD, Git • Bonus: MLflow, Kubernetes, Kimball modelling, MLOps 🧠 What you’ll do: • Build & maintain modern cloud … based data pipelines • Translate business needs into scalable data solutions • Solve data quality issues and improve infrastructure • Collaborate with cross-functional teams • Mentor others and shape team best practices 💡 Why join? You’ll be part of a forward-thinking team working on some of the most exciting infrastructure projects in the world. Expect great More ❯

Xcede is excited to be partnering with a leading global consultancy to grow their Data Engineering capability across the UK. They’re hiring a Principal Data Engineering Consultant to join their dynamic, fast-growing Data & Analytics team. You’ll work on high-impact infrastructure projects, designing and building scalable cloud data solutions … that enable clients to unlock real value from their data assets. 🔧 Tech you’ll be working with: • Azure Data Factory, Data Lake, Synapse, Databricks • SQL, Python, Spark, DAX • Azure DevOps, CI/CD, Git • Bonus: MLflow, Kubernetes, Kimball modelling, MLOps 🧠 What you’ll do: • Build & maintain modern cloud … based data pipelines • Translate business needs into scalable data solutions • Solve data quality issues and improve infrastructure • Collaborate with cross-functional teams • Mentor others and shape team best practices 💡 Why join? You’ll be part of a forward-thinking team working on some of the most exciting infrastructure projects in the world. Expect great More ❯