22 of 22 Azure Data Factory Jobs in the City of London

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform … for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. More ❯

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform … for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. More ❯

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Data Engineer with Insurance experience to play a … key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You’ll help shape the … data platform, ensuring adaptability for new data sources, analytical models, and emerging technologies. What You’ll Bring ✅ Extensive hands-on experience with Databricks , and Microsoft Azure data tools (must-have: Azure Data Factory, Azure Synapse, or Azure SQL). ✅ Dimensional modelling/ More ❯

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Data Engineer with Insurance experience to play a … key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You’ll help shape the … data platform, ensuring adaptability for new data sources, analytical models, and emerging technologies. What You’ll Bring ✅ Extensive hands-on experience with Databricks , and Microsoft Azure data tools (must-have: Azure Data Factory, Azure Synapse, or Azure SQL). ✅ Dimensional modelling/ More ❯

Lead Data Engineer (Azure Stack) £95k + 10% bonus Hybrid – 1 day a week Central London I’m helping a growing fintech find their next Lead Data Engineer, they are looking for someone who loves building modern data platforms in Azure and wants to make a genuine impact. This role … by allowing you to lead from the front while staying hands-on with the tech. You’ll shape the architecture, mentor the team, and help drive a modern, data-driven culture all within a collaborative environment that values innovation and ownership. Tech you’ll be working with: Azure Data Lake Azure Synapse … Databricks Data Factory Python, SQL, PySpark Terraform, GitHub Actions, CI/CD pipelines You’ll thrive here if you: Have strong experience building and leading Azure-based data platforms Enjoy mentoring and guiding other engineers Love designing scalable, automated data pipelines Bring a hands-on approach and enjoy problem-solving More ❯

Lead Data Engineer (Azure Stack) £95k + 10% bonus Hybrid – 1 day a week Central London I’m helping a growing fintech find their next Lead Data Engineer, they are looking for someone who loves building modern data platforms in Azure and wants to make a genuine impact. This role … by allowing you to lead from the front while staying hands-on with the tech. You’ll shape the architecture, mentor the team, and help drive a modern, data-driven culture all within a collaborative environment that values innovation and ownership. Tech you’ll be working with: Azure Data Lake Azure Synapse … Databricks Data Factory Python, SQL, PySpark Terraform, GitHub Actions, CI/CD pipelines You’ll thrive here if you: Have strong experience building and leading Azure-based data platforms Enjoy mentoring and guiding other engineers Love designing scalable, automated data pipelines Bring a hands-on approach and enjoy problem-solving More ❯

Data Developer (Microsoft Fabric/Azure) Location: Essex or Southampton (on-site, parking available) Salary: £45,000 - £56,000 per annum The Opportunity La Fosse is partnering with a leading global logistics organisation on an exciting data transformation project. We’re seeking an experienced Data Developer to join a new three-person … data team within Operations, focused on supporting and enhancing Terminal Operating Systems. This role will play a key part in the company’s migration from QlikView to Microsoft Fabric, helping to design and deliver the next generation of their data environment using Azure technologies. Key Responsibilities Lead and support the QlikView → Microsoft Fabric migration … Build and maintain ETL processes and data pipelines Develop scalable solutions in Azure Data Factory and Microsoft Fabric Create insightful Power BI dashboards and visualisations Write and optimise SQL queries to support reporting and analytics Collaborate across teams to enhance data quality and governance Key Requirements Proven Microsoft Fabric and More ❯

Data Developer (Microsoft Fabric/Azure) Location: Essex or Southampton (on-site, parking available) Salary: £45,000 - £56,000 per annum The Opportunity La Fosse is partnering with a leading global logistics organisation on an exciting data transformation project. We’re seeking an experienced Data Developer to join a new three-person … data team within Operations, focused on supporting and enhancing Terminal Operating Systems. This role will play a key part in the company’s migration from QlikView to Microsoft Fabric, helping to design and deliver the next generation of their data environment using Azure technologies. Key Responsibilities Lead and support the QlikView → Microsoft Fabric migration … Build and maintain ETL processes and data pipelines Develop scalable solutions in Azure Data Factory and Microsoft Fabric Create insightful Power BI dashboards and visualisations Write and optimise SQL queries to support reporting and analytics Collaborate across teams to enhance data quality and governance Key Requirements Proven Microsoft Fabric and More ❯

/Engineer Location: 3 Days p/w Central London Rate: £450 Outside IR35 Duration: 6 Months + Extensions This role is responsible for migrating and developing modern data and analytics solutions using Microsoft Fabric and Azure technologies. The position supports enterprise-wide BI initiatives, delivering data models, pipelines, dashboards and reporting assets that … enable data-driven decision-making. Key Responsibilities Lead and implement data migration into Microsoft Fabric for analytics and reporting use cases Design and build data models from multiple sources to generate actionable insights Maintain and optimise data warehouse platforms; identify and resolve issues Develop data pipelines using Fabric Pipelines, Azure Data Factory, Notebooks and SSIS Produce enterprise-grade Power BI dashboards and paginated reports Translate business requirements into scalable technical BI solutions Write advanced SQL for Fabric Lakehouse and Warehouse environments Implement CI/CD processes using Azure DevOps for secure, reliable deployment Technical Skills: Strong expertise in: Power BI and paginated More ❯

Senior Data Consultant Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that specialises in modern data platforms. You’ll be … working with well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Senior Data Consultant, you will be designing and delivering cutting-edge solutions across Azure Data services, Microsoft Fabric, and Databricks. This is a hands-on role where you’ll lead … from the front, working on enterprise projects that shape the future of data platforms. What you’ll be doing: Leading the design and implementation of modern data platform solutions for enterprise customers. Building and optimising data pipelines using Azure Data Factory , Microsoft Fabric, Synapse and Databricks . Guiding More ❯

Contract Role Remote Working £600 - £700, Inside IR35 We're partnering with a Global IT Partner who are looking for a Databricks Solution Architect to provide guidance on data architecture and design and optimise Databricks solutions. As a Databricks Solution Architect, you will be responsible for: Lead end-to-end architecture of data lakes to Azure with a core focus on Databricks Provide technical leadership on Databricks Design and implement data pipelines in Azure Databricks, optimizing for performance, cost, and scalability Advise of data lake migration, data modelling and pipeline optimisation Refactor and modernize existing data models to integrate with Power BI Coordinate phased … migrations to ensure zero disruption to live operations Replace legacy tools by consolidating workflows within Databricks and native Azure services Requirements: 10+ years in cloud architecture/engineering with a strong focus on building scalable data pipelines Expertise in Azure Databricks (7+years) including building and managing ETL pipelines using PySpark or Scala (essential) Solid More ❯

Our client are building a custom AI platform from the ground up - no off-the-shelf solutions, no shortcuts. To power this, they need a skilled Azure AI Data Engineer to design and build robust ETL pipelines that enable seamless communication between structured and unstructured data systems. What You'll Be Doing Architecting and … developing scalable ETL pipelines using Azure Data Factory, Synapse, and related tools. Integrating structured (SQL, relational) and unstructured (NoSQL, blob storage, document stores) data sources. Enabling real-time and batch data flows to support AI-driven applications. Collaborating with AI engineers to ensure data readiness for model training … and inference. Driving best practices in data governance, security, and performance optimisation. What We're Looking For Strong experience with Azure cloud services, especially Data Factory, Synapse, Databricks, and Azure Functions. Proficiency in Python, SQL, and data transformation techniques. Experience working with both structured and unstructured data More ❯

more than just a media agency; we are people people . At our core lies a commitment to understanding, trust, integrity, and delivering results. With a focus on data-driven decision-making, we have built a reputation for driving tangible outcomes for our clients. As an employee-owned organisation, we value our team members' contributions and provide them … s future. Join us, and let's create meaningful change together. The Role As an AI Engineer, you will head up the design, build, and optimisation of our data infrastructure, automation solutions, and AI-driven tools. Leading Data Architecture, MarTech, AI & Automation, you will ensure that data flows seamlessly across the business and is … harnessed effectively to drive client performance. This role requires a mix of technical expertise, leadership, and client-facing skills. You will manage and develop team members, oversee data engineering projects, and take ownership of the agency's core data pipelines and platforms using Artificial Intelligence. You will also play a key role in exploring and embedding More ❯

are more than just a media agency; we are people people. At our core lies a commitment to understanding, trust, integrity, and delivering results. With a focus on data-driven decision-making, we have built a reputation for driving tangible outcomes for our clients. As an employee-owned organisation, we value our team members' contributions and provide them … s future. Join us, and let’s create meaningful change together. The Role As an AI Engineer, you will head up the design, build, and optimisation of our data infrastructure, automation solutions, and AI-driven tools. Leading Data Architecture, MarTech, AI & Automation, you will ensure that data flows seamlessly across the business and is … harnessed effectively to drive client performance. This role requires a mix of technical expertise, leadership, and client-facing skills. You will manage and develop team members, oversee data engineering projects, and take ownership of the agency’s core data pipelines and platforms using Artificial Intelligence. You will also play a key role in exploring and embedding More ❯

Senior Data Engineer - Azure, Healthcare A Global Healthcare Leader based in Burton Upon Trent is currently searching for a Senior Data Engineer to help support a greenfield implementation of Databricks and further support the advancement of their modern data platform. The successful applicant will work closely with the Director of Analytics and … Strategic Data Manager and be responsible for implementing data pipelines in Azure Data Factory and Azyre Databricks, supporting Darewhaoure implementation and ETL process. Location: Hybrid in London Salary: £55,000 to £65,000 + Benefits To be considered: Minimum 3 years of experience working as a Data Engineer … within an Azure Environment. Prior experience working with Azure Databricks. Strong programming skills in Python, C# or .Net. Experience deploying CI/CD pipelines with Azure DevOps. Excellent communication skills, both written and verbal. This is one not to be missed, if interested, please apply via the link below. More ❯

Senior Data Engineer - Azure, Healthcare A Global Healthcare Leader based in Burton Upon Trent is currently searching for a Senior Data Engineer to help support a greenfield implementation of Databricks and further support the advancement of their modern data platform. The successful applicant will work closely with the Director of Analytics and … Strategic Data Manager and be responsible for implementing data pipelines in Azure Data Factory and Azyre Databricks, supporting Darewhaoure implementation and ETL process. Location: Hybrid in London Salary: £55,000 to £65,000 + Benefits To be considered: Minimum 3 years of experience working as a Data Engineer … within an Azure Environment. Prior experience working with Azure Databricks. Strong programming skills in Python, C# or .Net. Experience deploying CI/CD pipelines with Azure DevOps. Excellent communication skills, both written and verbal. This is one not to be missed, if interested, please apply via the link below. More ❯

Are you an experienced Data Analyst looking for your next opportunity in the insurance sector? **Insurance industry experience is essential** In this role, you’ll be involved in onboarding new insurance programs, enhancing data integration, and delivering impactful insights through advanced reporting tools. This is a fantastic opportunity to work in a high-performing, collaborative team … environment with the flexibility of a hybrid working model in Central London. Key Responsibilities: Design and implement ETL pipelines for data lakes, data warehouses, ODS, and data marts Collaborate with business and technical teams to onboard new insurance programs Cleanse, profile, and validate large data sets to ensure quality and consistency Develop … and maintain advanced reporting tools to support business insights Contribute to the growth and optimisation of the enterprise data infrastructure Required Experience: Insurance industry experience is essential 5+ years of hands-on ETL experience across data integration architectures Strong expertise in SQL, Azure Data Factory, JSON, XML, and Dataflows Proven More ❯

around £500/day Starting ASAP for 6 months - likely to extend About the Role We’re partnering with a financial client that’s undertaking a large-scale data transformation, modernising legacy systems and building a unified analytics platform in the cloud. As part of this initiative, you’ll play a key role in developing and optimising a … Snowflake-based data warehouse and delivering high-quality visualisations and reporting through Power BI. The role offers the chance to work on greenfield architecture, migrate legacy SQL Server solutions and collaborate closely with senior stakeholders on complex, high-impact data initiatives. What You’ll Be Doing Design, develop and maintain data pipelines and models … using Snowflake, dbt and Python. Enhance and support Power BI dashboards and data models, ensuring performance, accuracy and user accessibility. Contribute to the migration of legacy SQL Server (SSIS/SSAS/SSRS) systems into a modern Snowflake/Power BI environment. Work collaboratively with business users to understand requirements, translate them into technical solutions and deliver robust More ❯

. In this role, you’ll design and develop BI solutions that deliver meaningful insights to teams across underwriting, claims, actuarial, and finance. Your deep understanding of insurance data—particularly bordereaux, policy, and claims data in the Lloyd’s and London Market—is essential. What You’ll Do Build and maintain advanced Power BI dashboards and … visual reports Write and optimise complex SQL queries , stored procedures, and ETL workflows Translate business needs into technical BI solutions by working closely with stakeholders Model and structure data for analytics aligned with London Market standards Integrate and reconcile data from multiple sources including bordereaux and third-party feeds Ensure data quality and compliance … through validation and governance processes Deliver insights to support performance monitoring, profitability, and risk analysis Maintain and enhance existing BI solutions to improve scalability and efficiency Support broader data initiatives including governance and documentation What We’re Looking For Technical Skills Expertise in Power BI (DAX, Power Query) and building impactful dashboards Advanced SQL (T-SQL preferred) for More ❯

. In this role, you’ll design and develop BI solutions that deliver meaningful insights to teams across underwriting, claims, actuarial, and finance. Your deep understanding of insurance data—particularly bordereaux, policy, and claims data in the Lloyd’s and London Market—is essential. What You’ll Do Build and maintain advanced Power BI dashboards and … visual reports Write and optimise complex SQL queries , stored procedures, and ETL workflows Translate business needs into technical BI solutions by working closely with stakeholders Model and structure data for analytics aligned with London Market standards Integrate and reconcile data from multiple sources including bordereaux and third-party feeds Ensure data quality and compliance … through validation and governance processes Deliver insights to support performance monitoring, profitability, and risk analysis Maintain and enhance existing BI solutions to improve scalability and efficiency Support broader data initiatives including governance and documentation What We’re Looking For Technical Skills Expertise in Power BI (DAX, Power Query) and building impactful dashboards Advanced SQL (T-SQL preferred) for More ❯

Back End Integration Engineer ?? London (Hybrid) | ?? Full-time | ?? Permanent | ?? Competitive + Excellent Benefits Reports To: Data Engineering Manager ?? Join us on Our Digital Transformation Journey! We're building a cutting-edge suite of automation and data services to power the next phase of growth in the insurance market. Now, we're on the hunt for a … experienced in integration and automation within a cloud environment - we want to hear from you . ????? What You'll Be Doing You'll be part of our growing Data and Engineering team, working on exciting, high-impact projects across the entire business. You'll help design, build, and optimise applications and integration solutions that streamline our systems and … a fast-paced, agile, and ever-evolving tech environment. ? Essential Skills: Strong experience in application and integration design , including microservices architecture and API lifecycle management . Proficiency in Microsoft Azure services: API Management, Service Bus, Logic Apps, Azure Functions WebApps, Storage, Networking, Security (RBAC, OAuth, SAML) Solid software development experience with: C# (.NET/.NET Core More ❯

enterprise-scale systems. Role & Responsibilities: Lead the design and delivery of enterprise applications and reporting systems Develop tools for dashboards, analytics, and operational monitoring Build and maintain APIs, data pipelines, and automation for business processes Implement scalable solutions to improve operational efficiency and data quality Enhance and integrate commercial off-the-shelf (COTS) platforms where required … Skills & Experience: 8+ years in software development within financial services or other complex enterprise environments is a must have Skilled in C#, .NET Core, Angular (v17+), SQL Server, Azure, microservices, and Power BI Experience in unit testing, test automation, and Agile delivery Knowledge of compliance, regulatory reporting, and enterprise operational processes Proven experience delivering complex software solutions Strong … leadership and stakeholder management skills Bonus: Python, Azure Data Factory/Databricks, data analysis, and COTS platforms Package: £85,000 15% non-contributory pension Hybrid working (3 days per week) Performance-based bonus scheme Comprehensive benefits package including pension, healthcare, and wellbeing support Senior Software Developer | £85,000 | London | Financial Services More ❯