Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Essential Skills & Experience: 10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks. Strong proficiency in Python and Spark (PySpark) or Scala. Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns. Extensive experience with Azuredata services, including AzureDataFactory, Azure Blob Storage, and Azure SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and … data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality and data governance processes. Experience with version control systems (e.g., Git). Experience with Agile development methodologies. Excellent communication, interpersonal, and problem-solving skills. Experience with streaming dataMore ❯
Prestigious opportunity for a Data Platform Engineer within a pioneering technology team based in Manchester. Following a period of significant growth, investment and a cloud transformation, we are inviting you to join our success story! As our AzureData Platform Engineer, you will be responsible for:- Designing, building, and maintaining scalable data solutions on Microsoft Azure. Designing and implementing scalable data pipelines using AzureDataFactory, Databricks, Synapse Analytics, and other Azure services. Leading technical workstreams and supporting project delivery. Acting as the subject-matter expert for cloud-based data engineering. Ensure data governance, security, and … compliance standards are met. Monitoring and troubleshooting data platform performance and issues. Automate data ingestion, transformation, and integration processes. Document technical solutions and maintain best practices. If you possess a combination of some of the following skills, then LETS TALK! Proven experience with Azuredata services (SQL, DataFactoryMore ❯
Sheffield, South Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Erin Associates
Data Architect Remote £65,000 - £72,000 + bonus, 35-hour work week and great benefits This market-leading and growing business having created a brand-new Data Architect position, that would suit a technical expert that can take the lead for all things data architecture, offering suggestions for investment and implementing new tech. … You will be ambitious and open to expanding and developing a robust architecture capability. As a Data Architect, you will ensure that the companys internal data architecture meets the current and future needs of the business. Your role will see you transform and use data to provide valuable insights, contribute to decision-making and … provide a competitive advantage. As a Data Leader, you will ensure best practices and adherence to architectural principles whilst creating and maintaining detailed documentation of data architecture and data assets. The role will be remote based, with the expectation of one day per month in central Leeds. This can be expensed for candidates that More ❯
South Yorkshire, England, United Kingdom Hybrid / WFH Options
Erin Associates
Data Architect – Remote £65,000 - £72,000 + bonus, 35-hour work week and great benefits This market-leading and growing business having created a brand-new Data Architect position, that would suit a technical expert that can take the lead for all things data architecture, offering suggestions for investment and implementing new tech. … You will be ambitious and open to expanding and developing a robust architecture capability.As a Data Architect, you will ensure that the company’s internal data architecture meets the current and future needs of the business. Your role will see you transform and use data to provide valuable insights, contribute to decision-making and … provide a competitive advantage. As a Data Leader, you will ensure best practices and adherence to architectural principles whilst creating and maintaining detailed documentation of data architecture and data assets.The role will be remote based, with the expectation of one day per month in central Leeds. This can be expensed for candidates that live More ❯
Principal Data Engineer - hyrbid (Leeds) - £70k-£80k Are you an experienced AzureData Engineer looking to make an impact in an established financial insitution. We are seeking a hands-on professional to join a high-performing team tasked with building and enhancing a modern Azuredata platform, with an expertise … in Databricks. About the Role: In this role, you will play a key part in developing ETL pipelines, optimizing data integration processes, and supporting data-driven decision-making across the business. You'll collaborate with stakeholders to understand data requirements, contribute to architectural decisions, and support the migration of reporting services to Azure. Key … Responsibilities: Design, build, and maintain ETL pipelines using AzureDataFactory , AzureData Lake , Synapse , and Databricks . Design and build a greenfield Azuredata platform to support business-critical data needs. Collaborate with stakeholders across the organization to gather and define dataMore ❯
Data Engineers - Permanent Opportunity Based in Reading: 1-2 days per week A major UK organization is expanding their Data Engineering team to drive forward their ambitious data platform transformation initiative. Are you an experienced Data Engineer ready to tackle complex data challenges at scale? This established organization is building … their next-generation Enterprise Data Platform and needs skilled professionals to accelerate their journey toward becoming a data-centric organisation. About Our Client Our client operates critical infrastructure serving millions of customers across the UK. They're investing significantly in modernizing their data capabilities, creating a centralized data lakehouse architecture that will … engagement abilities across technical and business audiences Strong relationship-building skills with experience managing diverse internal customers Demonstrated success working within cross-functional project teams Additional Valuable Experience MicrosoftAzureData Engineering certifications (MCSA or equivalent) Azure Fundamentals knowledge and certification Exposure to industry standards frameworks (ISO certifications, ITIL practices) Previous experience in regulated More ❯
Hertfordshire, United Kingdom Hybrid / WFH Options
Tenth Revolution Group
Are you an experienced Data Engineer looking to make a real impact in a high-growth, data-driven environment? We're exclusively partnered with a major UK construction and infrastructure company to find a technically strong and collaborative Data Engineer to join their team. Why This Role? This is a chance to shape the … future of data engineering within a business that's investing heavily in its data strategy. With a newly appointed Head of Data and a strong architectural lead in place, you'll be working side-by-side with other data professionals and senior stakeholders to build scalable, modern data solutions that … either in their Central London office or in their Hertfordshire office to collaborate with your team and business stakeholders. What You'll Be Doing: Designing and orchestrating robust data pipelines using AzureDataFactory and Databricks. Ingesting and transforming data from diverse sources including CRM (D365), finance, procurement, and fleet More ❯
Are you an experienced Data Engineer looking to make a real impact in a high-growth, data-driven environment? We're exclusively partnered with a major UK construction and infrastructure company to find a technically strong and collaborative Data Engineer to join their team. Why This Role? This is a chance to shape the … future of data engineering within a business that's investing heavily in its data strategy. With a newly appointed Head of Data and a strong architectural lead in place, you'll be working side-by-side with other data professionals and senior stakeholders to build scalable, modern data solutions that … either in their Central London office or in their Hertfordshire office to collaborate with your team and business stakeholders. What You'll Be Doing: Designing and orchestrating robust data pipelines using AzureDataFactory and Databricks. Ingesting and transforming data from diverse sources including CRM (D365), finance, procurement, and fleet More ❯
Leeds, West Yorkshire, United Kingdom Hybrid / WFH Options
Tenth Revolution Group
AzureData Engineer - Leeds (Hybrid) - £65,000 Are you an experienced AzureData Engineer with a passion for building scalable, cloud-native data solutions? We're recruiting on behalf of a dynamic organisation in Leeds that's investing in its data platform - and they're looking for someone … with strong Databricks expertise to join their team. About the role: Designing and developing robust data pipelines using AzureDataFactory, Databricks, and Synapse Analytics. Working with Delta Lake and AzureData Lake Storage to manage and optimise large datasets. Collaborating with data analysts, engineers, and … business stakeholders to deliver clean, reliable data. Supporting the migration of legacy systems to a modern Azure-based architecture Ensuring best practices in data governance, security, and performance tuning Requirements: Proven experience with AzureData Services (ADF, Synapse, Data Lake) Strong hands-on experience with Databricks (including PySpark or SQL More ❯
Role: Azure AI DevOps Engineer Salary: £50,000 Location: London or remote Benefits: Healthcare and great holidays The Role As a Machine Learning Operations Engineer, you will be instrumental in designing, deploying, and maintaining machine learning systems that drive data-driven decision-making in the pensions and financial services sector. Using Azure's cloud … ecosystem, you will build scalable ML workflows that support actuarial modelling, risk prediction, and client insight generation. Key Responsibilities 1. Azure-Based Machine Learning Development * Collaborate with domain experts and analysts to design and implement machine learning models that predict key outcomes such as life expectancy, investment return scenarios, and financial risks. * Deploy and manage ML solutions using … Azure Machine Learning (Azure ML), covering training, testing, and deployment to production. * Select appropriate ML techniques (e.g., classification, regression, ensemble methods, survival models) to improve predictions and automate core processes. 2. MLOps & Model Lifecycle Management * Own the end-to-end ML lifecycle using Azure ML pipelines, DataFactory (ADF), and More ❯
Role: Azure AI DevOps Engineer Salary: £50,000 Location: London or remote Benefits: Healthcare and great holidays The Role As a Machine Learning Operations Engineer, you will be instrumental in designing, deploying, and maintaining machine learning systems that drive data-driven decision-making in the pensions and financial services sector. Using Azure's cloud … ecosystem, you will build scalable ML workflows that support actuarial modelling, risk prediction, and client insight generation. Key Responsibilities 1. Azure-Based Machine Learning Development * Collaborate with domain experts and analysts to design and implement machine learning models that predict key outcomes such as life expectancy, investment return scenarios, and financial risks.* Deploy and manage ML solutions using … Azure Machine Learning (Azure ML), covering training, testing, and deployment to production.* Select appropriate ML techniques (e.g., classification, regression, ensemble methods, survival models) to improve predictions and automate core processes. 2. MLOps & Model Lifecycle Management * Own the end-to-end ML lifecycle using Azure ML pipelines, DataFactory (ADF), and More ❯
Location: Central London (Hybrid - 3 days in office) Salary: Up to £62,000 per annum Contract Type: Fixed Term (18 months) Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're … looking for a hands-on Data Engineer to help build the foundations of their future data estate. This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from … across the organisation - including CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets. You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation. What You'll Be Doing: Design and build robust, automated data pipelines using AzureMore ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Tenth Revolution Group
Location: Central London (Hybrid - 3 days in office) Salary: Up to £62,000 per annum Contract Type: Fixed Term (18 months) Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're … looking for a hands-on Data Engineer to help build the foundations of their future data estate. This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from … across the organisation - including CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets. You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation. What You'll Be Doing: Design and build robust, automated data pipelines using AzureMore ❯
Location: Central London (Hybrid - 3 days in office) Salary: Up to £62,000 per annum Contract Type: Fixed Term (18 months) Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're … looking for a hands-on Data Engineer to help build the foundations of their future data estate. This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from … across the organisation - including CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets. You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation. What You'll Be Doing: Design and build robust, automated data pipelines using AzureMore ❯
South West London, London, England, United Kingdom Hybrid / WFH Options
Tenth Revolution Group
Location: Central London (Hybrid - 3 days in office) Salary: Up to £62,000 per annum Contract Type: Fixed Term (18 months) Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're … looking for a hands-on Data Engineer to help build the foundations of their future data estate. This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from … across the organisation - including CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets. You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation. What You'll Be Doing: Design and build robust, automated data pipelines using AzureMore ❯
Stratford-upon-avon, Warwickshire, United Kingdom Hybrid / WFH Options
Big Red Recruitment
Like data and love solving problems? Want to work on a number of new and exciting data projects and help deliver a BI & Data strategy for a growing organisation? You're probably looking for a role that challenges you daily, a role where your efforts aren't focused mostly on maintenance and support. You … want to be working on varied data projects and utilising the full set of your technology skills whilst driving new areas like Azure/cloud, and all the new tools to play with - AzureDataFactory, Azure Databricks - what about AI? In this predominantly remote you will help … create, mature, and grow, a data estate designing and creating modern data platforms to fundamentally transform the data environment. The projects are varied, from setting up new data pipelines, integration/ETL across all the different disparate business systems and all the relevant data flows to BI strategy around AI. More ❯
This is an exciting contract opportunity for an SC Cleared AzureData Engineer with a strong focus on Databricks to join an experienced team in a new customer engagement working at the forefront of data analytics and AI. This role offers the chance to take a key role in the design and delivery of … advanced Databricks solutions within the Azure ecosystem. Responsibilities: Design, build, and optimise end-to-end data pipelines using Azure Databricks, including Delta Live Tables. Collaborate with stakeholders to define technical requirements and propose Databricks-based solutions. Drive best practices for data engineering. Help clients realise the potential of data science … machine learning, and scaled data processing within Azure/Databricks ecosystem. Mentor junior engineers and support their personal development. Take ownership for the delivery of core solution components. Support with planning, requirements refinements, and work estimation. Skills & Experiences: Proven experience designing and implementing data solutions in Azure using Databricks as a core More ❯
Interim Data Workstream Lead – 3-Month Contract (Outside IR35) Location: UK-based/Remote Rate: Up to £500 per day | Outside IR35 Duration: 3 months initially Start: ASAP We’re working with a public sector organisation undergoing a major transformation programme and are looking for a contractor to lead the data workstream. This role will suit … a generalist with strong experience across Azuredata services, data migration and transformation, and governance in a programme-led environment. You’ll take ownership of all data-related activity, working closely with technical teams and business leads to ensure high-quality delivery and alignment with wider programme goals. Key Responsibilities: Define and … lead the delivery of the data workstream, including scope, timelines, and outcomes Manage end-to-end data migration and transformation—legacy analysis, mapping, cleansing and load Implement and oversee data solutions using Azure-based services (e.g. Synapse, DataFactory, Data Lake, Purview) Ensure robust dataMore ❯
South East London, London, United Kingdom Hybrid / WFH Options
Datatech Analytics
Manager, Data & Analytics, Global Insight (London-based) Hybrid working - Central London office Salary and benefits in line with industry Job Reference J12978 Reporting to: VP, Data & Analytics (New York) About Fremantle Join the place creatives call home! Fremantle is a world leader in creating, producing and distributing across Entertainment, Drama, Film and Documentary content. Our formats … all that we do. The Role and the team Fremantle's Global Insight Department plays a pivotal role in analysing performance metrics, audience behaviours, and content trends. The Data & Analytics team within this department is responsible for developing and maintaining the company's performance data infrastructure and delivering actionable insights across a wide range of business … areas using Microsoft Fabric, Power BI, AzureDataFactory and other tools. We are looking for a Manager, Data & Analytics to lead a London-based team within our Insights division, reporting directly to the VP of Data & Analytics based in New York. This is a newly created role designed to More ❯
East London, London, United Kingdom Hybrid / WFH Options
Client Server
Data Engineer (Python SQL ETL) London/WFH to £80k Are you a tech savvy Data Engineer with experience of working with sensitive patient/healthcare data? You could be progressing your career as a Data Engineer working on Tech for Good application for the healthcare sector that utilises AI and Machine … Learning techniques to help prevent patients from experiencing health crisis. As a Data Engineer you will take ownership of the healthcare data pipelines and platforms, focussing on implementing robust ETL processes and scalable data architectures, collaborating with various teams to deliver high quality data solutions. You'll develop and maintain data infrastructure on AzureData Lakes and Data Warehouses; create robust data transformation processes that ensure data quality, consistency and security and implement automation workflows. You will help to maintain compliance with ISO27001 and ISO13485 requirements for healthcare data management and ensure that security first practices are More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Client Server Ltd
Data Engineer (Python SQL ETL) London/WFH to £80k Are you a tech savvy Data Engineer with experience of working with sensitive patient/healthcare data? You could be progressing your career as a Data Engineer working on Tech for Good application for the healthcare sector that utilises AI and Machine … Learning techniques to help prevent patients from experiencing health crisis. As a Data Engineer you will take ownership of the healthcare data pipelines and platforms, focussing on implementing robust ETL processes and scalable data architectures, collaborating with various teams to deliver high quality data solutions. You'll develop and maintain data infrastructure on AzureData Lakes and Data Warehouses; create robust data transformation processes that ensure data quality, consistency and security and implement automation workflows. You will help to maintain compliance with ISO27001 and ISO13485 requirements for healthcare data management and ensure that security first practices are More ❯
Woking, Surrey, United Kingdom Hybrid / WFH Options
Michael Page
As a Data Engineer, you will design, build, and maintain data pipelines and solutions to support business needs. This role involves leveraging your technical expertise to enable data-driven decision-making. Client Details Data Engineer - Surrey - Hybrid Our client is a well-established organisation undergoing a significant digital and data transformation. With a focus on innovation and technology, they are investing in building modern, cloud-based data capabilities to drive smarter decision-making, improve customer experience, and support future growth. This is an exciting time to join a business that is placing data at the heart of its strategy and creating opportunities for impactful … work across the organisation Description Data Engineer - Surrey - Hybrid As the Data Engineer you will help design, build, and scale a modern Azure-based data platform. This is your chance to play a key role in shaping how data is used to drive smarter decisions and real business impact. Develop More ❯
HD-TECH are proud to be supporting a well-established and fast-growing Microsoft-focused data consultancy in their search for a Principal Data Consultant. Our client is a … recognised leader in the delivery of cloud-first data platform solutions, analytics, and managed services for enterprise organisations. Key Responsibilities Lead the technical delivery of complex MicrosoftAzuredata projects Architect cloud-native data platform solutions aligned with business needs Act as a technical escalation point and mentor for other consultants Support … reporting and visualisation Strong knowledge of data modelling, SQL, and governance best practices Consulting & Project Delivery Experience 8+ years in professional services or consulting, ideally with Microsoftdata technologies Strong background in client-facing delivery and stakeholder engagement Excellent communication skills with technical and non-technical audiences Experience contributing to pre-sales (SOWs, proposals, estimation) Able More ❯
Swindon, Wiltshire, South West, United Kingdom Hybrid / WFH Options
Genium Selection
Are you a Data Engineer who would like to work with Microsoft Fabric supporting a companys digital transformation by building robust and scalable data infrastructure? Our client will move from legacy to Microsoft Fabric with OneLake, AzureDataFactory and AzureData Lake and you can … be a key part of this move. THE OPPORTUNITY In this role of Data Engineer, youll ensure data is efficiently collected, transformed, and made available for analytics and decision-making across the business. To do this role, youll: Liaise with the business to understand data requirements and define data needs. Identify the … data then design and maintain data pipelines using Microsoft Fabric (OneLake etc) and AzureDataFactory that integrate to other applications including ERP. This data will be provided to a BI Analyst to create dashboards etc with Power BI. Integrate data from various applications such as More ❯
A leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £85,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager will come from a data engineering background and … have strong knowledge in SQL, Snowflake, MicrosoftAzure, AzureDataFactory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role you will need the following: Experience designing, improving and maintaining robust data … Strong SQL programming skills. Knowledge of other programming languages such as Python, C++ and Java beneficial Possesses a strong understanding of Snowflake - beneficial Experience managing small teams of Data Engineers Strong experience working in a cloud environment and knowledge in the following very beneficial: MicrosoftAzure, AzureDataFactory and More ❯