23 of 23 Data Pipeline Jobs in the West Midlands

Job summary The UKHSA Digital and Data Directorate provides strategic leadership and oversight for developing and managing a common and bespoke suite of performant, modern, secure, data and analytical tools, services, platforms and applications, ensuring access to high quality data and analytics services, internally and externally. Based within the Digital and Data Directorate, the Data Product Development Division are responsible for the development and delivery of new and existing dashboards and platforms, ensuring that data are made available to improve health security outcomes. Our flagship product is the UKHSA data dashboard, which builds on the hugely influential COVID-19 dashboard, and presents data on COVID-19, as well as other respiratory viruses such as influenza. Main duties of the job Collation, analysis, interpretation and visualisation of public health information. Implement data extraction, transformation, and loading (ETL) processes to ensure data quality and consistency. Building and maintaining interactive dashboards and data visualisation tools to facilitate data More ❯

the Role We're working with a market-leading organisation that's undergoing a major transformation, moving from manual, Excel-based reporting to a fully automated, intelligence-driven data ecosystem. As Data Architect, you'll be responsible for designing and implementing the Azure-based data platform that becomes the single source of truth across … the business. This is a hands-on, strategic role where you'll build scalable, governed data architecture and shape how data is used across Finance, Operations, and Commercial functions. What You'll Be Doing Data Architecture & Platform Design Design and implement an enterprise data lake on Azure Data Lake Gen2 … using Bronze/Silver/Gold architecture. Build and maintain scalable ETL/ELT pipelines in Azure Data Factory to integrate data from core systems (AS400, Tagetik, CRM, Esker, Slimstock). Develop the overall data model, data dictionaries, and lineage documentation. Deliver a stable “batch-first” integration strategy with AS400 during its More ❯

Senior Data Engineer - Burton on Trent £64-67k x1 day per week on-site (Sponsorship is not provided for this opportunity) As a Senior Data Engineer, you will lead the development and optimisation of our customers Azure-based data platform, ensuring efficient, secure, and high-performing data services. You'll design … scalable pipelines and data models, champion data governance and best practices, and drive continuous improvement to enhance data quality and accessibility across the business. Key Responsibilities Data Engineering: Design, build, and maintain Azure data pipelines using Data Factory, Databricks, and related services. Data Architecture: Develop and … optimise scalable data models, warehouses, and lakes (Azure Synapse, Data Lake Storage). Governance & Security: Enforce compliance and data protection standards (GDPR, DPA) through robust security and governance practices. Automation: Implement CI/CD pipelines and Infrastructure as Code (Terraform, Bicep, ARM) via Azure DevOps. Performance & Monitoring: Optimise data systems for cost More ❯

Proud to be partnering with a leading national organisation looking for a fully remote Head of Data to join on a permanent basis to be a key part of the digital transformation. This is a fully remote role paying up to £90,000 base + benefits. Purpose This role will be responsible for leading, aligning, and delivering a … data strategy, building on existing work, through the design, implementation, and ongoing development of our data and business intelligence platforms, whilst ensuring compliance and security. This role will lead the Data department, interconnected with Technology, Security, Solutions Architecture, Change and … the Operational Excellence department to identify, prioritise and deliver continual improvement. This role will lead the development and maintenance of the data warehouse, master data pipeline, utilising Microsoft Fabric and associated toolset. They will lead the development through all phases of the delivery lifecycle, from requirements capture, high level design, low level design, development They More ❯

DATA ENGINEER UP TO £75,000 + BENEFITS HYBRID - BIRMINGHAM If you're a technically strong, proactive Data Engineer looking to join a FTSE-listed business during a major transformation, this could be a fantastic next step. THE COMPANY: Having recently joined forces with a major FTSE 100 company, this client is merging systems, data, and teams - creating a once-in-a-career opportunity for a driven Data Engineer to make a visible impact.With a flat and collaborative structure, you will have direct access to senior decision-makers and be able to input how their data function evolves. THE ROLE: This is a hands-on engineering role sitting at … the heart of the data and digital transformation. You'll own and manage the data warehouse, ensuring data quality, reliability, and scalability, while contributing to how data is used to drive commercial decisions - particularly around pricing, revenue, and customer insight. Key responsibilities include: Manage and maintain the company's data More ❯

Data Engineering and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

About the role We have an exciting opportunity for a Senior DataOps Engineer to join the Group and take responsibility for inspiring and coaching our Data Engineering teams.The person in post will be working alongside domain-oriented, multi-disciplinary data product teams to design, develop, and test high-quality data solutions that serve as … the backbone of our decision-making and digital services.Driving automation and CI/CD practices across data pipelines and infrastructure, the Senior DataOps Engineer will build robust, scalable, and secure infrastructure that supports our data platform strategy.The role holder will lead and mentor data engineers, fostering a high-performance, collaborative environment. They will also … play a central role in designing and developing a new cloud-based Data Ecosystem.Working closely with stakeholders to analyse requirements the person in post will design test strategies and ensure data quality and integrity through comprehensive testing. They will also collaborate in an agile environment with product managers, analysts, and developers to deliver data More ❯

Data Engineer - 12 Month FTC Up to £75,000 * London or Birmingham * Hybrid A leading UK-wide property business is seeking a Data Engineer to join their growing analytics and digital function on a 12-month fixed-term contract. The Role In this role you'll take ownership of the organisation's data warehouse … ensuring reliable data flows, resolving issues, and recommending improvements across the wider data ecosystem. You'll work closely with digital, product, and analytics teams to support ongoing business operations while contributing ideas to shape the future-state data platform. This is a great opportunity for a hands-on Data Engineer who enjoys … both maintenance and innovation, and who thrives in customer-focussed, commercially minded environments. Key Responsibilities Manage and maintain the central data warehouse and associated pipelines. Ensure data quality and availability across customer, sales, and operational datasets. Support the onboarding and ingestion of third-party vendor data (e.g. Google Analytics). Troubleshoot and resolve data More ❯

Data Engineer - Defence & National Security Client (Multiple Roles!) Location: Hereford | On-site | SC Clearance Required (DV Eligible) Salary: £50,000-£70,000 + Exceptional Benefits Are you a Data Engineer who thrives in fast-paced, mission-critical environments? Our client is expanding their high-performing data engineering team and is looking for an innovative … engineer to help design, build and maintain the data pipelines and applications that power some of the UK's most important data-driven projects. In this role, you'll work closely with data scientists, analysts and product teams to rapidly prototype, develop and deploy bespoke data solutions using commercial and proprietary technologies. … a similar programming language). Experience working with relational databases. Awareness of APIs for data retrieval and integration. Proven stakeholder engagement and requirements-gathering abilities. Understanding of pipeline scheduling, health checks and failure-point identification. Exposure to designing or delivering front-end applications. Benefits £5,000 annual professional development budget, certifications, training, courses. Comprehensive wellness programme, including More ❯

Data Integration Engineer - Hybrid (Telford) Day Rate: 513 (Inside IR35) Contract Length: 6 months Location: Hybrid - 2 days per week onsite in Telford Security Clearance: Active SC clearance required About the Role We're seeking an experienced Data Integration Engineer to join a new Scrum team within the Minerva Platform, supporting HMRC's Modernizing, Mandating Tax … Advisor Registration (MMTAR) initiative. This project will deliver a unified, automated registration journey for tax agents across multiple regimes, incorporating risk assessment and advanced data processing. You'll play a key role in designing and implementing ingestion and risking capabilities within the SAS Platform, including IDP, as part of a high-impact transformation program. Key Responsibilities Design, develop … and deploy data integration and transformation solutions using Pentaho , Denodo , Talend , and SAS . Architect scalable data pipelines and services to support BI and analytics platforms. Collaborate with cross-functional teams to define technical specifications and deliver robust solutions. Champion Agile/Scrum methodologies and drive timely sprint delivery. Implement DevOps practices for CI/CD More ❯

Data Integration Engineer - Hybrid (Telford) Day Rate: £513 (Inside IR35) Contract Length: 6 months Location: Hybrid - 2 days per week onsite in Telford Security Clearance: Active SC clearance required About the Role We're seeking an experienced Data Integration Engineer to join a new Scrum team within the Minerva Platform, supporting HMRC's Modernizing, Mandating Tax … Advisor Registration (MMTAR) initiative. This project will deliver a unified, automated registration journey for tax agents across multiple regimes, incorporating risk assessment and advanced data processing. You'll play a key role in designing and implementing ingestion and risking capabilities within the SAS Platform, including IDP, as part of a high-impact transformation program. Key Responsibilities Design, develop … and deploy data integration and transformation solutions using Pentaho , Denodo , Talend , and SAS . Architect scalable data pipelines and services to support BI and analytics platforms. Collaborate with cross-functional teams to define technical specifications and deliver robust solutions. Champion Agile/Scrum methodologies and drive timely sprint delivery. Implement DevOps practices for CI/CD More ❯

Data Engineer Ms Dynamics 365, Azure Data Factory, SQL, SSIS We have an exciting new permanent opportunity for a dynamic Data Engineer to join a fantastic & growing team at the best timing possible as the business has just embarked on a data transformation journey. This role will give you the chance to … showcase your expertise to help shape data integration methodologies, processes, and standards, driving adoption and best practices across the team. Youll be working closely with Data Architects, Developers and business stakeholders and will be involved in some exciting projects as well as BAU activities like building and maintaining efficient data pipelines between Dynamics … CRM , Azure SQL databases, SharePoint, and analytical platforms using tools such as SSIS, Azure Data Factory , and KingswaySoft. Were looking for someone with good experience of Microsoft Dynamics 365 CRM data structures and architecture and experience orchestrating data pipelines using Azure Data Factory. Hands-on experience with SQL Server Integration Services (SSIS More ❯

Connections Policy Data Scientist/Analyst (Contractor) Location: Warwick (Hybrid - 1 day/week onsite) Contract: 6 Months (with potential for extension) Rate: £500/day via umbrella company We're looking for a skilled Data Scientist/Analyst to support policy and reform initiatives within the Connections directorate. You'll be at the heart of … modelling, forecasting, and analytics that shape strategic decisions and regulatory engagement. Working closely with the Data & Systems Lead and Reporting & Insights Lead, you'll build reproducible pipelines, run simulations, and deliver insights that influence real-world outcomes. This is a hands-on role ideal for a contractor who can onboard quickly and deliver value from week one. Key … lead times, capacity release). Run scenario and sensitivity modelling to support strategic decision-making. Design experiments to estimate the impact of policy/process changes. Engineer robust data pipelines using SQL/Python on Azure. Co-create dashboards and curated datasets in Power BI. Produce clear, concise decision papers for internal and external stakeholders. Improve data More ❯

Data Engineer - Ms Dynamics 365, Azure Data Factory, SQL, SSIS We have an exciting new permanent opportunity for a dynamic Data Engineer to join a fantastic & growing team at the best timing possible as the business has just embarked on a data transformation journey. This role will give you the chance to … showcase your expertise to help shape data integration methodologies, processes, and standards, driving adoption and best practices across the team. You’ll be working closely with Data Architects, Developers and business stakeholders and will be involved in some exciting projects as well as BAU activities like building and maintaining efficient data pipelines between Dynamics … CRM , Azure SQL databases, SharePoint, and analytical platforms using tools such as SSIS, Azure Data Factory , and KingswaySoft. We’re looking for someone with good experience of Microsoft Dynamics 365 CRM data structures and architecture and experience orchestrating data pipelines using Azure Data Factory. Hands-on experience with SQL Server Integration Services More ❯

Job Title: Azure Data Engineer Location: Warwick, UK (Office Based) Job Type: Contract (Inside IR35) Duration: 6 months Job Summary: Join Tata Consultancy Services (TCS) as an Azure Data Engineer and play a key role in delivering innovative data solutions for some of the largest brands in the UK and worldwide. You will leverage … your expertise in Azure, ADF, and modern data platforms to support high-impact, data-driven projects that make a meaningful difference to our clients and communities. Key Responsibilities: Apply in-depth knowledge of Azure and SQL to develop and maintain robust data solutions. Utilize strong debugging skills to resolve issues efficiently. Design, build, and … manage data pipelines using Azure Data Factory (ADF) . Collaborate effectively with stakeholders, ensuring clear communication throughout project lifecycles. Skills, Experience, and Abilities Required: Essential: Expert-level experience with Azure Data Factory (ADF) Hands-on experience with Snowflake and Databricks Proficiency in Python programming Strong Azure and SQL knowledge Excellent debugging and troubleshooting abilities More ❯

DATA ENGINEER - PRIVATE HEALTHCARE - SNOWFLAKE, AZURE, ETL, SQL POWER BI, SSRS, PYTHON Progressive, forward thinking, innovative international private healthcare organisation urgently require a talented Data Engineer to help then shape the future state of the organisation You will: Help create and develop data as they move forward into their new Snowflake environment to ensure … they deliver critical data in an accurate and timely information to the rest of the organisation. Develop and implement data pipelines that extract, transform and load data using into our Snowflake environment for use with reporting tools such as Power BI and SSRS. You are: An Experienced Data Engineer - ETL With in More ❯

We are looking for a permanent Data Engineer to help implement Quantexa for a global brand based in The Midlands. Hybrid, up to £80k base + benefits. ABOUT THE ROLE We are looking for an experienced Senior Data Engineer with Quantexa expertise to join our growing team, which forms part of a larger, successful organisation working … teams. YOUR RESPONSIBILITIES - Lead the design and implementation of enterprise solutions using Quantexa. - Collaborate with product teams and client stakeholders to define matching logic and ensure high quality data inputs. - Build and maintain data pipelines feeding into matching and analytics services. - Conduct data profiling and analysis to ensure high-quality inputs. - Optimise matching algorithms … work cross-functionally with engineers, analysts and business teams. WHAT YOU'LL BRING Essential Skills and Experience: - Hands-on experience with the Quantexa platform, particularly entity resolution. - Strong data engineering background, including data profiling and integration. - Familiarity with APIs for data access and integration. - Excellent client-facing and consultancy skills. - Experience working in Agile More ❯

Data Engineer x3 Telford 2 days a week 55,000 - 65,000 A Leading consultancy organisation based in is looking to expand their team of Data Engineers to join a specific public sector client. This is a pivotal role, where you will contribute to data acquisition, preparation and management projects, helping to modernise services … and deliver secure, reliable data products at scale. WHAT YOU'LL DO Design and implement robust, secure and performance data integration solutions (batch and/or near-real-time). Build, operate and improve data pipelines (ingestion, transformation, curation) with monitoring, alerting and SLAs. Collaborate with product teams and client stakeholders to refine requirements … and business teams. WHAT YOU'LL BRING Our team delivers solutions across a wide range of technologies, and so we are looking for candidates with strong knowledge in data engineering fundamentals, with ability to operate at all stages of the delivery lifecycle, with an interest in learning and cross-skilling. Essential skills and experience: Strong SQL and hands More ❯

Data Engineer x3 Telford 2 days a week £55,000 - £65,000 A Leading consultancy organisation based in is looking to expand their team of Data Engineers to join a specific public sector client. This is a pivotal role, where you will contribute to data acquisition, preparation and management projects, helping to modernise services … and deliver secure, reliable data products at scale. WHAT YOU'LL DO Design and implement robust, secure and performance data integration solutions (batch and/or near-real-time). Build, operate and improve data pipelines (ingestion, transformation, curation) with monitoring, alerting and SLAs. Collaborate with product teams and client stakeholders to refine requirements … and business teams. WHAT YOU'LL BRING Our team delivers solutions across a wide range of technologies, and so we are looking for candidates with strong knowledge in data engineering fundamentals, with ability to operate at all stages of the delivery lifecycle, with an interest in learning and cross-skilling. Essential skills and experience: Strong SQL and hands More ❯

building the future of responsible finance. We're looking for a hands-on Chief Technology Officer (CTO) to lead our tech strategy, drive sprint-based delivery, and own data integrity across our lending platforms. This is a high-impact role, reporting to the board and shaping the direction of both our B2B and B2C tech products. What You … Do: · Define and execute the technology roadmap for our SME and consumer lending platforms · Lead and mentor a cross-functional team of 7+ developers · Architect and maintain scalable data pipelines and integrations · Oversee agile delivery cycles with clear outcomes and accountability · Ensure platform compliance with FCA, CCA, and data protection regulations · Manage third-party tech partnerships … e.g., Simform, NexGen) · Consolidate ownership of Lovey's full technology ecosystem · Lead architectural design for data flow, resilience, and automation across lending systems · Oversee sprint governance, partner performance, and system uptime · Implement robust data and cyber risk frameworks aligned with FCA expectations · Represent technology and innovation strategy to investors and the Board Technology Background of the More ❯

will be joining a community of Graduates and Apprentices across the business. On joining, you will be assigned to start in one of the following roles. Insights and Data (I&D) Build secure, scalable data pipelines using modern tools and cloud platforms. Create dashboards, automate testing, and support data governance. Work on cloud migration … by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. Get the Future You Want More ❯

UK’s largest independent recruitment agency, is looking for a confident and capable Senior SQL Database Administrator to take ownership of our SQL Server estate and Azure SQL Data Warehouse environment. It’s a brilliant opportunity for someone who loves improving performance, solving tricky problems, and keeping everything in top shape.What you’ll be doing as a Senior … to keep systems running at their best Advising on and reworking existing databases to boost efficiency and cut costs Overseeing database access and security patch management Migrating SQL data from on-premise SQL Server to Azure SQL using Data Migration tools Creating and maintaining scripts using SQLCMD and PowerShell What we’re looking for: Solid experience … working as a Senior SQL Database Administrator or in a similar senior-level role Hands-on experience with database server security patching Strong knowledge of Azure SQL Data Warehouse and ETL or data pipelines (ADF) Good understanding of database access management Confident with SQL Server Administration, performance tuning and optimisation Experience with backups, restores, and recovery More ❯

team Pertemps, is the UK’s largest independent recruitment agency, who are looking for a skilled SQL Database Administrator to manage our SQL Server environment and Azure SQL Data Warehouse. This is a fantastic opportunity for a SQL Database Administrator who enjoys tackling complex database challenges and improving performance and efficiency.What you’ll be doing: Administering, monitoring, and … to keep systems running at their best Advising, rearchitecting, and tuning existing databases for improved performance and cost savings Managing Database Access and Security Patch Management Migrating SQL data from on-premises SQL Server to Azure SQL using Data Migration tools Developing and maintaining scripts using SQLCMD and PowerShell What we’re looking for: Previous experience … as a SQL Database Administrator Experience with Database Server Security Patch Management Strong experience with Azure SQL Data Warehouse and ETL/data pipelines (ADF) Proficiency in Database Access Management Expertise in SQL Server Administration, Performance Tuning & Optimisation Experience with backups, restores, and recovery models Knowledge of High Availability (HA) and Disaster Recovery (DR) solutions Ability More ❯