1 to 25 of 91 Data Pipeline Jobs in the Midlands

in the digital lifecycle and helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation … Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents. Job Overview We are seeking a highly skilled and detail-oriented Python Data Engineer to join our dynamic audit and risk technology team. Based fully onsite in our Birmingham office , you will play a critical role in designing, developing, and maintaining data … governance standards and regulatory requirements. Maintain accurate data dictionaries, metadata , and workflow documentation for transparency and team collaboration. Optimization & Best Practices Optimize dashboard and data pipeline performance through best practices in data visualization and coding standards . Contribute to the evolution of internal audit data strategy by integrating new technologies and More ❯

the Role We re working with a market-leading organisation that s undergoing a major transformation, moving from manual, Excel-based reporting to a fully automated, intelligence-driven data ecosystem. As Data Architect, you ll be responsible for designing and implementing the Azure-based data platform that becomes the single source of truth across … the business. This is a hands-on, strategic role where you ll build scalable, governed data architecture and shape how data is used across Finance, Operations, and Commercial functions. What You ll Be Doing Data Architecture & Platform Design Design and implement an enterprise data lake on Azure Data Lake Gen2 … using Bronze/Silver/Gold architecture. Build and maintain scalable ETL/ELT pipelines in Azure Data Factory to integrate data from core systems (AS400, Tagetik, CRM, Esker, Slimstock). Develop the overall data model, data dictionaries, and lineage documentation. Deliver a stable batch-first integration strategy with AS400 during its More ❯

the Role We're working with a market-leading organisation that's undergoing a major transformation, moving from manual, Excel-based reporting to a fully automated, intelligence-driven data ecosystem. As Data Architect, you'll be responsible for designing and implementing the Azure-based data platform that becomes the single source of truth across … the business. This is a hands-on, strategic role where you'll build scalable, governed data architecture and shape how data is used across Finance, Operations, and Commercial functions. What You'll Be Doing Data Architecture & Platform Design Design and implement an enterprise data lake on Azure Data Lake Gen2 … using Bronze/Silver/Gold architecture. Build and maintain scalable ETL/ELT pipelines in Azure Data Factory to integrate data from core systems (AS400, Tagetik, CRM, Esker, Slimstock). Develop the overall data model, data dictionaries, and lineage documentation. Deliver a stable “batch-first” integration strategy with AS400 during its More ❯

Join us in shaping the future of sustainable housing. We're building a cutting-edge regional data platform that unites retrofit programme data from local authorities, contractors, and IoT telemetry to drive smarter decisions and demonstrate real-world impact. As a Data Engineer, you'll design and develop scalable data pipelines and … dimensional models on an enterprise-grade data lake, enabling high-quality, insight-rich datasets and APIs. Your work will power dashboards and reporting tools that help partners track outcomes, measure value, and accelerate carbon reduction. If you're passionate about data, innovation, and making a tangible difference, we want to hear … from you! Please note, this is a fixed term contract for a period of 12 months. What you will be doing. Design and develop Extract, Transform and Load (ETL) pipeline processes to automate the access to source data, quality check and increase the usage. Asist with the development of new data analysis and reporting systems. More ❯

Contract Role – Data AWS Engineer – Northampton/Hybrid – 6 months – Inside IR35 7+ years of experienced in designing, building, and maintaining data pipelines and architectures on the Amazon Web Services (AWS) cloud platform. Skilled in scalable, reliable, and efficient data solutions, often using AWS services like S3, Redshift, EMR, Glue, and Kinesis. This involves … designing ETL processes, ensuring data security, and collaborating with other teams for data analysis and business requirements Role Overview: Job Title: Data AWS Engineer Location: Northampton (hybrid: 2-3 days in office) Contract Type: Contract Duration: 6 months Key Responsibilities: Designing and Building Data Pipelines: Creating and implementing data pipelines … to move data between different systems and applications on AWS. Data Warehouse Management: Designing, building, and maintaining data warehouses using AWS services like Redshift. ETL Process Development: Developing and maintaining Extract, Transform, Load (ETL) processes to move and transform data. Data Governance and Security: Implementing data governance and security policies More ❯

Contract Role – Data AWS Engineer – Northampton/Hybrid – 6 months – Inside IR35 7+ years of experienced in designing, building, and maintaining data pipelines and architectures on the Amazon Web Services (AWS) cloud platform. Skilled in scalable, reliable, and efficient data solutions, often using AWS services like S3, Redshift, EMR, Glue, and Kinesis. This involves … designing ETL processes, ensuring data security, and collaborating with other teams for data analysis and business requirements Role Overview: Job Title: Data AWS Engineer Location: Northampton (hybrid: 2-3 days in office) Contract Type: Contract Duration: 6 months Key Responsibilities: Designing and Building Data Pipelines: Creating and implementing data pipelines … to move data between different systems and applications on AWS. Data Warehouse Management: Designing, building, and maintaining data warehouses using AWS services like Redshift. ETL Process Development: Developing and maintaining Extract, Transform, Load (ETL) processes to move and transform data. Data Governance and Security: Implementing data governance and security policies More ❯

About Us Makutu designs, builds and supports Microsoft Azure cloud data platforms. We are a Microsoft Solutions Partner (Azure Data & AI) and are busy building a talented team with relevant skills to deliver industry leading data platforms for our customers. The Role The Data Engineer role is key to building and growing … technical team at Makutu. The role will provide the successful applicants with the opportunity for significant career development while working with a range of large businesses to whom data is critical to their success. Working as part of the team and with the customer, you'll require excellent written and verbal English language and communication skills. Big growth … plans are in place to build a broader and deeper technical capability with a focus on the Microsoft Azure technology stack. The position of Data Engineer is a key role in the wider capability of our team. Occasional visits to our Head Office and customers sites will be required. Key responsibilities: Identify, design, and implement working practices across More ❯

billion players already reached, your work will contribute to our shared mission of making the most fun games for the world's players. Join the team! Our Data Engineering team are seeking a talented and experienced Data Engineer to join the team based in Leamington Spa, working on-site 5 days a week. With high volume … and a variety of data within our organisation we require an advanced expertise to ensure scalability, reliability and efficiency in our data ecosystem. We require a person who has designed, created, & maintained data pipelines at large scale in a given tech stack, and also understands best practices and standards and is able to review … if they are being followed at team level. Role Overview Design, develop, test, and maintain Kwalee’s core data systems, including data pipelines, data warehouses and data lakes. Maximise the accessibility and reliability of data for developers and users of data at Kwalee, while ensuring reasonable cost effectiveness More ❯

billion players already reached, your work will contribute to our shared mission of making the most fun games for the world's players. Join the team! Our Data Engineering team are seeking a talented and experienced Data Engineer to join the team based in Leamington Spa, working on-site 5 days a week. With high volume … and a variety of data within our organisation we require an advanced expertise to ensure scalability, reliability and efficiency in our data ecosystem. We require a person who has designed, created, & maintained data pipelines at large scale in a given tech stack, and also understands best practices and standards and is able to review … if they are being followed at team level. Role Overview Design, develop, test, and maintain Kwalee’s core data systems, including data pipelines, data warehouses and data lakes. Maximise the accessibility and reliability of data for developers and users of data at Kwalee, while ensuring reasonable cost effectiveness More ❯

Data Engineer Location: Herefordshire Salary: £50,000 – £70,000 (Permanent) Clearance: DV Cleared (Essential) Working pattern: On-site 4–5 days per week, flexible hours The Opportunity We’re partnering with a leading technology-driven organisation in Herefordshire seeking 7 Data Engineers to join a growing data and analytics team. This is a rare … opportunity for individuals with DV clearance to move into a highly collaborative, forward-thinking environment where data is central to decision-making. Whether you’re an experienced Data Engineer , a Data Analyst looking to step up , or a Full Stack Engineer keen to transition into data , this role offers the support and … technical environment to help you develop and thrive. Key Responsibilities Design, build and maintain reliable data pipelines and APIs to support business intelligence, analytics, and application integrations. Collaborate with analysts, software engineers, and stakeholders to translate business requirements into scalable technical solutions. Work with structured and unstructured data sources, ensuring quality, integrity, and availability of data. More ❯

Data Engineer Location: Herefordshire Salary: £50,000 – £70,000 (Permanent) Clearance: DV Cleared (Essential) Working pattern: On-site 4–5 days per week, flexible hours The Opportunity We’re partnering with a leading technology-driven organisation in Herefordshire seeking 7 Data Engineers to join a growing data and analytics team. This is a rare … opportunity for individuals with DV clearance to move into a highly collaborative, forward-thinking environment where data is central to decision-making. Whether you’re an experienced Data Engineer , a Data Analyst looking to step up , or a Full Stack Engineer keen to transition into data , this role offers the support and … technical environment to help you develop and thrive. Key Responsibilities Design, build and maintain reliable data pipelines and APIs to support business intelligence, analytics, and application integrations. Collaborate with analysts, software engineers, and stakeholders to translate business requirements into scalable technical solutions. Work with structured and unstructured data sources, ensuring quality, integrity, and availability of data. More ❯

Data Engineer - SQL Developer Mostly Remote role - Must be able to travel to rugby office 1-2 times per month An established organisation is seeking a talented SQL Data Engineer to join a collaborative and forward-thinking data team. This role is ideal for someone who thrives on solving complex data challenges … enjoys working with diverse data sources, and takes pride in building scalable, secure and high-performing data solutions. Key Responsibilities Design, develop and maintain SQL databases and data pipelines, ensuring reliability, integrity and optimisation. Create and enhance complex T-SQL queries to support reporting, analytics and system integrations. Develop and maintain data models, mapping processes and documentation to support enterprise data architecture. Collaborate with analysts, data architects and technical teams to understand business requirements and deliver fit-for-purpose data solutions. Support the evaluation, design and implementation of data platforms and tools. Structure and prepare data for analytics, data More ❯

Data Engineer Hereford £50,000 to £70,000 Clearance: minimum SC clearance, eligible for DV We're seeking an experienced Data Engineer to work with an established consultancy providing advanced cybersecurity, data, and technology solutions to clients in government, defence, and critical sectors. The team works on high-impact digital and security transformation projects … culture that values innovation, integrity, and technical excellence. Key Responsibilities Design and develop user-facing applications with a focus on functionality and user experience. Build and maintain custom data pipelines to support end-to-end data processing and integration. Collaborate closely with data scientists, analysts, product owners, and engineers to deliver robust data … all project stages. About You Strong proficiency in Python (or similar programming languages) with experience integrating data through APIs and relational databases. Skilled in data pipeline development, including scheduling, monitoring, and ensuring system reliability and digital continuity. Experienced in stakeholder engagement, gathering requirements, and translating them into effective technical solutions. Familiar with front-end application More ❯

Data Engineer Hereford £50,000 to £70,000 Clearance: minimum SC clearance, eligible for DV We're seeking an experienced Data Engineer to work with an established consultancy providing advanced cybersecurity, data, and technology solutions to clients in government, defence, and critical sectors. The team works on high-impact digital and security transformation projects … culture that values innovation, integrity, and technical excellence. Key Responsibilities Design and develop user-facing applications with a focus on functionality and user experience. Build and maintain custom data pipelines to support end-to-end data processing and integration. Collaborate closely with data scientists, analysts, product owners, and engineers to deliver robust data … all project stages. About You Strong proficiency in Python (or similar programming languages) with experience integrating data through APIs and relational databases. Skilled in data pipeline development, including scheduling, monitoring, and ensuring system reliability and digital continuity. Experienced in stakeholder engagement, gathering requirements, and translating them into effective technical solutions. Familiar with front-end application More ❯

Position: Senior Data Engineer Hybrid - Birmingham 6 months - Outside IR35 Overview: Join a leading UK company as a Senior Data Engineer and play a key role in a major data transformation project. You will have the opportunity to design and deliver a new Azure-based data platform, modernising the organisation's data … management and reporting processes. This hands-on role offers architectural influence and is ideal for an experienced engineer with a strong background in setting up new environments, creating data pipelines, and enabling self-service analytics through Power BI. Key Responsibilities: Design, build, and maintain Azure data pipelines using Azure Data Factory, Synapse, or Fabric. … Implement a data lakehouse architecture (Bronze/Silver/Gold) and establish best-practise ETL/ELT frameworks. Ingest and integrate data from multiple core systems, including ERP, finance, supply chain, and CRM platforms. Develop and optimise SQL data models and support the creation of Power BI-ready datasets. Apply and document data More ❯

Position: Senior Data Engineer Hybrid - Birmingham 6 months - Outside IR35 Overview: Join a leading UK company as a Senior Data Engineer and play a key role in a major data transformation project. You will have the opportunity to design and deliver a new Azure-based data platform, modernising the organisation's data … management and reporting processes. This hands-on role offers architectural influence and is ideal for an experienced engineer with a strong background in setting up new environments, creating data pipelines, and enabling self-service analytics through Power BI. Key Responsibilities: Design, build, and maintain Azure data pipelines using Azure Data Factory, Synapse, or Fabric. … Implement a data lakehouse architecture (Bronze/Silver/Gold) and establish best-practise ETL/ELT frameworks. Ingest and integrate data from multiple core systems, including ERP, finance, supply chain, and CRM platforms. Develop and optimise SQL data models and support the creation of Power BI-ready datasets. Apply and document data More ❯

Data Architect (SQL Azure) Milton Keynes/WFH to £90k Are you a Data technologist with data architecture experience looking for an opportunity to take ownership and make an impact? You could be progressing your career at a well known household name within the fast food space as they invest heavily in their data strategy. As the Data Architect you'll be instrumental in delivering a modern cloud based data infrastructure, they have 16 million customer data points across the UK and Ireland that they're looking to use this to optimise customer retention, product quality and speedy and efficient delivery to the customer. Initially you … ll be responsible for migrating the current on-premise data platform to Azure using Databricks; you'll collaborate with the Head of Digital and AI to modernise the current Data infrastructure and monetise the data available, working with senior business stakeholders to deliver tangible business value. Location/WFH: There's a hybrid work More ❯

Lead/Senior Data Engineer Hybrid – Midlands (1-2 days per week in office) Salary: Up to £65k plus bonus Permanent We are partnering with a leading and innovative organisation to help recruit a Senior Data Engineer to join their evolving data team. This role provides a unique opportunity to work with cutting-edge … cloud data platforms, supporting the delivery of high-quality, reliable data solutions while contributing to automation and platform enhancements. What You’ll Be Doing As a Senior Data Engineer, you will play a key role in building, optimising, and maintaining cloud-based data solutions. Responsibilities include: Developing and maintaining end-to-end … data pipelines using Azure services such as Data Factory, Databricks, Synapse, and Data Lake. Designing and optimising data models, warehouses, and lakehouse architectures to support analytics and reporting requirements. Ensuring data governance, security, and compliance across cloud platforms, implementing access controls, encryption, and monitoring. Monitoring data processes, identifying More ❯

Lead/Senior Data Engineer Hybrid – Midlands (1-2 days per week in office) Salary: Up to £65k plus bonus Permanent We are partnering with a leading and innovative organisation to help recruit a Senior Data Engineer to join their evolving data team. This role provides a unique opportunity to work with cutting-edge … cloud data platforms, supporting the delivery of high-quality, reliable data solutions while contributing to automation and platform enhancements. What You’ll Be Doing As a Senior Data Engineer, you will play a key role in building, optimising, and maintaining cloud-based data solutions. Responsibilities include: Developing and maintaining end-to-end … data pipelines using Azure services such as Data Factory, Databricks, Synapse, and Data Lake. Designing and optimising data models, warehouses, and lakehouse architectures to support analytics and reporting requirements. Ensuring data governance, security, and compliance across cloud platforms, implementing access controls, encryption, and monitoring. Monitoring data processes, identifying More ❯

Data Engineer Hybrid (West Midlands) Permanent Competitive Salary + Benefits Are you passionate about building scalable data solutions and working with cutting-edge technologies like Microsoft Fabric, Azure, and Power BI? TXP is looking for a talented Data Engineer to join our growing team and help shape the future of data-driven … of technology and people, and we help everyone here to succeed. At TXP, you can multiply your potential. What You’ll Be Doing Designing, developing, and maintaining robust data pipelines. Building and optimising infrastructure for scalable data solutions. Integrating data from diverse sources across the business. Ensuring data integrity, security, and compliance … with best practices. Collaborating with cross-functional teams including analysts, developers, and business stakeholders. Leveraging Microsoft Fabric (Lakehouse, Data Pipelines) to modernise our data architecture. Supporting CI/CD and DevOps practices for data workflows. What We’re Looking For Proven experience as a Data Engineer or in a similar role. Strong More ❯

Data Engineer Hybrid (West Midlands) Permanent Competitive Salary + Benefits Are you passionate about building scalable data solutions and working with cutting-edge technologies like Microsoft Fabric, Azure, and Power BI? TXP is looking for a talented Data Engineer to join our growing team and help shape the future of data-driven … of technology and people, and we help everyone here to succeed. At TXP, you can multiply your potential. What You'll Be Doing Designing, developing, and maintaining robust data pipelines. Building and optimising infrastructure for scalable data solutions. Integrating data from diverse sources across the business. Ensuring data integrity, security, and compliance … with best practices. Collaborating with cross-functional teams including analysts, developers, and business stakeholders. Leveraging Microsoft Fabric (Lakehouse, Data Pipelines) to modernise our data architecture. Supporting CI/CD and DevOps practices for data workflows. What We're Looking For Proven experience as a Data Engineer or in a similar role. Strong More ❯

Senior Data Engineer Hybrid - Birmingham (2 days per week in office) Salary: Up to £65k Permanent We are partnering with a forward-thinking, public sector organisation currently undergoing a major data and digital transformation. They are seeking a Senior Data Engineer to play a pivotal role in developing and maintaining a modern, cloud-based … data platform that underpins critical regulatory and strategic objectives. This is an exciting opportunity to work with cutting-edge Microsoft technologies and contribute to the creation of a secure, scalable, and insight-driven data ecosystem that supports the organisation’s mission to deliver better outcomes for customers, communities, and the environment. What You’ll Be Doing … As a Senior Data Engineer, you’ll take a hands-on role in building and optimising data services across both modern and legacy platforms. Key responsibilities include: Developing, maintaining, and optimising data pipelines and ELT processes using Microsoft Fabric, Azure Data Factory, Synapse, Purview, and Power BI. Designing and implementing scalable and More ❯

Data EngineerLeicester£65,000 to £75,000Permanent I am currently looking for a Data Engineer to join a forward-thinking organisation, where you will play a pivotal role in building a modern, enterprise-scale data platform. Data Engineer - What will you be doing? * Designing and implementing modern data architectures including … lakehouse and medallion models using Azure and Databricks.* Developing, maintaining, and optimising data pipelines, quality validation tools, and lineage tracking systems to guarantee high-quality data outputs.* Manage MS SQL and Azure SQL databases efficiently while ensuring optimal performance across all environments.* Utilising Azure Data Factory, Python, and other tools to build efficient ETL … enterprise environments.* Power BI experience.* Deep understanding of SQL.* Experience with Azure and Databricks.* Proficient Python programming skills.* Demonstrated ability to design lakehouse architectures.* Experience implementing CI/CD pipeline management for reliable solution delivery. Robert Walters are proud to specialise in BI & Data recruitment across the UK, offering amazing opportunities on a permanent and interim basis. More ❯

Data Science Engineer – Azure | Databricks | AI Innovation Permanent | Birmingham (Hybrid) Amtis is proud to partner with an advanced, data-driven organisation — a business that’s not just talking about AI, but actively building intelligent systems powered by Azure, Databricks, and real-world machine learning applications. This is a hands-on engineering role where you’ll be … at the core of designing, developing, and optimising modern data platforms that enable predictive analytics, AI experimentation, and large-scale automation. You’ll work in an environment where data truly drives business decisions — not just dashboards. If you’re excited by high-volume, high-velocity data challenges and want to work on next-gen … infrastructure that supports advanced analytics and AI workloads, this is your opportunity. What You’ll Be Doing Designing and building scalable, reusable data pipelines using Azure Databricks, Data Factory, and modern cloud tooling Developing secure, flexible data models and optimising performance across massive datasets Collaborating with data scientists to productionise AI models More ❯

Position: Azure Data Engineer Employment Type: Contract Start: ASAP (November/December 2025) Duration: 6 Months Location: West Midlands, UK Language(s): English Focus on SAP is a specialist SAP and ERP Recruitment organisation offering both permanent and contract staffing solutions on a global scale. Client – Partnered with a global leader in digital transformation and IT services, working … people and communities they serve. For you, this means working on challenging projects that demand innovation, collaboration, and thought leadership . Role – We are seeking an experienced Azure Data Engineer to join a leading technology-driven organisation. You will play a key role in designing, building, and optimising data pipelines and integration workflows within the Microsoft … Azure ecosystem. You will work closely with cross-functional teams to deliver efficient, scalable, and secure data solutions that enable advanced analytics and business intelligence capabilities. Key Responsibilities: Design, build, and maintain data pipelines using Azure Data Factory (ADF) . Develop ETL/ELT processes to integrate and transform large datasets across cloud and More ❯