1 to 25 of 45 Data Pipeline Jobs in the West Midlands

Our OEM Client based in Whitley, Coventry, is searching for a Data Quality & Management Engineer (Test Data) to join their team, Inside IR35. This is a contract position until 31st March 2026. Umbrella Pay Rate: £28.06 per hour. Be a part of the team testing the next generation of electrified propulsion systems for our client s … Performance Index. DV Delivery Burndown. Key Accountabilities and Responsibilities: Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. Delivering data quality reviews in order to support programme targets and prove out chosen … Educated to degree level in a natural science, mathematical or engineering or computing discipline. Designing applications in different programming languages (preferable Python). Build data systems & pipelines, data validation and management in cloud platforms (AWS, Google Cloud). Data analysis skills, including hypothesis testing, uncertainty analysis, and process variation. Ability to work closely with More ❯

Our OEM Client based in Whitley, Coventry, is searching for a Data Quality & Management Engineer (Test Data) to join their team, Inside IR35. This is a contract position until 31st March 2026. Umbrella Pay Rate: £28.06 per hour. Be a part of the team testing the next generation of electrified propulsion systems for our client's … Performance Index. DV Delivery Burndown. Key Accountabilities and Responsibilities: Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. Delivering data quality reviews in order to support programme targets and prove out chosen … Educated to degree level in a natural science, mathematical or engineering or computing discipline. Designing applications in different programming languages (preferable Python). Build data systems & pipelines, data validation and management in cloud platforms (AWS, Google Cloud). Data analysis skills, including hypothesis testing, uncertainty analysis, and process variation. Ability to work closely with More ❯

Our premium brand Automotive client is currently recruiting for the following role: Data Management and Validation Engineer - 28/hr (Inside IR35) - Coventry (hybrid potential) - 9 Months (potential for yearly renewal) The Opportunity Be a part of the team testing the next generation of electrified propulsion systems for luxury automotive products. Our client is at the forefront of … quality produced by the team. Key Accountabilities and Responsibilities - Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. - Delivering data quality reviews to support programme targets and prove out chosen technologies. - Develop … Experience - Educated to degree level in a natural science, mathematical or engineering or computing discipline. - Designing applications in different programming languages (preferable Python) - Build data systems & pipelines, data validation and management in cloud platforms (AWS, Google Cloud). - Data analysis skills, including hypothesis testing, uncertainty analysis, and process variation. - Ability to work closely with More ❯

Our premium brand Automotive client is currently recruiting for the following role: Data Management and Validation Engineer - £28/hr (Inside IR35) - Coventry (hybrid potential) - 9 Months (potential for yearly renewal) The Opportunity Be a part of the team testing the next generation of electrified propulsion systems for luxury automotive products. Our client is at the forefront of … quality produced by the team. Key Accountabilities and Responsibilities - Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. - Delivering data quality reviews to support programme targets and prove out chosen technologies. - Develop … Experience - Educated to degree level in a natural science, mathematical or engineering or computing discipline. - Designing applications in different programming languages (preferable Python) - Build data systems & pipelines, data validation and management in cloud platforms (AWS, Google Cloud). - Data analysis skills, including hypothesis testing, uncertainty analysis, and process variation. - Ability to work closely with More ❯

the forefront of development in hybrid and full electric powertrains, aiming to deliver electrifying performance and peerless refinement. We are looking for individuals who are excited about our data management and validation and can bring their passion and experience to our growing team. This role will work across Electric machine, Electric Drive Unit (EDU), Inverter, Cell, Battery, Power … quality produced by the team. Key Accountabilities and Responsibilities: Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. Delivering data quality reviews in order to support programme targets and prove out chosen … Essential: Educated to degree level in a natural science, mathematical or engineering or computing discipline. Designing applications in different programming languages (preferable Python) Build data systems & pipelines, data validation and management in cloud platforms (AWS, Google Cloud). Data analysis skills, including hypothesis testing, uncertainty analysis, and process variation. Ability to work closely with More ❯

the forefront of development in hybrid and full electric powertrains, aiming to deliver electrifying performance and peerless refinement. We are looking for individuals who are excited about our data management and validation and can bring their passion and experience to our growing team. This role will work across Electric machine, Electric Drive Unit (EDU), Inverter, Cell, Battery, Power … quality produced by the team. Key Accountabilities and Responsibilities: Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. Delivering data quality reviews in order to support programme targets and prove out chosen … Essential: Educated to degree level in a natural science, mathematical or engineering or computing discipline. Designing applications in different programming languages (preferable Python) Build data systems & pipelines, data validation and management in cloud platforms (AWS, Google Cloud). Data analysis skills, including hypothesis testing, uncertainty analysis, and process variation. Ability to work closely with More ❯

Data Quality & Management Engineer (Automotive: Testing and Data Validation)Certain Advantage are recruiting on behalf of a globally renowned automotive brand for a Data Quality & Management Engineer to take responsibility for providing timely, accurate, secured and accessible test data for the wider engineering group to enable efficient engineering decisions to be made. … The engineering group need world class test and data management and validation. The role will require you to work cross functionally to deploy a common approach to data piping, data validation tools as well to build a federated data platform.This is a contract inside IR35 until 31st … March (initially) based in Coventry. Key Accountabilities and Responsibilities Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. Delivering data quality reviews in order to support programme targets and prove out chosen More ❯

Broster Buchanan are partnered global business within the food industry with a turnover of £8Bn+ who are looking for a Fabric Data Engineer to join as they set up an exciting new project team within the group. This would suit an experienced Azure Data Engineer with good Fabric experience looking to join a new, growing team … 55k - £65k + 10% bonus is on offer. Responsibilities: Help set up and deliver the future direction of strategy and approach to the management, storage and usage of data Collaborate with their wider technology and business teams to ensure goals and visions are aligned and achieved Help with setting up the data warehousing and lake processes … including collaborating with their architecture teams to figure out what that will look like At times, guide and mentor the junior data engineers within the team, reviewing their ideas, providing feedback and identifying their knowledge gaps to support their development Design, develop, and manage data pipelines using Fabric Data Factory Leverage Fabric Data More ❯

Job Title: Senior Data Engineer Location: Warwick, Hybrid - 2 days per week onsite Remuneration: Up to £650 per day Contract Details: Fixed Term Contract (6 months) Working Pattern: Full Time Join a leading organisation dedicated to connecting people to the energy they use safely, reliably, and efficiently! We're on the lookout for a talented Senior Data Engineer to elevate our data capabilities and drive our projects forward. If you're passionate about data engineering and thrive in a dynamic environment, we want to hear from you! Responsibilities: Lead the design, development, and maintenance of large-scale data systems, including data warehouses, data lakes, and … data pipelines. Create and manage ETL processes using tools like Matillion for seamless data integration. Develop and maintain data warehouse objects such as tables, views, and security roles in Snowflake. Extract data from various sources, ensuring accuracy and consistency throughout the process. Transform and cleanse data, implementing data More ❯

Salary: £51000 - £55000 per annum Employment type: Permanent Hours per week: 37 Reporting into: Principal Data Engineer Department: Analysis Insights and Performance Click here to read the full job description and view our excellent benefits here This role operates primarily on a remote working arrangement that will require little to no travel. Our working model arrangements are a … expand into new disciplines, forge worldwide partnerships, and expand our locations. About our Department : The Analysis, Insights & Performance department at Arden University plays a vital role in driving data-driven decisions. By providing valuable insights, monitoring performance, and promoting innovation, the team supports the university's mission to enhance student outcomes and drive continuous improvement. About the Opportunity … Skills in data modelling and datawarehousing solutions. Experienceof dimensional modelling (Kimball). Proven Experience in designing and developing ETL/ELT processes. Knowledge of data pipeline toolssuch as Data Factory, Airflow, andNiFi. Knowledge of version controlsystems such as Git. Ability to analyse problems anddesign better solutions. A familiarity with agile projectmanagement processes such More ❯

Like data and love solving problems? Want to work on a number of new and exciting data projects and help deliver a BI & Data strategy for a growing organisation? You're probably looking for a role that challenges you daily, a role where your efforts aren't focused mostly on maintenance and support. You … want to be working on varied data projects and utilising the full set of your technology skills whilst driving new areas like Azure/cloud, and all the new tools to play with - Azure Data Factory, Azure Databricks - what about AI? In this predominantly remote you will help create, mature, and grow, a data … Azure data solution to release the power and potential of the data across the organisation. We need a few basics from you: Data pipeline creation Strong ETL development experience with Azure Data Factory Datawarehouse and data storage concepts - star schema/snowflake/Kimball Azure Databricks and AI Power More ❯

teams that build massively scalable software and systems, architect low latency infrastructure solutions, proactively guard against cyber threats, and leverage machine learning alongside financial engineering to continuously turn data into action. Create new businesses, transform finance, and explore a world of opportunity at the speed of markets . Engineering, which is comprised of our Technology Division and global … Want to push the limit of digital possibilities? Start here. Who We Look For Goldman Sachs Engineers are innovators and problem-solvers, building solutions in risk management, big data, mobile and more. We look for creative collaborators who evolve, adapt to change and thrive in a fast-paced global environment. Asset & Wealth Management Division: Across Asset and Wealth … solutions that span Sales, Client Servicing, Research, Portfolio Management and Trading. You will work across a variety of systems & programming languages to create a data pipeline to ingest millions of data points per day and create a highly available data processing and REST services to distribute data to different More ❯

Data Engineer Remote (UK Only | No Visa Sponsorship) Build Scalable Data Infrastructure for Leading US Companies Talent Hero connects UK-based professionals with remote roles at innovative US tech firms. Were hiring Data Engineers who are logical, detail-oriented, and skilled at designing data pipelines and infrastructure. If you have strong backend … data skills and enjoy working with complex systems to deliver reliable, scalable solutions this is your chance to work globally from home. What Youll Do: Design, build, and maintain scalable data pipelines Integrate data from multiple sources and ensure data quality Collaborate with data scientists and analysts to support data needs Optimise data storage and retrieval for performance Work with batch and real-time processing frameworks Implement and manage ETL processes Use tools like Python, SQL, Spark, Airflow, Kafka, dbt, Snowflake, Redshift, BigQuery Requirements Bachelors degree in Computer Science, Engineering, or a related field 1+ year in a Data Engineer or similar role Proficiency More ❯

Data Software Engineer (Python PySpark) Remote UK to £95k Are you a data savvy Software Engineer with strong Python coding skills? You could be progressing your career in a senior, hands-on Data Software Engineer role as part of a friendly and supportive international team at a growing and hugely successful European car insurance … company as they expand their UK presence; their platform enables an insurance quote to be made to the consumer within 60 seconds, using just 4 clicks. As a Data Software Engineer within the Claims team you will help shape the architecture of data products, building reusable technology that enables teams to ingest, store, transform and serve … their own data products. You'll take a lead in data transformation, setting up best practices in areas like Data modelling, performance optimisation and Data Governance to ensure that the data used within the business is consistent, available and reliable. You will be supported with continual learning and self development More ❯

Data Engineer, Non Cleared - Policing background We are seeking a skilled and motivated Data Engineer with a background in policing or law enforcement to join our data and analytics team. The successful candidate will play a key role in designing, building, and maintaining data pipelines and infrastructure to support data-driven decision-making across policing operations. Your understanding of law enforcement processes, systems, and compliance requirements will be vital in shaping data solutions that are secure, ethical, and impactful. Rate - Negotiable Duration - 6- 12 Months Location - West Midlands - twice a week onsite Responsibilties Design, develop, and maintain scalable data pipelines to collect, process, and … transform structured and unstructured data from various policing systems. Collaborate with analysts, data scientists, and operational policing units to understand data requirements and deliver appropriate data solutions. Work with ETL/ELT tools to integrate data from sources such as Niche, Athena, PNC, custody systems, and other law enforcement platforms. More ❯

Senior Data/Power BI Engineer West Midlands/HybridPermanent - Full Time Are you passionate about turning data into powerful insights? TXP is looking for a Senior Data/Power BI Engineer to help our clients unlock the full potential of their data. In … this role, you'll: Design and deploy Power BI models and dashboards Collaborate with stakeholders to shape intelligent analytics solutions Support data warehousing and data pipeline development Drive analytics maturity and best practices across client organisations Mentor junior team members and lead by example What you'll bring: Expertise in Power BI, DAX, and SQL … Experience with Microsoft Fabric or similar platforms Strong understanding of manufacturing processes and ERP systems A passion for data storytelling and business impact Join a consultancy that values innovation, diversity, and continuous learning. Be part of a team that's shaping the future of data-driven decision-making. Apply now and help us build smarter, data More ❯

Lead Data Architect £67,000 - 76,000 GBP Hybrid WORKING Location: Birmingham, West Midlands - United Kingdom Type: Permanent Lead Data Architect Locations: Leeds, Manchester, Birmingham, Bristol, Glasgow, or London (Hybrid - up to 2 days on-site per week, remainder remote) Salary: £67,000 - £76,000 (non-London)/Up to £83,000 (London) + Benefits A … respected digital consultancy is hiring a Lead Data Architect to join its growing Data Engineering practice. Known for delivering modern, human-centred services across public and private sectors, this organisation supports clients through meaningful transformation by combining data, design, and engineering. This role is ideal for experienced architects who enjoy shaping cloud-native data platforms, working in multidisciplinary teams, and embedding data governance and architectural rigour across complex service ecosystems. The Role: As a Lead Data Architect, you'll play a key role in designing scalable, secure, and accessible data platforms that enable insight-driven decision-making. You'll work closely with engineering teams and client More ❯

Data Engineer//1 Day/Week Onsite Worcestershire//Initial 3 Months//Up to £400/day Outside IR35 REED Technology are working with a client who are seeking a contract Data Engineer to join their dynamic Data Engineering team. You'll play a key role in designing and … implementing complex data flows that power analytics and business intelligence (BI) systems across their growing financial services organisation. Key responsibilities Designing, building, and maintaining robust data pipelines and platforms Collaborating with BI, tech, and business teams to deliver scalable solutions Leading on the implementation of new data infrastructure Analysing data for integrity … and correlation across systems Translating stakeholder requirements into technical deliverables Producing and maintaining high-quality technical documentation Championing data engineering best practices and standards across the business Technical skills Cloud data platforms - Azure, AWS, or GCP (Azure preferred) Snowflake - Deep knowledge and hands-on experience Matillion - Expertise in ETL orchestration Data warehousing and advanced More ❯

you're inspired to think big and bring your ambition to work every day, which is why, at British Airways the sky is never the limit. The role: Data Scientist/Senior Data Scientist Join British Airways as a Data Scientist in our cutting-edge Operations Decision Support (ODS) product team. This full-stack … role sits at the heart of our transformation, combining data science, machine learning, and optimisation to build industrialised decision-support software. If you're passionate about solving real-world problems through intelligent, data-driven solutions and thrive in a collaborative, agile environment-this is your opportunity to make a real impact. What you'll do: Design … with software engineering teams, product & change teams to turn their models into industrialized products that are used by the airline every day to make better decisions. Build robust data pipelines, automate data cleaning, and deliver scalable, production-grade Python code using best practices such as typing, testing, and modular design. Integrate models into orchestration frameworks (e.g. More ❯

Contribute to security engineering projects, transitions, and transformations. Work closely with security operations and associated security incident response systems Stay informed about emerging threats and security best practices. Data Ingestion and Enrichment: Configure Elasticsearch pipelines for data ingestion from various sources, primarily from Kafka Enhance data enrichment by integrating threat intelligence feeds and contextual … towards achieving these. Skills Required for the Role Security and Compliance with Elastic Security: Set up access controls, authentication, and encryption using Elastic Security features. Ensure compliance with data protection regulations. Detection Rule Development: Ability to create, test, and optimise detection rules to identify suspicious activities and potential threats based on the MITRE ATT&CK Framework Performance Tuning … with Elasticsearch and Logstash: Fine-tune query performance using Elasticsearch indices and mappings. Monitor Logstash pipelines and optimize resource utilization. Kibana Visualization and Monitoring: Leverage Kibana for data visualization, dashboards, and real-time monitoring. Create custom visualizations to track data quality metrics and system performance. Elastic integration Integration of the SIEM with critical systems to provide More ❯

Data Engineer (Minerva MMTAR Functional Core Build) Max Pay: £537 SC is required, Duration: 6 months initially Location: Telford: If local to Telford, requirement will be 2 days per week on site. If not local, expectation will be to attend once/twice a month. Via Umbrella Key Responsibilities: Design, development, and deployment of data integration … and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices … for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS More ❯

actively including and empowering our people. Above all, we are purpose-driven, committed to positively impacting our people, the planet, and our global communities. We are investing in data, technology and analytics as a strategic priority. The team brings together a number of capabilities that sit within different parts of Croud, into one unit that will drive cutting … edge development in a number of critical areas for the business. The role sits within the Data Engineering team and reports to the Head of Data Engineering. The team's remit is to drive innovation & revenue through the development & delivery of revenue-generating/client-facing data engineering solutions used across the agency. The … Data Engineer will be part of a growing team that delivers highly impactful data solutions across our extensive client portfolio and also the agency's own product offerings. We seek individuals who are proactive, self-starters with a meticulous eye for detail, and who can communicate clearly and effectively across our diverse internal and external stakeholders. More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Viya 4. Support the migration of legacy SAS platforms to cloud-native SAS Viya 4 environments, including namespace separation and Kubernetes orchestration. Implement and manage configuration objects, service data, and translation objects within SAS environments. Collaborate with data engineers and DevOps teams to integrate SAS with Oracle, GitLab CI/CD pipelines, and other enterprise platforms. … Monitor and optimise platform performance, ensuring high availability and compliance with security standards. Provide technical support and troubleshooting for SAS users and developers. Automate environment provisioning and data transfers using approved EA integration patterns. Participate in community knowledge sharing and contribute to best practice documentation. Essential Skills and Experience: SAS Enterprise Guide (EG) – workflow orchestration and user support. … Viya 4 – platform configuration, migration, and containerisation (Kubernetes). SAS Visual Analytics (VA) and SAS Visual Investigator (VI) – dashboard and investigation tool support. Oracle – integration and data pipeline support. Configuration Management – experience managing service objects, deployment artefacts, and environment baselines. Testing Lifecycle Knowledge – including test strategy design, environment comparison utilities, and automated testing integration. Desirable Attributes: Experience More ❯

Viya 4. Support the migration of legacy SAS platforms to cloud-native SAS Viya 4 environments, including namespace separation and Kubernetes orchestration. Implement and manage configuration objects, service data, and translation objects within SAS environments. Collaborate with data engineers and DevOps teams to integrate SAS with Oracle, GitLab CI/CD pipelines, and other enterprise platforms. … Monitor and optimise platform performance, ensuring high availability and compliance with security standards. Provide technical support and troubleshooting for SAS users and developers. Automate environment provisioning and data transfers using approved EA integration patterns. Participate in community knowledge sharing and contribute to best practice documentation. Essential Skills and Experience: SAS Enterprise Guide (EG) – workflow orchestration and user support. … Viya 4 – platform configuration, migration, and containerisation (Kubernetes). SAS Visual Analytics (VA) and SAS Visual Investigator (VI) – dashboard and investigation tool support. Oracle – integration and data pipeline support. Configuration Management – experience managing service objects, deployment artefacts, and environment baselines. Testing Lifecycle Knowledge – including test strategy design, environment comparison utilities, and automated testing integration. Desirable Attributes: Experience More ❯