1 to 25 of 37 Data Pipeline Jobs in the West Midlands

Minimum 10+ years of experience as a Data Engineer or similar role. Proven expertise in the technologies below, and data pipeline development and strong understanding of data warehousing concepts and practices. Excellent problem-solving and analytical skills and strong communication and teamwork skills. … Databricks ML and Azure ML to develop predictive models and drive business insights. Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage ...

tcs.com or call the TCS London Office on 020 3155 2100 . Please include the subject line: “Application Support Request” . Role: Lead Data Engineer – Azure Databricks & Data Operations Job Type: Permanent Location: Redditch, UK Mode of Working: Hybrid Working Hours: 40 hours per week (Full … Platform experience. Hands-on Azure Databricks expertise. Advanced SQL and Python development skills. Strong experience with ETL/ELT and data pipeline development. Experience supporting production data platforms and operational services. Data modelling and data architecture knowledge. Incident management, root ...

Data Architect Max pay rate: £670 per day, c.£90 per hour (Inside IR35) Essential Clearance Required: Live SC clearance. Duration: 6 months Location: Telford - 2 days per week Job Description: Our client is expanding its architecture capability for one of our largest UK Public Sector clients. … this role, you will help to shape and deliver data and analytics solutions that directly support client priorities: improving efficiency, maximising revenues, reducing fraud and responding rapidly to policy challenges. We are looking for Data Architects with a specialism in data-related technologies ...

have a background in Automotive Data Quality, are you excited about data management and validation? Expleo are seeking a highly organised and proactive Data Quality Engineer, you will be a part of the team testing the next generation of electrified propulsion systems, based … Warwickshire on a Contract basis. Key Responsibilities of the Data Quality Engineer include: * Work across Electric machine, Electric Drive Unit (EDU), Inverter, Cell, Battery, Power in loop (PiL) and Vehicle in Loop (ViL) test beds * Provide timely, accurate, secured and accessible test data for wider engineering ...

Role Title: Data Architect Duration: initial 6 month contract Location: Telford, Hybrid 2 days per week onsite Rate: up to £690 p/d Umbrella inside IR35 Clearance required: Active SC Clearance is required Role purpose/summary Capgemini is expanding its architecture capability … largest UK Public Sector clients. In this role, you will help to shape and deliver data and analytics solutions that directly support client priorities: improving efficiency, maximising revenues, reducing fraud and responding rapidly to policy challenges. We are looking for Data Architects with a specialism ...

passionate about making a positive impact, we'd love to have you on our team. About the role As the Data Pipeline Manager, you will lead a team responsible for building and maintaining scalable, reliable data pipelines that support enterprise reporting and analytics. You will … pipelines can process the data received from Customers Liaise with business to understand customer requirements, and to keep the business informed of pipeline progress. Provide feedback to users about the quality of the customers data. Establish and maintain a data stewardship model that works ...

specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you. Job Title: Data Architect Duration: 6 months Location: Telford - 2 days onsite per week Pay Rate: £671 per day all inc. (PAYE through Umbrella) Clearance Required: Current … Expanding its architecture capability for one of our largest UK Public Sector clients. In this role, you will help to shape and deliver data and analytics solutions that directly support client priorities: improving efficiency, maximising revenues, reducing fraud and responding rapidly to policy challenges. We are looking ...

expanding its architecture capability for one of our largest UK Public Sector clients. In this role, you will help to shape and deliver data and analytics solutions that directly support client priorities: improving efficiency, maximising revenues, reducing fraud and responding rapidly to policy challenges. We are looking … Data Architects with a specialism in data-related technologies who can operate across the full data lifecycle and design enterprise-level data architecture for complex programmes. These include cloud migrations, data management, data virtualisation, lakehouse deployments ...

including RBAC, encryption at rest/in transit, privileged access management, and audit logging, in support of ISO27001 compliance. Own the ETL/ELT pipeline architecture connecting source systems to the data warehouse, including data quality validation and error handling. Develop and implement routines … equivalents (e.g., Azure SQL, Snowflake). Experience with ETL/ELT tooling (e.g., SSIS, dbt, Azure Data Factory) and data pipeline design. Understanding of data modelling principles (normalisation, dimensional modelling/star schema for data warehousing). Experience of diagnosing ...

Data Engineer – NPPV 3 Cleared – Contract – Outside IR35 – Hybrid – Midlands VIQU have partnered with a well-established public-sector organisation in the Midlands, who are seeking a Data Engineer to join a major RMS (Records Management System) replacement programme. The successful Data Engineer will … responsible for designing and building robust data pipelines, supporting large-scale data migration activities, and enabling reporting and analytics capabilities across a complex enterprise environment. Key responsibilities: Design, develop, and optimise scalable ETL/ELT pipelines to support data migration, integration, and reporting requirements. ...

Senior Quantexa Data Engineer - Birmingham/Hybrid (Quantexa Data Engineer, Lead Data Engineer, Senior Data Engineer, Data Engineering Manager, Quantexa, Spark, Scala, Python Databricks, DevOps, CI/CD pipelines, Jenkins, GitHub Actions, Azure DevOps, Docker, Kubernetes, Quantexa Data … global innovator and world leader with one of the most recognisable names within technology. They are looking for an experienced Quantexa Data Engineer with significant experience leading the technical development of Quantexa-based solutions. You will be tasked with designing and implementing robust data pipelines, configuring ...

more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. Job Title: Lead Data Integration Engineer Location: Warwick/Hybrid Contract Type: 9 months with scope to extend Overview We are seeking an experienced Lead Data Integration Engineer to support the delivery of a large-scale enterprise data transformation programme. Working alongside the Project Manager, business stakeholders and the wider delivery team, you will lead the discovery, integration and transformation of data from multiple fragmented enterprise systems into a scalable ...

Senior Azure Data Engineer Location: Coventry, UK (Hybrid - 3 Days Per Week Onsite) Day Rate: £425 (Inside IR35) Contract Duration: 3 Months Overview We are seeking an experienced Senior Azure Data Engineer to support a large-scale data migration programme, designing and delivering robust … scalable and high-performing data solutions within the Microsoft Azure ecosystem. This role will focus on building enterprise-grade data pipelines, migration frameworks and transformation processes using Azure Synapse Analytics, Azure Data Factory (ADF), PySpark, Python and SQL. You will work closely with technical ...

Senior Data Engineer – Azure/Databricks £70,000 + bonus Hybrid Working – 1 day on-site per week East Midlands based I'm working with a business that's continuing to invest in its Azure data platform and is looking for a Senior Data Engineer to help shape and develop its modern data estate. You'll play a key role in designing and building scalable Azure data solutions, developing robust data pipelines, and supporting a growing analytics platform. Working across Azure Databricks, Data Factory ...

Contract Data Integration Engineers (Datastage & Azure Data Factory)Remote-first with occasional UK office visits£400-500/day Outside IR356-12 Months Contract We are supporting a major UK organisation undergoing a significant transformation of its data and integration landscape. As part … large-scale programme of integration projects and future cloud migration initiatives, we are seeking experienced Data Integration Engineers with expertise in either IBM Datastage or Azure Data Factory (ADF) . We currently have five contract opportunities available: 3 x Datastage Engineers 2 x Azure Data ...

Data Engineer Up to £60,000 + Benefits Birmingham (Hybrid) This is a fantastic opportunity to join one of the UK's leading specialist care providers as they embark on a major data transformation journey. You'll play a key role in building a modern Azure … based data platform, taking ownership of end-to-end data engineering projects that will directly support reporting, analytics, self-service data access, and future AI initiatives. THE COMPANY: This care provider, delivers long-term, community-based care to individuals. As part of an ongoing ...

Data Engineer Telford/Hybrid - 2 days per week onsite £515 per day inside IR35 6 months Active SC clearance An exciting opportunity has arisen for an experienced Data Engineer to join a high-profile government programme focused on improving fraud prevention and risk assessment. … play a key role in delivering innovative data solutions that support critical public services, working as part of a newly formed Agile Scrum team responsible for developing data ingestion and risking capabilities within a modern SAS platform. This is an opportunity to work on a complex ...

Data Engineer – Azure/Fabric/Pipelines Hybrid – 4 days office (Stoke)/1 day WFH Salary: +benefits A major UK organisation is investing heavily in its digital, data and technology landscape and is looking for a Data Engineer to join its expanding Data … Factory , Synapse , or similar Proficiency in SQL , Python , or other scripting languages Understanding of data modelling , ETL/ELT , and pipeline orchestration Experience working with large datasets and cloud‐based architectures A proactive mindset and ability to work in a fast‐moving transformation environment ...

Data Engineer Pay Rate: £490/day (Inside IR35) Clearance Required: SC required. Candidates holding SC with another governing body. Current timescales for SC transfer are approx. 8 weeks+ from submission of application. Duration: 6 months Location: Mostly Remote (Telford - 2x/month onsite) Industry: Public Sector … Description: We're seeking a Data Engineer to join a Data Acquisition team supporting one of the Public Sector's strategic SAS-based data platforms, designed to industrialise the identification and risking of tax-related activity. The platform is currently deployed for Self Assessment ...

Operational/Data Engineer - SC cleared Operational/Data Engineer - SC cleared The location of the role is Telford (hybrid working) . The duration of the contract is 6 months . The pay rate on offer is £500 per day (via Umbrella agency) . Project Overview … RTENG to build the SA registration network, SAS Viya 3.5 tools for risk assessment of new SA registrations. The POC leveraged data from 20 different sources, most of which were already housed in the Minerva Oracle database. Previously, some data had to be transferred manually. However ...

Were looking for a proactive, solution-focused end to end developer to join a multidisciplinary reporting team within the National Data and Analytics (NDA) department. In this role, you will be responsible for designing, developing, and delivering high-quality national reporting solutions across one or more business areas. … Youll work alongside fellow developers and data engineers to create reporting products that empower decision-making and drive strategic outcomes. As an NDA developer, youll report directly to the NDA Executive Manager and play a key role in the full delivery lifecyclefrom understanding gathered requirements, data ...

looking for a proactive, solution-focused end to end developer to join a multidisciplinary reporting team within the National Data and Analytics (NDA) department. In this role, you will be responsible for designing, developing, and delivering high-quality national reporting solutions across one or more business areas. … work alongside fellow developers and data engineers to create reporting products that empower decision-making and drive strategic outcomes. As an NDA developer, you’ll report directly to the NDA Executive Manager and play a key role in the full delivery lifecycle—from understanding gathered requirements, data ...

help us fulfil our mission to close the world's digital skills gap. What you'll bring to the table: As a Lead Data Engineer, you'll help our clients deploy and maintain data pipelines in a production-safe manner, using the latest technologies and with … DataOps culture. You'll work in a fast moving, agile environment, within multi-disciplinary teams, delivering modern data platforms into large organisations. Your responsibilities: Develop pipelines that brings data to life for decision making, either delivering insight or for more sophisticated data science applications ...

enjoy sharing knowledge and helping others grow You value low-ego collaboration and enjoy working as part of multidisciplinary teams As a Lead Data Solution Engineer, you’ll help our clients deploy and maintain data pipelines in a production-safe manner, using the latest technologies … with a DataOps culture. You’ll work in a fast moving, agile environment, within multi-disciplinary teams, delivering modern data solutions to clients of different sizes and from various sectors. Your responsibilities: Develop pipelines that bring data to life for decision-making, either delivering insight ...

guidelines for Airflow clusters and DAG's, working knowledge of performance tuning of the DAG's and task implementation, developing DAG - data pipeline to on-board and change management of datasetsExperience with installing, configuring and monitoring Airflow cluster, strong PythonUnderstanding of Airflow rest services and integration ...