1 to 25 of 46 Data Pipeline Jobs in the Midlands

Minimum 10+ years of experience as a Data Engineer or similar role. Proven expertise in the technologies below, and data pipeline development and strong understanding of data warehousing concepts and practices. Excellent problem-solving and analytical skills and strong communication and teamwork skills. … Databricks ML and Azure ML to develop predictive models and drive business insights. Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage ...

Data Architect Inside IR35 up to £600+ Nottingham Hybrid Summary We're undertaking a fast paced data transformation into Databricks at E.ON Next using best practice data governance and architectural principles, and we are growing our data engineering capability within the Data … data storage concepts and logical data structures i.e. data warehousing. - Able to make recommendations for data pipeline design based on business requirements. - Be open to new ways of working, and open to working with new technologies. - Be able to set your ...

tcs.com or call the TCS London Office on 020 3155 2100 . Please include the subject line: “Application Support Request” . Role: Lead Data Engineer – Azure Databricks & Data Operations Job Type: Permanent Location: Redditch, UK Mode of Working: Hybrid Working Hours: 40 hours per week (Full … Platform experience. Hands-on Azure Databricks expertise. Advanced SQL and Python development skills. Strong experience with ETL/ELT and data pipeline development. Experience supporting production data platforms and operational services. Data modelling and data architecture knowledge. Incident management, root ...

Data Architect Max pay rate: £670 per day, c.£90 per hour (Inside IR35) Essential Clearance Required: Live SC clearance. Duration: 6 months Location: Telford - 2 days per week Job Description: Our client is expanding its architecture capability for one of our largest UK Public Sector clients. … this role, you will help to shape and deliver data and analytics solutions that directly support client priorities: improving efficiency, maximising revenues, reducing fraud and responding rapidly to policy challenges. We are looking for Data Architects with a specialism in data-related technologies ...

have a background in Automotive Data Quality, are you excited about data management and validation? Expleo are seeking a highly organised and proactive Data Quality Engineer, you will be a part of the team testing the next generation of electrified propulsion systems, based … Warwickshire on a Contract basis. Key Responsibilities of the Data Quality Engineer include: * Work across Electric machine, Electric Drive Unit (EDU), Inverter, Cell, Battery, Power in loop (PiL) and Vehicle in Loop (ViL) test beds * Provide timely, accurate, secured and accessible test data for wider engineering ...

Role Title: Data Architect Duration: initial 6 month contract Location: Telford, Hybrid 2 days per week onsite Rate: up to £690 p/d Umbrella inside IR35 Clearance required: Active SC Clearance is required Role purpose/summary Capgemini is expanding its architecture capability … largest UK Public Sector clients. In this role, you will help to shape and deliver data and analytics solutions that directly support client priorities: improving efficiency, maximising revenues, reducing fraud and responding rapidly to policy challenges. We are looking for Data Architects with a specialism ...

passionate about making a positive impact, we'd love to have you on our team. About the role As the Data Pipeline Manager, you will lead a team responsible for building and maintaining scalable, reliable data pipelines that support enterprise reporting and analytics. You will … pipelines can process the data received from Customers Liaise with business to understand customer requirements, and to keep the business informed of pipeline progress. Provide feedback to users about the quality of the customers data. Establish and maintain a data stewardship model that works ...

specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you. Job Title: Data Architect Duration: 6 months Location: Telford - 2 days onsite per week Pay Rate: £671 per day all inc. (PAYE through Umbrella) Clearance Required: Current … Expanding its architecture capability for one of our largest UK Public Sector clients. In this role, you will help to shape and deliver data and analytics solutions that directly support client priorities: improving efficiency, maximising revenues, reducing fraud and responding rapidly to policy challenges. We are looking ...

expanding its architecture capability for one of our largest UK Public Sector clients. In this role, you will help to shape and deliver data and analytics solutions that directly support client priorities: improving efficiency, maximising revenues, reducing fraud and responding rapidly to policy challenges. We are looking … Data Architects with a specialism in data-related technologies who can operate across the full data lifecycle and design enterprise-level data architecture for complex programmes. These include cloud migrations, data management, data virtualisation, lakehouse deployments ...

including RBAC, encryption at rest/in transit, privileged access management, and audit logging, in support of ISO27001 compliance. Own the ETL/ELT pipeline architecture connecting source systems to the data warehouse, including data quality validation and error handling. Develop and implement routines … equivalents (e.g., Azure SQL, Snowflake). Experience with ETL/ELT tooling (e.g., SSIS, dbt, Azure Data Factory) and data pipeline design. Understanding of data modelling principles (normalisation, dimensional modelling/star schema for data warehousing). Experience of diagnosing ...

Data Engineer – NPPV 3 Cleared – Contract – Outside IR35 – Hybrid – Midlands VIQU have partnered with a well-established public-sector organisation in the Midlands, who are seeking a Data Engineer to join a major RMS (Records Management System) replacement programme. The successful Data Engineer will … responsible for designing and building robust data pipelines, supporting large-scale data migration activities, and enabling reporting and analytics capabilities across a complex enterprise environment. Key responsibilities: Design, develop, and optimise scalable ETL/ELT pipelines to support data migration, integration, and reporting requirements. ...

Senior Quantexa Data Engineer - Birmingham/Hybrid (Quantexa Data Engineer, Lead Data Engineer, Senior Data Engineer, Data Engineering Manager, Quantexa, Spark, Scala, Python Databricks, DevOps, CI/CD pipelines, Jenkins, GitHub Actions, Azure DevOps, Docker, Kubernetes, Quantexa Data … global innovator and world leader with one of the most recognisable names within technology. They are looking for an experienced Quantexa Data Engineer with significant experience leading the technical development of Quantexa-based solutions. You will be tasked with designing and implementing robust data pipelines, configuring ...

more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. Job Title: Lead Data Integration Engineer Location: Warwick/Hybrid Contract Type: 9 months with scope to extend Overview We are seeking an experienced Lead Data Integration Engineer to support the delivery of a large-scale enterprise data transformation programme. Working alongside the Project Manager, business stakeholders and the wider delivery team, you will lead the discovery, integration and transformation of data from multiple fragmented enterprise systems into a scalable ...

Senior Azure Data Engineer Location: Coventry, UK (Hybrid - 3 Days Per Week Onsite) Day Rate: £425 (Inside IR35) Contract Duration: 3 Months Overview We are seeking an experienced Senior Azure Data Engineer to support a large-scale data migration programme, designing and delivering robust … scalable and high-performing data solutions within the Microsoft Azure ecosystem. This role will focus on building enterprise-grade data pipelines, migration frameworks and transformation processes using Azure Synapse Analytics, Azure Data Factory (ADF), PySpark, Python and SQL. You will work closely with technical ...

Data Engineer needed in Lincoln Paying £27.95 per hr ref 376144 Full time hours on a temporary basis Key Responsibilities Design, develop, and maintain scalable data pipelines and data integration solutions. Build and optimise ETL/ELT processes to extract data from … various source systems. Develop and maintain data warehouses, data lakes, and cloud-based data platforms. Ensure data quality, accuracy, integrity, and consistency across all data assets. Monitor and troubleshoot data pipelines, resolving performance and reliability issues. Collaborate with ...

Senior Data Engineer – Azure/Databricks £70,000 + bonus Hybrid Working – 1 day on-site per week East Midlands based I'm working with a business that's continuing to invest in its Azure data platform and is looking for a Senior Data Engineer to help shape and develop its modern data estate. You'll play a key role in designing and building scalable Azure data solutions, developing robust data pipelines, and supporting a growing analytics platform. Working across Azure Databricks, Data Factory ...

Contract Data Integration Engineers (Datastage & Azure Data Factory)Remote-first with occasional UK office visits£400-500/day Outside IR356-12 Months Contract We are supporting a major UK organisation undergoing a significant transformation of its data and integration landscape. As part … large-scale programme of integration projects and future cloud migration initiatives, we are seeking experienced Data Integration Engineers with expertise in either IBM Datastage or Azure Data Factory (ADF) . We currently have five contract opportunities available: 3 x Datastage Engineers 2 x Azure Data ...

Data Engineer Up to £60,000 + Benefits Birmingham (Hybrid) This is a fantastic opportunity to join one of the UK's leading specialist care providers as they embark on a major data transformation journey. You'll play a key role in building a modern Azure … based data platform, taking ownership of end-to-end data engineering projects that will directly support reporting, analytics, self-service data access, and future AI initiatives. THE COMPANY: This care provider, delivers long-term, community-based care to individuals. As part of an ongoing ...

Senior AWS Data Engineer (Fixed Term Contract) When registering to this job board you will be redirected to the online application form. Please ensure that this is completed in full in order that your application can be reviewed. Were looking for a Senior Data Engineer … impact Ensuring data products meet quality, performance and SLA expectations What Were Looking For Strong experience in data engineering and pipeline development A solid understanding of data modelling, governance and quality frameworks Experience working with analytics or AI-ready datasets Ability to translate ...

About the Role We are seeking a Lead Data Platform Engineer to own the resilience, scalability, and security of our core financial data ecosystem. This is a senior, hands‐on engineering role for a technical expert who thrives on the unique challenge of designing, building … ideally within a large‐scale or regulated environment. AWS Experience: You have a strong working knowledge of AWS and cloud‐first data pipeline orchestration tools (like Airflow, Glue, or EMR). A Security Mindset: You understand the importance of compliance and security when managing sensitive data ...

Lead Data Platform Engineer – DataOps Location: Nottingham Trent House (95002), United Kingdom, Nottingham, Nottinghamshire About the Role We are seeking a Lead Data Platform Engineer to own the resilience, scalability, and security of our core financial data ecosystem. This senior, hands‐on engineering role … operations, ideally within a large‐scale or regulated environment. AWS Experience: Strong working knowledge of AWS and cloud‐first data pipeline orchestration tools such as Airflow, Glue, or EMR. A Security Mindset: Understanding of compliance and security when managing sensitive data pipelines. Strong ...

Data Engineer Telford/Hybrid - 2 days per week onsite £515 per day inside IR35 6 months Active SC clearance An exciting opportunity has arisen for an experienced Data Engineer to join a high-profile government programme focused on improving fraud prevention and risk assessment. … play a key role in delivering innovative data solutions that support critical public services, working as part of a newly formed Agile Scrum team responsible for developing data ingestion and risking capabilities within a modern SAS platform. This is an opportunity to work on a complex ...

Data Engineer – Azure/Fabric/Pipelines Hybrid – 4 days office (Stoke)/1 day WFH Salary: +benefits A major UK organisation is investing heavily in its digital, data and technology landscape and is looking for a Data Engineer to join its expanding Data … Factory , Synapse , or similar Proficiency in SQL , Python , or other scripting languages Understanding of data modelling , ETL/ELT , and pipeline orchestration Experience working with large datasets and cloud‐based architectures A proactive mindset and ability to work in a fast‐moving transformation environment ...

Data Engineer Pay Rate: £490/day (Inside IR35) Clearance Required: SC required. Candidates holding SC with another governing body. Current timescales for SC transfer are approx. 8 weeks+ from submission of application. Duration: 6 months Location: Mostly Remote (Telford - 2x/month onsite) Industry: Public Sector … Description: We're seeking a Data Engineer to join a Data Acquisition team supporting one of the Public Sector's strategic SAS-based data platforms, designed to industrialise the identification and risking of tax-related activity. The platform is currently deployed for Self Assessment ...

Hiring: Senior Data Developer (Azure & SQL) | Leicester Are you a senior data professional looking to bridge the gap between traditional SQL databases and modern cloud environments? We are looking for a Senior Developer to join a collaborative team in Leicester. You'll play a key role … maintaining robust SQL platforms while rapidly scaling up modern Azure data architectures and integrating AI/ML tools. What You'll Do: Build and optimize data pipelines using Azure Data Factory (ADF) and SSIS . Leverage Databricks and Azure Data Lake ...