1 to 25 of 68 Data Pipeline Jobs in the West Midlands

Databricks ML and Azure ML to develop predictive models and drive business insights.* Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage … Minimum 10+ years of experience as a Data Engineer or similar role.* Proven expertise in the technologies below, and data pipeline development and strong understanding of data warehousing concepts and practices.* Excellent problem-solving and analytical skills and strong communication and teamwork skills.Security ...

data‐enabled products. Establish and champion engineering best practices, including CI/CD, automated testing, version control, monitoring and alerting on pipeline failures. Work closely with Data Architects to implement target‐state data models and modern data engineering principles. Partner with … Factory Azure Synapse Analytics Microsoft Fabric Azure Data Lake Advanced SQL development skills. Proficiency in Python and modern data pipeline orchestration tools, including their monitoring and automation. Track record of building reliable, monitored production‐grade data pipelines. Experience integrating data ...

team OSB Group is undertaking a significant transformation programme, building new cloud-based customer journeys and experiences supported by a modern enterprise data architecture. In parallel, the Group Data Office is responsible for maintaining a complex legacy data landscape that continues … bank today. What you will be doing? As a senior technical leader within the Data Engineering function, the Principal Data Engineer will act as the organisation's Azure Data Platform subject matter expert, providing architectural leadership and technical direction across all data ...

place where you can grow, belong and thrive. Your day at NTT DATA Primary Responsibilities Client Engagement & Delivery Data Pipeline Development (Batch and Streaming) Databricks & Lakehouse Architectures Data Modelling & Optimisation (Delta Lake, Medallion architecture) Collaboration & Best Practices Quality, Governance & Security Business Relationships Solution … Architect, and Analytics leadership To thrive in this role, you need to have: Key Competencies Proven experience in data engineering and pipeline development on Databricks and cloud-native platforms. Strong consulting values with ability to collaborate effectively in client-facing environments. Hands-on expertise across ...

Title: Technical Data Solutions Architect Job Description This role offers the opportunity to shape and deliver high-level and detailed technical data solutions within a major two-year, full life-cycle regulatory change programme. You will translate established enterprise data architecture strategy into robust … solution designs, working closely with business and technology stakeholders to ensure that data platforms and analytics capabilities effectively support regulatory commitments and wider business objectives. Responsibilities Translate high-level strategic enterprise architecture designs into clear, high-level and detailed technical data solution designs ...

Data Pipeline Manager Vacancy Type: Full Time, Permanent Location: Stratford-upon-Avon (Hybrid) Salary: Competitive + Up to 10% Bonus and Benefits Why choose Valpak? Valpak has created a friendly and supportive working environment that enables our team to perform to the best of their abilities, with … improve accuracy and utilise the data to improve knowledge within the sector. What will I be doing? As the Data Pipeline Manager, you will lead a team responsible for building and maintaining scalable, reliable data pipelines that support enterprise reporting and analytics. ...

Lead Data Engineer role in the Digital Services function Hybrid position with two days in the office Responsibilities include delivering the Data as a Service roadmap Collaboration with stakeholders to develop data products Requirement for experience in data pipelines and enterprise data platforms About the role. As part of the development of our Digital Services function, we are strengthening internal digital capability within the Data Team. These roles are central to building sustainable in-house expertise that supports the design, development, and delivery of digital solutions across the transport ...

Game and Inspire the Nation through Winning England Teams The FA is excited to be recruiting an England Men's Insights Senior Data Scientist who will play a key role within the Insights department, driving evidence-based insights across multiple performance functions. The successful candidate will develop … implement advanced analytical models and data-driven applications to generate actionable insights that support player selection, development and performance outcomes. Leveraging their expertise in data science, they will design, train and optimise models, working closely with a range of stakeholders to ensure cutting-edge insights ...

Data Engineer Location: Birmingham Hybrid Working Permanent Full Time Salary: up to £45,000 We’re looking for a Data Engineer to join a growing Data & Analytics team, helping to build and develop the data platform that supports reporting, analytics and emerging … cases across the organisation. This is a broad Data Engineering position covering the full data lifecycle. You’ll work from the point data is connected at source, through ingestion, transformation and modelling, into the central data platform where it can be used ...

expertise across all areas of ET in the manipulation, interpretation, and management of data. The role focuses on designing and implementing architectural and data model changes across core applications and strategic data platforms to support business outcomes. A key purpose of the role is to design … build, and maintain high-quality data products that are discoverable, reusable, and aligned with domain needs—enabling decentralised data ownership and supporting a data mesh approach. The role also involves profiling data to implement quality rules that enable visibility into data ...

Data Engineer +6 months + +Hybrid Malvern +Inside IR35 +£550 - £600 a day +DV cleared - current active clearance is essential for this role We are seeking an experienced Data Engineer to support a major Ministry of Defence (MOD) programme, helping design, develop and maintain secure … data solutions within a highly regulated defence environment. The successful candidate will have strong data engineering experience, with the ability to build and optimise data pipelines, manage complex datasets and ensure data is reliable, secure and accessible to support critical business ...

Work type: Full time Site: Redditch Categories: IT, Data and Analytics Location: Worcestershire About us Halfords is on a journey - building the future of motoring and cycling and looking for people who want to help shape what comes next. We’re a place for cocreators: people who want … policy – this position will be based 3 days per week at our support centre in Redditch, West Midlands. About the role As a Data Solution Architect within our Technology Architecture function, you'll support the design of end-to-end data solutions that deliver real business ...

including RBAC, encryption at rest/in transit, privileged access management, and audit logging, in support of ISO27001 compliance. Own the ETL/ELT pipeline architecture connecting source systems to the data warehouse, including data quality validation and error handling. Develop and implement routines … equivalents (e.g., Azure SQL, Snowflake). Experience with ETL/ELT tooling (e.g., SSIS, dbt, Azure Data Factory) and data pipeline design. Understanding of data modelling principles (normalisation, dimensional modelling/star schema for data warehousing). Experience of diagnosing ...

Lead Data Engineer – Databricks Up to £75,000 | Permanent | Huddersfield | 4 days onsite Want to build the data platform rather than just maintain one? This is an opportunity for a hands‐on Lead Data Engineer to play a key role in a major data transformation – moving a complex, multi‐site UK organisation away from fragmented legacy data and manual processes towards a modern Databricks environment . There's plenty to build, plenty to improve and a genuine opportunity to influence how Data Engineering is done. We're looking ...

Data Engineer Pay of up to £75,664, 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. DWP. Digital with Purpose. Are you an experienced Senior Data Engineer with strong skills in Azure and data pipelines and experience leading technical … ability to analyse complex requirements, produce clear specifications and define effective testing approaches. Experience leading the resolution of complex data, platform and pipeline issues across strategic, tactical and operational levels. Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud ...

strategic move from a large on-premise estate to a modern AWS-based analytics platform, our client is investing heavily in cloud-native data capabilities that will power enterprise reporting, customer analytics, AI initiatives and future data products. This is an opportunity to join a high … digitally enabled services. Technical scope across ingestion, lakehouse design, governance, data products and AWS platform optimisation rather than a narrowly defined pipeline remit. Exposure to analytics, machine learning and emerging AI initiatives as the organisation expands its data capabilities. Opportunity to influence reusable engineering standards ...

looking for an experienced Data Engineer to support a data migration and integration programme within a relatively low maturity Azure environment. Key Skills & Experience Azure Data Engineering Azure Data Factory (ADF) Azure Data Lake Databricks Building ETL/ELT pipelines … Large-scale data migration and integration Oracle and/or Oracle Fusion data sources SharePoint data extraction and integration Working with multiple and varied source systems Data transformation, mapping and validation Designing data pipelines in environments where architecture and processes ...

Role Title: Data & Development Engineer Business Unit: Group Services Location: Solihull Role Overview The data and development engineer role is part of the Data, Analytics and Development team within the IT function at Galliford Try. The accountabilities for the role sit across the whole … data lifecycle from the point of connecting to data at source, through the ETL process, management of data within our data platform, integrations, master data management, reporting, analytics and AI. It is critical that the role demonstrates best practice ...

Data Engineer x 3 Telford/Hybrid - 2 days onsite £460 per day inside ir35 6 month contract Active SC clearance We are currently recruiting for three Data Engineers to join a major data transformation and migration programme within a secure public-sector environment. … processing workflows. Integrate pipelines into CI/CD environments using Jenkins and Git . Implement monitoring and alerting for data quality and pipeline health. Support testing, UAT and production readiness activities. Work collaboratively within Agile and DevOps teams. What We're Looking For We're particularly interested ...

leading environmental compliance provider seeks a Data Pipeline Manager in Stratford-upon-Avon. The role involves leading a team to build reliable data pipelines and ensuring data quality for enterprise reporting. Candidates should have management experience, excellent communication skills, and knowledge ...

Data Test Analyst - SC Cleared Location: Telford - Hybrid ( 2 days per week onsite ) Contract: 6 months Rate: £45-£51 per hour, Inside IR35 Clearance: Active SC Clearance Engagement: PAYE via Umbrella The Opportunity We are looking for a Data Test Analyst to support a major data migration programme within HMRC. You will play a key role in validating data integrity, accuracy and functionality as HMRC's SAS estate, including SAS 9.4 and Viya 3.5 , is migrated to SAS Viya 4 on DPS AWS . This is an excellent opportunity to join ...

release management and rollback processes. Implement monitoring, logging and observability for data pipelines and dashboards (for example Application Insights, logging frameworks and pipeline metrics) and act on alerts. Work with ML/agentic automation teams to integrate or evaluate agent-based workflows where applicable (e.g. controlled … requirements through to deployed solutions and operational support. Proven experience designing and operating CI/CD for data platforms and analytics applications (pipeline automation, test automation, release orchestration). Practical familiarity with software development life-cycle practices (version control, code review, unit and integration testing, release management ...

based Employment type: Permanent The Opportunity We're working with an established and growing UK business that is looking to appoint a senior data analytics engineer to take ownership of its modern data platform and help shape the next stage of its data journey. … business has made significant investment in its technology and data infrastructure, creating an opportunity for someone to build on those foundations, improve existing capabilities and have a genuine influence on how data is used across the organisation. This is a hands-on position, ideally suited ...

Data and Analytics Manager, Microsoft Fabric, SQL, AI & Automation Not sure what skills you will need for this opportunity Simply read the full description below to get a complete picture of candidate requirements. A Data and Analytics Manager opportunity has arisen with a well-established … business that is already making strong progress on its data journey. Could this be the right next step for someone who wants to roll up their sleeves and make a genuine impact rather than starting from scratch? The Role The Data and Analytics Manager will take ...

GlobalData Healthcare operates an intelligence platform that empowers leaders to act decisively in a world of complexity and change. By uniting proprietary data, human expertise, and purpose-built AI into a single, connected platform, we help organizations see what’s coming, move faster, and lead with confidence. … from a range of internal and external sources. Design and maintain data models and database structures. Monitor data quality and pipeline health, and resolve issues quickly. Optimise database performance and manage schema changes. Work with the wider team and the infrastructure team to keep pipelines ...