1 to 25 of 93 Data Pipeline Jobs in the Midlands

Databricks ML and Azure ML to develop predictive models and drive business insights.* Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage … Minimum 10+ years of experience as a Data Engineer or similar role.* Proven expertise in the technologies below, and data pipeline development and strong understanding of data warehousing concepts and practices.* Excellent problem-solving and analytical skills and strong communication and teamwork skills.Security ...

data‐enabled products. Establish and champion engineering best practices, including CI/CD, automated testing, version control, monitoring and alerting on pipeline failures. Work closely with Data Architects to implement target‐state data models and modern data engineering principles. Partner with … Factory Azure Synapse Analytics Microsoft Fabric Azure Data Lake Advanced SQL development skills. Proficiency in Python and modern data pipeline orchestration tools, including their monitoring and automation. Track record of building reliable, monitored production‐grade data pipelines. Experience integrating data ...

engineering best practices. Power BI experience is desirable and would be considered a good-to-have skill. Key Responsibilities Data Engineering & Pipeline Development Design, build, and maintain scalable data pipelines using Azure Data Factory. Develop robust ETL/ELT processes to ingest, transform … data engineering outputs support analytics and decision-making. Preferred Skills & Experience Hands-on experience with Azure Data Factory, including pipeline orchestration, triggers, linked services, datasets, and monitoring. Strong SQL skills and experience working with cloud data platforms such as Snowflake. Experience with DataOps.live ...

team OSB Group is undertaking a significant transformation programme, building new cloud-based customer journeys and experiences supported by a modern enterprise data architecture. In parallel, the Group Data Office is responsible for maintaining a complex legacy data landscape that continues … bank today. What you will be doing? As a senior technical leader within the Data Engineering function, the Principal Data Engineer will act as the organisation's Azure Data Platform subject matter expert, providing architectural leadership and technical direction across all data ...

About the role... Are you an experienced Data Architect looking for your next challenge? Cooper Parry is on a rapid growth trajectory, and we're seeking a Data Architect to lead the design and evolution of our enterprise data platform. This role will play … experience with Microsoft Fabric Deep understanding of: Modern data lakehouse architectures Dimensional and analytical data modelling Data pipeline orchestration Strong SQL skills and experience with distributed data processing Experience designing enterprise-scale analytics platforms in Azure Ability to translate business requirements ...

place where you can grow, belong and thrive. Your day at NTT DATA Primary Responsibilities Client Engagement & Delivery Data Pipeline Development (Batch and Streaming) Databricks & Lakehouse Architectures Data Modelling & Optimisation (Delta Lake, Medallion architecture) Collaboration & Best Practices Quality, Governance & Security Business Relationships Solution … Architect, and Analytics leadership To thrive in this role, you need to have: Key Competencies Proven experience in data engineering and pipeline development on Databricks and cloud-native platforms. Strong consulting values with ability to collaborate effectively in client-facing environments. Hands-on expertise across ...

Data Pipeline Manager Vacancy Type: Full Time, Permanent Location: Stratford-upon-Avon (Hybrid) Salary: Competitive + Up to 10% Bonus and Benefits Why choose Valpak? Valpak has created a friendly and supportive working environment that enables our team to perform to the best of their abilities, with … improve accuracy and utilise the data to improve knowledge within the sector. What will I be doing? As the Data Pipeline Manager, you will lead a team responsible for building and maintaining scalable, reliable data pipelines that support enterprise reporting and analytics. ...

excited to be recruiting an England Men’s Insights Senior Data Scientistwho will play a key role within the Insights department, driving evidence-based insights across multiple performance functions. The successful candidate will develop and implement advanced analytical models and data-driven applications to generate actionable … insights that support player selection, development and performance outcomes. Leveraging their expertise in data science, they will design, train and optimise models, working closely with a range of stakeholders to ensure cutting-edge insights are effectively communicated, understood and embedded into decision-making processes. Whatwill you be doing ...

Data Engineer Location: Birmingham Hybrid Working Permanent Full Time Salary: up to £45,000 We’re looking for a Data Engineer to join a growing Data & Analytics team, helping to build and develop the data platform that supports reporting, analytics and emerging … cases across the organisation. This is a broad Data Engineering position covering the full data lifecycle. You’ll work from the point data is connected at source, through ingestion, transformation and modelling, into the central data platform where it can be used ...

expertise across all areas of ET in the manipulation, interpretation, and management of data. The role focuses on designing and implementing architectural and data model changes across core applications and strategic data platforms to support business outcomes. A key purpose of the role is to design … build, and maintain high-quality data products that are discoverable, reusable, and aligned with domain needs—enabling decentralised data ownership and supporting a data mesh approach. The role also involves profiling data to implement quality rules that enable visibility into data ...

Role Overview Experian Credit Services & Verifications are looking for a Lead Data Platform Engineer to provide hands‐on technical leadership for a new fraud data capability that will connect fraud‐related data assets into Experian’s Data Analytics Platform. Reporting into … team that supports innovation, learning and collaboration. Ensuring that the team follows the highest technical standards. You will work closely with the central Data Analytics Platform team, data owners, security, compliance, platform and delivery stakeholders to agree practical implementation approaches, align with established platform patterns ...

Join Microlise as a Senior AWS Data Engineer on a 12-month fixed term contract and help build the data foundations behind the next generation of customer-facing analytics and AI products. This is a hands-on engineering role in a major cloud data platform programme, where youll help turn operational, telematics, customer and third-party data into trusted, reusable data products that power dashboards, APIs, self-service analytics, machine learning and future generative AI services. Youll work with modern AWS managed services, lakehouse architecture, Data ...

Data Engineer +6 months + +Hybrid Malvern +Inside IR35 +£550 - £600 a day +DV cleared - current active clearance is essential for this role We are seeking an experienced Data Engineer to support a major Ministry of Defence (MOD) programme, helping design, develop and maintain secure … data solutions within a highly regulated defence environment. The successful candidate will have strong data engineering experience, with the ability to build and optimise data pipelines, manage complex datasets and ensure data is reliable, secure and accessible to support critical business ...

About the role. As part of the development of our Digital Services function, we are strengthening internal digital capability within the Data Team. These roles are central to building sustainable in-house expertise that supports the design, development, and delivery of digital solutions across the transport network. … focus of this campaign is creating new opportunities, and as a result, we are recruiting Lead Data Engineers. This is a pivotal role within the organisation. In this role, you will work as part of a collaborative team, partnering with stakeholders across the business to understand user needs ...

Work type: Full time Site: Redditch Categories: IT, Data and Analytics Location: Worcestershire About us Halfords is on a journey - building the future of motoring and cycling and looking for people who want to help shape what comes next. We’re a place for cocreators: people who want … policy – this position will be based 3 days per week at our support centre in Redditch, West Midlands. About the role As a Data Solution Architect within our Technology Architecture function, you'll support the design of end-to-end data solutions that deliver real business ...

including RBAC, encryption at rest/in transit, privileged access management, and audit logging, in support of ISO27001 compliance. Own the ETL/ELT pipeline architecture connecting source systems to the data warehouse, including data quality validation and error handling. Develop and implement routines … equivalents (e.g., Azure SQL, Snowflake). Experience with ETL/ELT tooling (e.g., SSIS, dbt, Azure Data Factory) and data pipeline design. Understanding of data modelling principles (normalisation, dimensional modelling/star schema for data warehousing). Experience of diagnosing ...

Lead Data Engineer – Databricks Up to £75,000 | Permanent | Huddersfield | 4 days onsite Want to build the data platform rather than just maintain one? This is an opportunity for a hands‐on Lead Data Engineer to play a key role in a major data transformation – moving a complex, multi‐site UK organisation away from fragmented legacy data and manual processes towards a modern Databricks environment . There's plenty to build, plenty to improve and a genuine opportunity to influence how Data Engineering is done. We're looking ...

Data Engineer UK Remote/Hybrid Competitive salary + benefits Please note: Applicants must be based in the UK. We are unable to offer sponsorship for this position. Are you an experienced Data Engineer looking for your next challenge? Do you enjoy designing scalable data … warehouse or lakehouse platforms . Experience with notebook-based development and distributed data processing frameworks. CRM integration experience. CI/CD pipeline configuration. Experience supporting mobile application backend services. Low-code/no-code automation experience. Experience working within a regulated environment. What We’re Looking ...

full-time Band 6 post working 37.5 hours per week. You will play a key role in developing and maintaining the Trust's Data Warehouse and Data Visualisation systems, using technologies including SQL Server, Power BI and the Microsoft BI stack. The role offers the opportunity … duties of the job Day to day, you will develop, test and maintain the Trust data warehouse, ETL/data pipeline and reporting solutions; write advanced SQL; build and improve Power BI and SSRS reports; monitor the Business Intelligence environment and resolve or escalate issues ...

Delivery Manager – Data & Reporting Programme Contract duration: 6 months Location: Hybrid- 2 days per week in either office location- Central London or Chesterfield Pay range: £600-£650.00 per day/Inside IR35 Start date: ASAP We are looking for an experienced Delivery Manager to join our client … data and reporting programme, supporting the delivery of two key workstreams a Report Replacement solution and a newer Databricks/Enterprise Data Platform workstream.The role will sit across both workstreams, providing the delivery structure, coordination and end-to-end oversight needed to keep technical and business ...

Data Engineer Pay of up to £75,664, 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. DWP. Digital with Purpose. Are you an experienced Senior Data Engineer with strong skills in Azure and data pipelines and experience leading technical … ability to analyse complex requirements, produce clear specifications and define effective testing approaches. Experience leading the resolution of complex data, platform and pipeline issues across strategic, tactical and operational levels. Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud ...

looking for an experienced Data Engineer to support a data migration and integration programme within a relatively low maturity Azure environment. Key Skills & Experience Azure Data Engineering Azure Data Factory (ADF) Azure Data Lake Databricks Building ETL/ELT pipelines … Large-scale data migration and integration Oracle and/or Oracle Fusion data sources SharePoint data extraction and integration Working with multiple and varied source systems Data transformation, mapping and validation Designing data pipelines in environments where architecture and processes ...

Role Title: Data & Development Engineer Business Unit: Group Services Location: Solihull Role Overview The data and development engineer role is part of the Data, Analytics and Development team within the IT function at Galliford Try. The accountabilities for the role sit across the whole … data lifecycle from the point of connecting to data at source, through the ETL process, management of data within our data platform, integrations, master data management, reporting, analytics and AI. It is critical that the role demonstrates best practice ...

direction of the Principal Engineer, this role is responsible for enabling secure, reliable and scalable engineering solutions, focusing specifically on the Customer Data Management platform, Informatica 360 MDM and the Customer Data Platform, Treasure AI. The role supports the technical delivery, operation and continuous improvement … customer data capabilities across these 2 key systems in the Customer Management estate, ensuring consistent engineering standards, architectural alignment and operational excellence. What You Will Be Doing Design, build and maintain Informatica Customer 360 (MDM/CDM) and Treasure Data AI (CDP) solutions, including data ...

direction of the Principal Engineer, this role is responsible for enabling secure, reliable and scalable engineering solutions, focusing specifically on the Customer Data Management platform, Informatica 360 MDM and the Customer Data Platform, Treasure AI. The role supports the technical delivery, operation and continuous improvement … customer data capabilities across these 2 key systems in the Customer Management estate, ensuring consistent engineering standards, architectural alignment and operational excellence. What You Will Be Doing Design, build and maintain Informatica Customer 360 (MDM/CDM) and Treasure Data AI (CDP) solutions, including data ...