1 to 25 of 96 Data Pipeline Jobs in the Midlands

Michael Page have exclusively partnered with The Government Property Agency (GPA) to support on their continued Data Transformation programmes. The newly created role of Data Platform & Data Integrations Lead is pivotal in this strategy. The GPA is the largest property holder in government, with … data warehouse Maintain existing data feeds into and out of the data estate (data integration pipelines, data lake and data warehouse) The reliability and operation of the data warehouse environment Ensuring that the GPA data ...

Michael Page have exclusively partnered with The Government Property Agency (GPA) to support on their continued Data Transformation programmes. The newly created role of Data Platform & Data Integrations Lead is pivotal in this strategy. The GPA is the largest property holder in government, with … data warehouse Maintain existing data feeds into and out of the data estate (data integration pipelines, data lake and data warehouse) The reliability and operation of the data warehouse environment Ensuring that the GPA data ...

Michael Page have exclusively partnered with The Government Property Agency (GPA) to support on their continued Data Transformation programmes. The newly created role of Data Platform & Data Integrations Lead is pivotal in this strategy. The GPA is the largest property holder in government, with … data warehouse Maintain existing data feeds into and out of the data estate (data integration pipelines, data lake and data warehouse) The reliability and operation of the data warehouse environment Ensuring that the GPA data ...

Michael Page have exclusively partnered with The Government Property Agency (GPA) to support on their continued Data Transformation programmes. The newly created role of Data Platform & Data Integrations Lead is pivotal in this strategy. The GPA is the largest property holder in government, with … data warehouse Maintain existing data feeds into and out of the data estate (data integration pipelines, data lake and data warehouse) The reliability and operation of the data warehouse environment Ensuring that the GPA data ...

execution. Automation & Performance Optimization • Drive the automation of data workflows, reducing manual intervention and improving efficiency. • Monitor and optimize data pipeline performance, ensuring minimal downtime and maximum reliability. • Implement best practices for data engineering, including version control, testing, and documentation. Data … values Essential • Proven experience in managing data operations, integrations, and engineering teams. • Strong expertise in Databricks, including Delta Lake, Spark, and automated pipeline development. • Hands-on experience with ETL/ELT processes, data governance, and cloud-based data platforms. • Proficiency in SQL, Python ...

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed … warehousing. Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed. Can make data pipeline design recommendations based on business requirements. Experience with data migration is a plus. Open to new ways of working and new technologies. ...

undertaking one of the largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Data Engineer, you will support the development of HMLR's data engineering capability by helping to build and maintain reliable data … and analysing source systems to produce clear, actionable insights. Desirable Skills Knowledge of DevOps processes: (e.g. Terraform) Knowledge of data pipeline testing (e.g. end-to-end testing, data quality testing, monitoring & alerting, unit & contract testing) Knowledge of the data lifecycle (e.g. ...

Senior Data Engineer Location : Bristol, Swansea, Leeds, Nottingham, Newcastle, Oldham, Birmingham and Yeading. Salary : Up to £58,997 Job summary A DVSA Senior Data engineer is responsible for the design and implementation of numerous complex data flows to connect operational systems, data for analytics and BI systems. DVSA Senior Data Engineers: lead the build of data streaming systems optimize the code to ensure processes perform optimally lead work on database management recognize and share opportunities to re-use existing data flows coordinate project teams ...

experiences, giving you the opportunity to influence how thousands of people interact with Buzz Bingo every day. What You’ll Do Data Pipeline Development: Design, implement, and maintain robust ETL/ELT pipelines for ingesting and transforming data from multiple sources. Data Modelling … Quality Assurance: Implement checks and monitoring processes to ensure accuracy and reliability. Documentation: Maintain detailed technical documentation for data architectures, pipeline designs, and operational procedures. Performance Tuning: Analyse and optimize workflows for performance and cost efficiency. Innovation: Stay current with emerging technologies and best practices ...

About Us Makutu designs, builds and supports Microsoft Azure cloud data platforms. We are a Microsoft Solutions Partner (Azure Data & AI) and are busy building a talented team with relevant skills to deliver industry leading data platforms for our customers. The Role The Data … role will provide the successful applicants with the opportunity for significant career development while working with a range of large businesses to whom data is critical to their success. Working as part of the team and with the customer, you'll require excellent written and verbal English language ...

Snowflake Data Engineer Location: Brighton, East Sussex (Hybrid/Remote possible) Salary: £50,000 – £60,000 per annum (DOE) Job Type: Permanent, Full-time About the Role We are looking for a talented Snowflake Data Engineer to join our growing data team based … Brighton. You'll play a key role in enhancing our data platform, automating data workflows and enabling data-driven decision-making across the business. This role is ideal for someone who enjoys working with modern cloud data platforms, has excellent SQL skills ...

Data Engineer- Azure £500-£525 pd via Umbrella Birmingham- 1-2 days per week in the office Leading business is looking to bring in a Data Engineer to develop, maintain, and operate data-ingestion routines across the estate to create a single, trusted data source that supports a data-driven culture. Role: Design and implement scalable, secure data-processing pipelines using Azure Data Factory, Azure Synapse, and other Azure services. Manage and optimize data storage solutions, including Azure Data Lake Storage ...

This role is fully remote in UK, with full work authorization already in effect. No Visa sponsorship is available. Job Description In a data-driven and AI-oriented environment, you will be responsible for the design, industrialization, and optimization of inter-application data pipelines. You will … Languages: Advanced SQL and Python for data manipulation, automation, and ML integration. Data Engineering: Proven experience in ETL/ELT pipeline design. AI/ML Integration: Ability to prepare data for model training and deploy AI models into production workflows (batch or real ...

This role is fully remote in UK, with full work authorization already in effect. No Visa sponsorship is available. Job Description In a data-driven and AI-oriented environment, you will be responsible for the design, industrialization, and optimization of inter-application data pipelines. You will … Languages: Advanced SQL and Python for data manipulation, automation, and ML integration. Data Engineering: Proven experience in ETL/ELT pipeline design. AI/ML Integration: Ability to prepare data for model training and deploy AI models into production workflows (batch or real ...

Data Engineer Central Nottingham/Hybrid £54,000 - £62,000 + bonus, 35-hour work week and great benefits Joining a well-established and highly skilled Data team, an experienced Data Engineer is required to help design and develop modern cloud solutions. In order … will have proven experience in delivering business critical BI and reporting services both using on-prem Microsoft BI and Azure tech. As a Data Engineer, you will collaborate with cross-functional teams to ensure data solutions meet business requirements. Utilising modern technologies, this role presents ...

DATA ENGINEER £75,000 + BENEFITS PRIMARILY REMOTE This is a key hire within a data function, responsible for designing and building a modern, scalable data platform. You'll lead the migration away from legacy reporting tools and help deliver a unified data lake/data warehouse. The role offers real ownership, exposure across the business, and the chance to shape how data is used to drive decision-making. THE COMPANY: An established UK-based consultancy, specialising in property risk management and compliance, is looking to hire ...

largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Senior Data Engineer, you will help establish a new data engineering capability, contributing to the development of reliable data pipelines and products that improve data access, integrity and value across the organisation. Your work will support programmes that shape how HMLR manages and uses its data for years to come. Salary up to £60,800, 29% employer pension contribution plus full Civil Service benefits. Flexible, hybrid working from Plymouth, Croydon ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

Title: Senior Data Engineer (Databricks) Salary: Up to £60,000 Location: Birmingham (Hybrid) Are you a Data Engineer looking to work on large-scale, global data solutions that actually make an impact? This is a fantastic opportunity to join a market-leading automotive technology … company that's shaping the future of connected data and intelligent platforms worldwide. You'll be joining a collaborative, forward-thinking data team focused on building a modern, scalable data infrastructure that powers insights for thousands of dealerships across the globe. What ...

Principal Quality Engineering Lead | Data & Analytics | Azure | Financial Services | London (Hybrid) Eligibility: Only candidates with senior-level Banking and/or Financial Services experience and enterprise Data & Analytics platform exposure will be considered. Rate: £455 p/d Outside IR35 Required Sector Experience: Banking/Financial … Services Working Model: Hybrid – 2–3 days per week onsite in London Must-Have Expertise: Quality Engineering leadership, Data & Analytics testing, automation strategy, non-functional testing, Azure data platforms Strict Requirements – Please Read Before Applying - Only apply if you meet all the following: Familiar with NIST ...