1 to 25 of 64 Data Pipeline Jobs in Staffordshire

Scope & Key Interfaces Deliver the data engineering roadmap for ‘Group Data’ ensuring delivery of demonstratable real value to Greene King Own the end-to-end data engineering lifecycle from data ingestion to data transformation to data serving for … new data sources Support and input to the development and optimisation of data engineering tools/processes/environments Own the ongoing maintenance and optimisation of existing data pipelines Own the documentation of all existing and new data pipelines and processes Manage … the testing of all deployed solutions to ensure all solutions are accurate and fault tolerant Ensure adherence to all regulation so that data engineering solutions and resulting business usage is compliant Act as a technical data steward to review and optimise the data quality More ❯

Social network you want to login/join with: Senior Data Engineer - Abu Dhabi, UAE, stoke-on-trent col-narrow-left Client: Robert Walters Location: stoke-on-trent, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 04.06.2025 Expiry Date … role requires a deep understanding of modern data engineering practices, real-time processing, and cloud-native solutions. Key Responsibilities: Data Pipeline Development & Management: Design, implement, and maintain scalable and reliable data pipelines to ingest, transform, and load structured, unstructured, and real-time data … environments. Machine Learning & Advanced Analytics Enablement: Collaborate with data scientists to prepare and serve features for ML models. Maintain awareness of ML pipeline integration and ensure data readiness for experimentation and deployment. Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow More ❯

Posted: 04.06.2025 Expiry Date: 19.07.2025 col-wide Job Description: You will provide expert-level troubleshooting, root cause analysis, and performance optimisation for data platforms, such as Azure SQL databases, Fabric Warehouse and Onelake, Databricks, and Azure Data Factory. Purview or another MDM tool is highly desirable. … Skills/experience Bachelor’s degree in Information Technology, Computer Science, Data Management, or a related field. 4+ years of experience in data management, data operations, or IT support roles, with at least 2 years in Level 3/4 support or equivalent. Hands … on experience with database technologies ( Azure landscape , Oracle, PostgreSQL, etc.). Industry certifications in professional data management, cloud platforms (AWS, Azure, GCP), metadata management, or database administration (e.g., Microsoft Certified: Azure Data Engineer Associate, DAMA CDMP) are desirable. Proven experience with ETL tools, data More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

life. Are you excited at the opportunity to electrify and decarbonize the world? We are seeking a dynamic, forward-thinking, and results-driven Data Engineer to join our Grid Innovation team. This role focuses on designing, building, and maintaining the infrastructure and data pipelines that enable … effective data collection, processing, storage, and analysis for cutting-edge AI/ML applications in the energy domain. Experience in the energy sector, smart infrastructure, or industrial automation is fundamental, as this role supports AI-driven innovation in mission-critical systems with high regulatory and operational complexity. As … Azure, or GCP for deploying and managing data systems. Extensive experience with ETL processes (Extract, Transform, Load) and automating data pipeline workflows. Effective communication skills, with the ability to collaborate smoothly with cross-functional teams and resolve conflicts proactively.Adaptability to work in a dynamic, multi More ❯

life. Are you excited at the opportunity to electrify and decarbonize the world? We are seeking a dynamic, forward-thinking, and results-driven Data Engineer to join our Grid Innovation team. This role focuses on designing, building, and maintaining the infrastructure and data pipelines that enable … effective data collection, processing, storage, and analysis for cutting-edge AI/ML applications in the energy domain. Experience in the energy sector, smart infrastructure, or industrial automation is fundamental, as this role supports AI-driven innovation in mission-critical systems with high regulatory and operational complexity. As … Azure, or GCP for deploying and managing data systems. Extensive experience with ETL processes (Extract, Transform, Load) and automating data pipeline workflows. Effective communication skills, with the ability to collaborate smoothly with cross-functional teams and resolve conflicts proactively.Adaptability to work in a dynamic, multi More ❯

Social network you want to login/join with: Senior Data Platform Engineer, stoke-on-trent col-narrow-left Client: easyJet Location: stoke-on-trent, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 1 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide … big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data … environment with Spark Streaming, Kafka, DLT or Beam. Understanding of the challenges faced in the design and development of a streaming data pipeline and the different options for processing unbounded data (pubsub, message queues, event streaming etc) Understanding of the most commonly used Data More ❯

brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board. Company Description Job Description The IT Data Engineering Manager will play a pivotal role in advancing the data maturity of the Data & AI department by owning and … delivering the data engineering roadmap. They will manage the Data Engineering team, providing best practices and specialized support as an expert and consultant to deliver solutions that enable the business to maximize value. The IT Data Engineering Manager will be responsible for the entire … engineering lifecycle, from data ingestion to transformation to serving. They will support the development and optimization of the environment and platforms to ensure ongoing growth and adherence to industry best practices. Define and implement data engineering strategies and best practices Oversee data platform architecture More ❯

London (links Piccadilly in the south to Oxford Street in the north) **Work Arrangement:** In-office only, five days a week. **Job Title:** Data Architect/Data Engineer **Experience Required:** 7-8 Years **Role Overview:** We are seeking a Senior Data Architect/Data Engineer to design and implement scalable data solutions, including real-time and ETL/ELT data pipelines. Responsibilities include optimizing our data warehouse, creating Power BI reports, and developing AI-driven solutions using OpenAI APIs. **Key Responsibilities:** - Design and implement robust real … time data pipelines from diverse sources. - Maintain a high-performance data warehouse for reporting and analytics. - Develop insightful Power BI dashboards and reports for stakeholders. - Use Azure Data Factory, Azure Functions, and Logic Apps for data integration. - Employ Python and SQL for More ❯

security, and quality of life. Are you excited about electrifying and decarbonizing the world? We are seeking a dynamic, forward-thinking, results-driven Data Engineer to join our Grid Innovation team. This role focuses on designing, building, and maintaining infrastructure and data pipelines that support AI … Leader, you will collaborate with Grid Automation (GA) product lines, R&D teams, product management, and other GA functions. You will develop scalable data frameworks to address customer problems and enable rapid prototyping and deployment, both at the edge and in the cloud. Job Description Essential Responsibilities: Design … and maintain database architectures, schemas, and data models tailored to grid innovation and energy system applications. Utilize efficient data storage technologies (e.g., Relational Databases, Data Lakes, NoSQL) to ensure scalable and secure data access. Build, optimize, and maintain reliable data More ❯

Data Scientist – Grid Innovation Model Development (Energy Sector Experience Required) Join to apply for the Data Scientist – Grid Innovation Model Development (Energy Sector Experience Required) role at GE Vernova's Grid Software Data Scientist – Grid Innovation Model Development (Energy Sector Experience Required) 1 week … ago Be among the first 25 applicants Join to apply for the Data Scientist – Grid Innovation Model Development (Energy Sector Experience Required) role at GE Vernova's Grid Software Job Description Summary Join us in our journey to redefine what's possible with AI and make a lasting … life. Are you excited at the opportunity to electrify and decarbonize the world? We are seeking a dynamic, forward-thinking, and results-driven Data Scientist who will primarily focus on deriving advanced models for grid innovation applications. Reporting to the AI leader in the CTO organization, the Data More ❯

Social network you want to login/join with: Mortgages Data and ETL Engineer, stoke-on-trent col-narrow-left Client: Nationwide Building Society Location: stoke-on-trent, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 04.06.2025 Expiry Date … advertised date, so please apply as soon as you can. What you’ll be doing Contribute to the design and execution of the data migration and integration strategy within the Mortgages area, supporting the broader integration programme objectives. Collaborate with internal stakeholders, business analysts, and architects to translate … functional and non-functional requirements into technical data solutions. Design, build and maintain robust, scalable and high-performance ETL/ELT pipelines using modern data engineering tools and practices, ensuring quality, lineage and auditability. Support data discovery activities and analysis to inform data More ❯

Data Scientist - Grid Innovation Model Development (Energy Sector Experience Required) Join to apply for the Data Scientist - Grid Innovation Model Development (Energy Sector Experience Required) role at Energy Job Search Data Scientist - Grid Innovation Model Development (Energy Sector Experience Required) 2 days ago Be … among the first 25 applicants Join to apply for the Data Scientist - Grid Innovation Model Development (Energy Sector Experience Required) role at Energy Job Search Job Description Summary Join us in our journey to redefine what's possible with AI and make a lasting impact on the world … life. Are you excited at the opportunity to electrify and decarbonize the world? We are seeking a dynamic, forward-thinking, and results-driven Data Scientist who will primarily focus on deriving advanced models for grid innovation applications. Reporting to the AI leader in the CTO organization, the Data More ❯

Social network you want to login/join with: ZONTAL is revolutionizing data management and digital transformation for the life sciences industry. Our cutting-edge platform enables seamless data integration, standardization, and accessibility—empowering scientists and organizations to drive innovation, enhance compliance, and accelerate breakthroughs in … a subject matter expert in the ZONTAL Platform and its customer use-cases. Analyze business requirements for customer-facing projects, with emphasis on data flows and data formats as they feed into & out of the ZONTAL Platform. Create functional and design specifications for the proposed solution … software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and More ❯

This role reports to the Analytics Director, Adobe.pub EMEA. The ideal candidate will possess strong analytical and communication skills and have experience analysing data to answer critical business questions. They will design and implement effective data visualizations and reports, while collaborating closely with cross-functional teams. … Develop roadmaps for these workstreams, ensuring their successful execution Supervise the planning, management, and execution of analyses to support campaign strategy and planning Data Transformation: Design data architecture and ETL processes for efficiently processing large volumes of data periodically Oversee the building and maintenance … of data pipelines to ingest data from diverse sources Design and implement data quality checks and validation procedures to maintain data accuracy and integrity Collaborate with data engineers and architects to optimize data infrastructure and improve data More ❯

up to work for a genuine market leader in an exciting and innovative industry. They plan to build a newly created BI and Data Engineering division to work alongside other Data and Analytics teams across the group. For this role, they need someone to serve as … and Analytics department, also working with, but not exclusive to, the Commercial, Finance, and Operational business functions, to help advance the group’s data infrastructure and support in transforming data into actionable insights and triggered events for Business Intelligence (BI) and Customer Relationship Management (CRM) system … purposes. This role will be instrumental in leveraging data to ensure a fully integrated approach to data-driven decision-making and also business strategy. Day-to-day tasks Work across the group and with the divisions' data partners to leverage all available data More ❯

Social network you want to login/join with: Data & AI Solutions Deployment Architect, stoke-on-trent col-narrow-left Client: Bytes Software Services Location: stoke-on-trent, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 7 Posted: 06.06.2025 Expiry Date … collaboration, recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: The Data & AI Solutions Deployment Architect will be instrumental in architecting and deploying Azure Data & AI Solutions. A solid, technical, ‘hands-on’ (not just … grasp of Azure Fabric is essential as we navigate clients through all of the infrastructure, coding, and product development lifecycle challenges around successful Data and AI implementation and deployment. This customer-centric position involves delivering projects, conducting workshops and physically working on client’s environments via Python, and More ❯

life. Are you excited at the opportunity to electrify and decarbonize the world? We are seeking a dynamic, forward-thinking, and results-driven Data Scientist who will primarily focus on deriving advanced models for grid innovation applications. Reporting to the AI leader in the CTO organization, the Data … the energy sector, specifically in grid automation and energy systems. This role will be responsible for designing and building a common framework for data storage, analytics, and AI model deployment. The Data Scientist will work across different functions within Grid Automation (GA) to identify opportunities for … leveraging data and AI to solve critical customer problems, improve efficiencies, and develop scalable solutions. This role will also involve developing Proof of Concepts (POCs) and ensuring the deployment of models on edge or cloud-based systems. Job Description Essential Responsibilities: Develop and maintain database structures, schemas, and More ❯

Social network you want to login/join with: Head of Data Engineering & Governance, stoke-on-trent col-narrow-left Client: Data Science Talent Location: stoke-on-trent, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 04.06.2025 … Expiry Date: 19.07.2025 col-wide Job Description: Head of Data Engineering & Governance Investment & Wealth Management Hybrid (3 days at home with 2 days traveling in the UK) £120k - £140k basic (DOE) + bonus (10-25%) and benefits (pension, life insurance, healthcare, holidays, & more). “Money makes the world … on wealth management. But now? This company – a trusted name in the UK financial services sector – fully recognise this. They understand that embracing data and AI is what will continue to position them at the forefront of the UK’s investment management sector. This isn’t a dalliance More ❯

Redbrain is a team full of tech-loving, results-driven data nerds who love helping retailers achieve kickass results (and we really mean that). Our people thrive on applying their tech smarts to the online retail space. We've been shaking up the online affiliate business for … BI) Developer with expertise in Google BigQuery, Looker Studio, and PostgreSQL. The ideal candidate will be responsible for designing, developing, and optimising our data pipelines and reporting solutions to drive data-driven decision-making across the organisation. KEY RESPONSIBILITIES This role demands a deep understanding of … data modelling, SQL, and performance tuning in BigQuery and PostgreSQL, along with a proven ability to create insightful and visually appealing reports and dashboards in Looker Studio. BigQuery Development & Optimization: Design and implement efficient data models in BigQuery to support business reporting needs. Write and optimise More ❯

Views: 3 Posted: 04.06.2025 Expiry Date: 19.07.2025 col-wide Job Description: We are partnering with a client undergoing a critical transformation of their data infrastructure and CRM capabilities. They are seeking a hands-on Data Engineer with strong AWS experience to support two key initiatives: finalising … a Braze CRM integration and migrating legacy R-based data pipelines to a modern cloud-native stack. Support the CRM team with data engineering requests. QA, deploy, and monitor data pipelines that push third-party formatted data into Braze. Manage ad hoc … including journey updates and API integrations. Work extensively within AWS using Lambda, API Gateway, and Python to maintain and enhance integrations. Phase 2: Legacy Pipeline Migration (Months 2-3) Analyze and understand existing R-based data pipelines created by data scientists. Migrate these pipelines into More ❯

leading-edge finance solutions through a unique combination of teamwork and technology. From this continued success we are now looking to recruit a Data Analyst to allow us to continue our exciting growth plans. Our aim is to take the service we offer to the next level, to … d like to be part of? As a key member of our team, you’ll be responsible for translating business requirements into practical data models, reports, and dashboards that deliver real insights Role responsibilities; Stakeholder Engagement: Collaborate with key stakeholders across the business to understand their data needs, gather requirements, and provide clear insights that drive decision-making. Data Modelling & Analysis : Design, develop, and maintain scalable data models to ensure data quality and accuracy, utilising SQL and Azure Synapse where necessary. Dashboard Development: Build and maintain visually compelling and More ❯

permit required: Yes col-narrow-right Job Views: 6 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Lead Backend Engineers (Platform Experience & Data Warehousing teams) Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland numi is proud to have partnered with a front-runner in data … some of the biggest names in the industry. We are seeking experienced Lead Backend Engineers (PHP) to join either the Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimizing end-to-end platform journeys and building impactful customer experiences, including developing data visualization dashboards and new features from scratch. The Data Warehousing team manages data storage and transfer solutions, facilitating data transfers to data warehouses/datalakes and improving internal storage, involving scaling, refactoring, and enhancing complex data transfer systems More ❯

Social network you want to login/join with: Data Engineer £50,000-£68,000 per annum Hybrid role with 3 days per week in Burton-on-Trent office Seeking a skilled Data Engineer to deliver the data engineering roadmap and help drive data maturity across the organisation. You'll be responsible for the end-to-end data engineering lifecycle from ingestion and transformation to delivery while ensuring data solutions are scalable, secure and aligned with business goals. Key Responsibilities: · Design, build and maintain robust data … batch, streaming, and APIs · Collaborate with cross-functional teams to understand and deliver on business needs · Ensure regulatory compliance, data quality, and pipeline documentation · Optimise the central data platform in partnership with architecture and analytics teams · Champion best practices in data engineering, MLOps More ❯

required: Yes col-narrow-right Job Views: 2 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Synechron is looking for a Senior Data Engineer to join their Data and AI Practice to work on a multi - year, AI programme of work within a leading financial … institution. Role Overview: We are seeking a talented Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. Your work will ensure reliable, efficient, and secure data flow across systems, enabling advanced analytics, reporting, and business insights. Key Responsibilities: Develop and optimise … data pipelines Build and maintain data infrastructure on cloud platforms (Azure) Collaborate with data scientists and analysts to support data workflows Ensure data security, reliability, and performance at scale Monitor and troubleshoot data pipelines and systems Qualifications & Skills More ❯