26 to 50 of 943 Data Pipeline Jobs in the UK excluding London

with expertise working with MS Fabric, SQL and Python. We are looking for an experienced engineer who can drive the automated data pipeline development process, starting from requirements gathering, data extraction & loading, through to data modelling, reporting, and ultimately supporting the business. … responsibilities include: Work with the Engineering Operations team to understand and define their data pipeline requirements for their new data projects Collaborate with the wider Engineering teams to understand existing data ingestion and design suitable methods for extraction Design and implement the necessary ...

with expertise working with MS Fabric, SQL and Python. We are looking for an experienced engineer who can drive the automated data pipeline development process, starting from requirements gathering, data extraction & loading, through to data modelling, reporting, and ultimately supporting the business. … responsibilities include: Work with the Engineering Operations team to understand and define their data pipeline requirements for their new data projects Collaborate with the wider Engineering teams to understand existing data ingestion and design suitable methods for extraction Design and implement the necessary ...

Data Pipeline Manager Application Deadline: 31 August 2026 Department: Technology Employment Type: Permanent - Full Time Location: Stratford-Upon-Avon Reporting To: Adam Christopherson Description As the UK’s leading provider of environmental compliance, Valpak strives to work together towards a profitable, sustainable, waste‐free world. To date … passionate about making a positive impact, we'd love to have you on our team. About the role As the Data Pipeline Manager, you will lead a team responsible for building and maintaining scalable, reliable data pipelines that support enterprise reporting and analytics. You will ...

compensation related questions, including pay details for this role. Job Description The TDS Research Technology team is responsible for delivering the data, analytics, and AI platforms that support Research business capabilities globally. From Belfast, this role will help build the strategic Research data platform leveraging Databricks … enabling reusable data products, modern analytics, and future AI solutions across the organization. Role Description We are seeking a Senior Data Engineer to help build and evolve the strategic Research data platform in Databricks. Working as part of a global Research Technology team, this ...

Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this … Overview Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this ...

Senior Data Engineer 6 Month contract with extension Full-time Inside IR35 Hybrid 1 day every two weeks in the office Nottingham - NG1 4BX Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance … warehousing. Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed. Can make data pipeline design recommendations based on business requirements. Experience with data migration is a plus. Open to new ways of working and new technologies. ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud‐native data platforms, with strong expertise in AWS and native data services. Familiarity with Infrastructure ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud-native data platforms, with strong expertise in AWS and native data services. Familiarity with Infrastructure ...

all. We make it, store it, move it, sell it, and mend it. Join a team at the heart of Centrica's data transformation journey, building the data products and platforms that power insight, customer experiences and business decision-making across the organisation. As a Data Engineer, you will design and develop scalable data solutions that underpin strategic assets such as Centrica's Single Customer View and Property View, enabling trusted, governed and accessible data for analytics, operational processes, customer engagement, AI and digital use cases across the business. ...

place where you can grow, belong and thrive. Your day at NTT DATA Primary Responsibilities Client Engagement & Delivery Data Pipeline Development (Batch and Streaming) Databricks & Lakehouse Architectures Data Modelling & Optimisation (Delta Lake, Medallion architecture) Collaboration & Best Practices Quality, Governance & Security Business Relationships Solution … Architect, and Analytics leadership To thrive in this role, you need to have: Key Competencies Proven experience in data engineering and pipeline development on Databricks and cloud-native platforms. Strong consulting values with ability to collaborate effectively in client-facing environments. Hands-on expertise across ...

with engineering best practices and the ability to translate customer expectations into applied technical functionality are key to success in this role. Key responsibilitiesData pipeline development Build and maintain scalable data pipelines using Apache Spark and PySpark, processing and transforming large datasets across distributed cloud infrastructure. Workflow … monitoring, and execution of data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Data modelling Apply understanding of dimensional data ...

Senior Data Engineer Make a difference and advance your career by helping deliver some of the UK’s most important #tech4good projects, making the world a smarter, safer, greener, and healthier place. You’ll join a talented team of dynamic and driven professional problem solvers; creative thinkers … digital transformation consultancy. We deliver multi-Queen’s Award for innovation winning platforms and services that support large-scale digital transformation. Our digital, data and technology solutions are used by globally recognised public and private sector brands operating in a variety of sectors including Civil Defence, Healthcare, Sustainable ...

Data Engineer Department: [SBSS] Enterprise Data Management Employment Type: Permanent - Full Time Location: Newcastle Compensation: £53,000 - £67,000/year Description At Somerset Bridge Group, we're transforming our data platform to create a modern, cloud-based data ecosystem that powers … smarter decision-making across the business. As part of this journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation. Joining our Enterprise ...

More about the role Our Data & Analytics team creates value for Morrisons by making sure we have the right data in the right place, transformed into clean, accessible structures ready for reporting, data product creation and enabling advanced decision-making. Utilising our Google Cloud … data platform, the Analytics Engineer transforms raw data from across our operations from field to fork into optimised, reliable, and well-documented data models and data products. You will bridge the gap between technical data pipelines and business insight, enabling ...

Data Engineer £60,000 - £70,000 DOE | East Kent | Generous Hybrid Working Are you an experienced Data Engineer looking for an opportunity to help shape and improve the way a growing international organisation uses data? We're working with a well-established, technology … organisation that is investing in its data and analytics capability. They are looking for a Data Engineer to join their Data Analytics team and play a key role in building reliable, scalable and reusable data solutions. This is an excellent opportunity ...

seeking a Data Engineering Specialist to join the Architecture & Modernization team. You will be instrumental in building … maintaining the data infrastructure for our Data AI platforms. This role will involve hands-on development, data pipeline creation, and close collaboration with stakeholders across the organization. This role requires a self-starter with strong execution skills and the ability to work independently. ...

Data Pipeline Manager Vacancy Type: Full Time, Permanent Location: Stratford-upon-Avon (Hybrid) Salary: Competitive + Up to 10% Bonus and Benefits Why choose Valpak? Valpak has created a friendly and supportive working environment that enables our team to perform to the best of their abilities, with … improve accuracy and utilise the data to improve knowledge within the sector. What will I be doing? As the Data Pipeline Manager, you will lead a team responsible for building and maintaining scalable, reliable data pipelines that support enterprise reporting and analytics. ...

OVERVIEW:This role exists to provide technical leadership within the data engineering team, setting the standard for engineering excellence while remaining deeply hands-on. The Lead Data Engineer drives the design and delivery of scalable, resilient data platforms and pipelines that underpin Gymshark … Data Product, and wider Tech teams to ensure joined up platform delivery. Maintain accurate and comprehensive technical documentation: architecture decision records, runbooks, pipeline specs, and data dictionaries. Uphold data governance, security, and compliance standards across all data engineering activities. WHAT ...

NegotiableReading, England Contract Principal Data Engineer - Secure Digital Platform (SDP) Data and Integration Location: Reading (hybrid working) Duration: Initially Until Feb '27 - but very likely to extend (new programme)(Inside IR35)Active SC Clearance Required Role details: We are looking for SC cleared Data Engineers to support our defence client on a contract basis. This role is focused on the Secure Digital Platform (SDP) Data and Integration, and will be based in Reading with hybrid working arrangements. The initial contract will run until February 2027, with a strong likelihood ...

work depends on, including taking our golden dataset of completed matters from a manual exercise to a versioned, access-controlled, anonymised and repeatable pipeline, along with the evaluation data that tells us whether our AI is getting better. Replace a legacy management information warehouse built on stored … tuning, data modelling and stored procedures, with the judgement to understand the impact of querying production systems. Python for data pipeline and automation work. Experience owning production data pipelines end-to-end: built them, monitored them, fixed them when they broke. Experience working ...

small team with a large remit, and we expect AI-assisted development to be embedded in how we work Apply AI tools to accelerate pipeline development, automated testing, anomaly detection and data quality monitoring Stay current with AI developments in the data engineering space … this is non‐negotiable; you must have built and operated production data pipelines on this stack Strong Python skills – used daily for pipeline development, data transformation and automation Experience across at least two of the three core data domains: Customer, Commercial and Operations ...

Senior Data Engineer Who we are We are an advanced data and business consultancy headquartered in Edinburgh, UK. We are a practitioner-led organisation that collaborates with top consumer brands to drive transformation and foster customer-centricity through our expertise in customer strategy, innovative design … business challenges in an inclusive environment that fosters continuous learning, knowledge sharing, and clear career development. What you will be doing Data Pipeline Development: Design and implement robust, scalable, and efficient data pipelines to collect, transform, and integrate data from various sources. Data ...

What you will be doing? The key purpose of this role is to deliver new, and implement changes to existing data solutions, data extraction and transform (ETL), using the full Microsoft SQL stack, for identified and agreed business requirements. In addition, the Senior Data Engineer will be responsible for translating business requirements into Azure Cloud-based big data solutions for our Data Transformation programme. This will include building complex data pipelines, data warehouses and the data lakes, using Azure services such ...

Senior Data Engineer at Unisys - Milton Keynes Are you an experienced data engineer with a passion for Generative AI and AI/LM technologies? Unisys is seeking a talented Senior Data Engineer to join our team in Milton Keynes, Buckinghamshire. In this role … science research and trends. Attend a meeting with client stakeholders to discuss their business requirements. Design and implement a data pipeline for processing large datasets. Develop and execute a machine learning model to solve a business problem. Present your findings and recommendations to a variety ...

WHAT YOU'LL BE DOING: Technical Leadership: Own and drive the technical design and architecture of data pipelines, data models, and platform components across the team. Set and enforce engineering standards: code quality, testing, observability, security, and documentation, ensuring the whole team operates to them Lead … Data Product, and wider Tech teams to ensure joined up platform delivery. Maintain accurate and comprehensive technical documentation: architecture decision records, runbooks, pipeline specs, and data dictionaries. Uphold data governance, security, and compliance standards across all data engineering activities. Strong experience ...