26 to 50 of 60 Data Pipeline Jobs in the North of England

client, a leading organisation within the public sector, is seeking an experienced Data Engineer to join their Digital & Data function. The role is focused on transforming and integrating data across the institution, supporting strategic reporting, analytics, and operational needs. With major ongoing development … their Snowflake-based data platform, this is an excellent opportunity to take ownership of high-impact data engineering work in a complex, data-rich environment.What You Will Be Doing Designing, developing, and maintaining data pipelines to ingest, clean, transform, and deliver high ...

Title: Senior Data Engineer Salary: Up to £60,000 Location: Leeds (Hybrid – 2 days a week in the office) Are you a data engineering expert ready to take the next step in your career? We're hiring a Senior Data Engineer to join … Collaborating with cross-functional teams to deliver high-impact data products Leading best practices in data engineering and pipeline architecture What we’re looking for: Proven experience in data engineering at a senior level Strong hands-on knowledge of Databricks Experience with Azure ...

building high-performing, scalable systems and solving complex technical challenges? We’re looking for a talented engineer with strong expertise across .NET, Azure Data Factory, Azure Services and SQL Server to join our team during an exciting period of data and platform transformation. … similar tools) Experience integrating applications with complex data backends Experience in Azure services such as App Services, Functions, or Service Bus ETL pipeline development using Azure Data Factory Familiarity with Databricks , Synapse , or Spark Experience working within event-driven architectures Understanding of DevOps principles , Infrastructure ...

Company NW Tech is delighted to be working with a North East based B2C business in their search for a Data Engineer. Joining a growing team, you will get the opportunity to help build, maintain and optimise data pipelines that support analytics and reporting projects across … will be hybrid, with a minimum of 2 days expected in the office each week. The Role Key responsibilities: Design, build and maintain data pipelines using Azure Data Factory and Azure Databricks Develop and optimise PySpark and SQL transformations Model data using dimensional modelling ...

title: Manufacturing Data Scientist Reference: 50899 Location: Halewood, Merseyside Duration : Permanent Start date: ASAP Salary: £46,587.88pa + 33 days holiday per year; 25 vacation & 8 bank holidays GPW Recruitment are partnering with Ford Halewood Transmissions Ltd (FHTL) in Halewood to recruit a Manufacturing Data Scientist. … facility to transform it to build electric power units for future Ford all-electric passenger and commercial vehicles. On Offer as the Manufacturing Data Scientist Salary of £46,587.88pa 33 days holidays per year(25 vacation & 8 bank holidays) Hours of work are Monday to Thursday ...

RealityMine has been a pioneer in delivering data driven insights to the world's largest brands for over a decade. Our platform provides unique data solutions to our clients enabling them to make strategic, informed decisions powered by data from real people, collected … privacy safe way. We are now looking for a Data Scientist to help build and mature our monitoring and alerting infrastructure, as well as introduce automation tooling to our existing systems. This is a pivotal role for someone who thrives in autonomous environments and enjoys owning solutions from ...

+ Car allowance Bolton- Hybrid We're partnering with a client who is looking to hire an experienced Solutions Architect with a strong data-led focus to support the evolution of their cloud and analytics landscape. This role is well suited to someone who enjoys operating at both … strategic and hands-on level, shaping data architecture while guiding technical teams through complex transformation initiatives. As Solutions Architect, you will be responsible for: Gaining a deep understanding of the client's existing data platforms and legacy systems, and defining clear migration paths to Azure-based ...

Role Based in Manchester, you will work as a Data Engineer responsible for designing, building, and maintaining robust data pipelines and data architectures. You will work closely with stakeholders to understand complex data challenges, transform raw data into meaningful insights … support analytics and reporting. This includes working with batch, streaming, real-time, and unstructured data, applying distributed compute techniques to handle large datasets efficiently. This is a hybrid role, with time split between the Manchester office and working from home. Key Responsibilities Develop and maintain data ...

Bolton As a data engineer specialising in generative AI ; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. Salary : Circa … including subsidised meals, free car parking and much more... The opportunity: The MBDA IM GenAI delivery Office department is looking for an experienced data engineer able to evaluate design, deploy, improve and support MBDA data sets. You will ensure MBDA data pipelines are designed ...

customers, partners, and stakeholders. If you’re someone who likes to “run it like it’s your own business” , enjoys working across data and application layers, and has a strong background in .NET and SQL Server , we’d love to chat! Why Join Us? This is a high … Experience integrating applications with complex data backends Strong problem-solving ability and ownership mindset Passion for knowledge sharing and mentoring others ETL pipeline development using Azure Data Factory Exposure to DataBricks, Synapse or Spark Experience working within event-driven architectures Understanding of DevOps, IaC (Terraform ...

deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions … modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global ...

Data Engineering Apprentice role is a developmental position within the Digital Team. During the apprenticeship you will work 5 days per week, inclusive of 1 day per week for study at BPP University. On completion of this apprenticeship, you will obtain a Level 5 Data Engineering … qualification. Role We are looking for an enthusiastic Apprentice to join our team specialising in Data Engineering for our Engine Business Segment in Darlington, UK. During your apprenticeship with us, you will learn how a major global organisation operates, gaining the tools and exposure you will need ...

your full potential and thrive, please read on. The Opportunity The purpose of the role is to collect, analyse and harmonize procurement master data to unlock insights and support informed decision-making. The target is to ensure that our data is secure, complete, accurate, relevant … broad and varied remit and the successful candidate will have responsibility for duties including: * Collaborate with cross-functional teams to understand data needs and identify opportunities for data collection and analysis. * Develop and implement data collection processes, ensuring accuracy, reliability, and integrity. * Build ...

LEAD DATA ENGINEER (AWS) Remote (UK based) Up to £120,000 + benefits You'll be a technical leader who stays close to the code, and you'll own the data infrastructure and modelling layer while helping the team to grow. THE COMPANY: I'm partnering … focused on scaling up while maintaining their hands on and quality culture. THE ROLE Lead the design and implementation of the modern data warehouse architecture Build and optimise data pipelines for ingestion, transformation, and modelling Mentoring Set technical standards and best practices for the data ...

client is an industry leading market-research company who use data-driven insights to provide unique and actionable data for some of the world's most recognised brands. Over the last 12 months they've experienced a period of rapid growth and they are positioned … continue this growth for the foreseeable future so it's an ideal time to join the team. They need a strong Data Scientist to design, develop and deploy systems to monitor data health. Key Responsibilities: •Design and implement monitoring and alerting systems to ensure the reliability ...

Lead Data Engineer (GCP) - Hybrid (Very Flexible - London) - Up to £100k + bonus + great benefits - Permanent We’re recruiting on behalf of a UK organisation building a brand new GCP data analytics platform from the ground up. This is a greenfield opportunity for a hands … Lead Data Engineer to shape architecture, standards, and delivery from day one. You’ll provide technical leadership across the data engineering team, working closely with senior stakeholders to design and deliver a scalable, reliable analytics platform that drives real business value. On Offer Salary ...

requirements. You will work closely with stakeholders across the organisation to gather reporting requirements, design robust reporting solutions, and implement controls that ensure data accuracy and consistency. The role also supports data requirements linked to claims processing and contractual reporting. Key Responsibilities: Deliver measurable business impact … Power BI dashboards and reports that are scalable, insightful, and user-focused. Partner with stakeholders to translate business needs into actionable insights and data products. Influence decision-making through clear data storytelling, analysis, and visualisation. Act as a subject matter expert in Power BI, including ...

RealityMine has been a pioneer in delivering data driven insights to the world's largest brands for over a decade. Our platform provides unique data solutions to our clients enabling them to make strategic, informed decisions powered by data from real people, collected … way. We are now looking for a Machine Learning Engineer to help build and optimise production-ready machine learning systems and advance our data pipelines for inference at scale. This is a pivotal role for someone who thrives in autonomous environments and enjoys owning solutions from concept ...

Responsibilities: Design, implement, and maintain data pipelines to ingest and process OpenShift telemetry (metrics, logs, traces) at scale. Stream OpenShift telemetry via Kafka (producers, topics, schemas) and build resilient consumer services for transformation and enrichment. Engineer data models and routing for multi-tenant observability; ensure lineage … proactive insights). Implement schema management (Avro/Protobuf), governance, and versioning for telemetry events. Build automated validation, replay, and backfill mechanisms for data reliability and recovery. Instrument services with OpenTelemetry; standardize tracing, metrics, and structured logging across platforms. Use LLMs to enhance observability capabilities (e.g., query assistance ...

United Kingdom (Hybrid working) Why Apply? This is an opportunity to shape how enterprise machine learning is delivered at scale within a modern data environment. Working on a strategic Lakehouse platform built on Databricks, you will influence how production ML models are designed, governed and optimised, helping … business turn complex data into reliable, decision-driving insight. The role combines hands-on engineering with MLOps leadership, strong stakeholder engagement and long-term platform thinking. Responsibilities * Lead the design, build, deployment and monitoring of production machine learning models using Databricks, ensuring performance, reliability and continuous improvement * Define ...

Sheffield (3 days on-site per week) Candidates must be eligible for BPSS clearance We're looking for a highly skilled Senior Data & Observability Engineer to design, build, and evolve large-scale telemetry and observability capabilities across modern cloud platforms. This role is ideal for someone who thrives … high-volume, real-time data environments and enjoys solving complex engineering challenges. What You'll Do Design, implement, and maintain scalable data pipelines to ingest and process telemetry (metrics, logs, traces) from OpenShift and Kubernetes platforms. Stream telemetry via Kafka-managing producers, topics, schemas, and building ...

Opportunity Overview The KTP aims to transform CARA_EPS into a data-driven retrofit company, positioning them the preferred partner for housing associations in their retrofit programs. The project aims to develop an integrated digital asset management (DAM) platform to address issues of unreliable property data and poor housebuilding procurement practices, which are common within the industry. Key Responsibilities Key responsibilities include enhancing retrofit assessment data transparency and accessibility, forecasting property energy performance, and decision-making in housing stock refurbishment. The platform will enable early verification of property/project specifications ...

works. You will help us automate manual tasks, connect AI agents to our CRM and ERP systems, strengthen customer interactions with data-driven “proof packages,” and explore new AI-enabled capabilities that strengthen our position as a UK leader in custom battery technology. This role is ideal … documentation, production forecasting). Create AI workflows that integrate with our CRM and ERP systems (including IFS Cloud), enabling smarter insights, rapid data retrieval, and improved traceability. Maintain AI agents that support internal teams, including text-analysis bots, report generators, and knowledge-retrieval tools. Data engineering ...

current hybrid working arrangement requires office attendance on Mondays, Tuesdays, and Thursdays. Summary of the Role We’re looking for a Data & Automation Engineer to join our AI team. This hybrid technical role blends coding expertise with advanced low-code orchestration to design, build, and maintain data … Head of AI, you’ll play a critical role in connecting agency systems with Generative AI models, ensuring secure, efficient, and accurate data flow. What You Can Expect to Be Doing: Design and deploy sophisticated automation workflows using tools like n8n and Dify. Develop custom scripts (Python/ ...

growing our AI capabilities and we’re looking for curious problem solvers who love turning data into decisions. If you enjoy spotting patterns, learning to write code, and testing ideas with evidence, this is where you’ll make a difference. Role During this programme, you’ll work … areas such as below work as part of team to become expert-level data and AI talent: AI Adoption & Enablement – helping shape, test and improve ML models, data pipelines, or automation solutions Data & Insights – partnering with product, operations or customer facing teams to understand ...