1 to 25 of 109 Data Pipeline Jobs in the North of England

Job summary We are looking for an experienced Senior Data Engineer with … strong technical expertise and innovative mindset to drive our team forward. Main duties of the job Data Engineer will be involved in the entire data pipeline from data acquisition to data extraction, ensuring that the data is accurate, reliable, and accessible, and fit-for-purpose for business intelligence, analytics … and data science functions. Data Engineer will be collaborating with cross-functional teams to support the delivery of impactful analytics work for our clients. About us We are the official research support team for the NHS Benchmarking Network, working with over 300 healthcare organisations across the UK to identify opportunities for service development and quality improvement. More ❯

allowance based on a skills assessment Published on 10 July 2025 Deadline 30 July 2025 Location Croydon, Manchester, Sheffield About the job Job summary As a Lead Data Architect, you will create and uphold data architecture across critical Home Office systems, enabling secure, data-driven services that keep the country safe. Working under the … vision set by the Principal Data Architect, you'll design robust data models, metadata systems, and governance frameworks to serve diverse stakeholders. Your leadership will span strategic planning, mentoring junior data architects, and aligning technical decisions with business objectives. If you thrive on architecting solutions that integrate emerging technologies such as cloud-native platforms … data lakehouses, streaming data pipelines and AI-powered analytics while collaborating with multi disciplinary teams, this role offers you the chance to elevate how the Home Office exploits data for maximum public impact. Due to business requirements this post is available on a full time/flexible working basis. Where business needs allow, some More ❯

allowance based on a skills assessment Published on 10 July 2025 Deadline 30 July 2025 Location Croydon, Manchester, Sheffield About the job Job summary As a Lead Data Architect, you will create and uphold data architecture across critical Home Office systems, enabling secure, data-driven services that keep the country safe. Working under the … vision set by the Principal Data Architect, you'll design robust data models, metadata systems, and governance frameworks to serve diverse stakeholders. Your leadership will span strategic planning, mentoring junior data architects, and aligning technical decisions with business objectives. If you thrive on architecting solutions that integrate emerging technologies such as cloud-native platforms … data lakehouses, streaming data pipelines and AI-powered analytics while collaborating with multi disciplinary teams, this role offers you the chance to elevate how the Home Office exploits data for maximum public impact. Due to business requirements this post is available on a full time/flexible working basis. Where business needs allow, some More ❯

Senior Data Ops Data EngineerLeeds 2/3 days per week£55,000-£67,000+ Excellent Benefits18 Months FTC with long term potential Your New Company Our large public sector organisation are seeking a senior Data Platform DataOps Engineer to serve as our clients first DataOps specialist in a growing team of Data Engineers and DevOps professionals.In this pivotal role, you will focus on operationalising and automating their data lifecycle to ensure that data workflows perform with reliability and efficiency. You will integrate CI/CD data pipelines, streamline deployment processes, enforce robust data governance, and optimise operational costs within our Microsoft Azure … APIM. Proficiency in developing CI/CD data pipelines and strong programming skills in Python, SQL, Bash, and PySpark for automation. Strong aptitude for data pipeline monitoring and an understanding of data security practices such as RBAC and encryption. Implemented data and pipeline observability dashboards, ensuring high data More ❯

that adventure. Our employees are at the heart of delivering impactful and meaningful work for our clients and helping them to reach for and realise their vision. Snowflake Data Architect Slalom is seeking an experienced Snowflake Data Architect to contribute to its growing Data Capability. The ideal candidate is a professional with experience in … designing, developing, validating and communicating enterprise data solutions using Snowflake. Deep experience in developing enterprise data management strategies including data lake/warehouse implementations, data movement, data services, data acquisition, data conversion, and archive/recovery. What will you do? Lead as a hands-on architect … and governance concepts such as data quality, metadata management, etc. Experience in designing data engineering solutions using open source and proprietary cloud data pipeline tools Experience in leading data platform development teams Knowledge of data science and visualisation Must have Snowflake SnowPro Core Certification and ideally SnowPro Advanced too More ❯

As a Lead Data Architect, you will create and uphold data architecture across critical Home Office systems, enabling secure, data-driven services that keep the country safe. Working under the vision set by the Principal Data Architect, you'll design robust data models, metadata systems, and governance frameworks to serve … diverse stakeholders. Your leadership will span strategic planning, mentoring junior data architects, and aligning technical decisions with business objectives. If you thrive on architecting solutions that integrate emerging technologies such as cloud-native platforms, data lakehouses, streaming data pipelines and AI-powered analytics while collaborating with multi disciplinary teams, this role offers you the … chance to elevate how the Home Office exploits data for maximum public impact. In this role, you will translate strategic data vision into tangible designs and solutions, ensuring data assets are secure, well-structured, and aligned with evolving Home Office priorities. Partnering with Technical Architects, Principal Data Architects, and various data More ❯

Job summary Ready to take on a career-defining challenge? HDFT are looking for two Senior Data Engineers to play a pivotal role in a ground-up deployment of Microsoft Fabric. This is a rare opportunity to work on a completely greenfield project, shaping architecture and developing robust, scalable data pipelines using best-fit technologies. What … s in it for you? - Immediate exposure to Microsoft Fabric -- be at the forefront of cutting-edge data engineering. - Greenfield deployment -- minimal legacy constraints, just innovation. - Critical role -- influence architecture, tooling, and best practices from day one. - Technology-first environment -- work with modern cloud and data technologies to build something that lasts. What you'll be … doing - Designing and implementing high-performance data pipelines for real time and batch processing. - Architecting a future-proof data platform, leveraging Microsoft Fabric and other best-in-class tools. - Collaborating with cross-functional teams to drive data strategy and governance.- Optimising performance, ensuring scalability, security, and reliability. What we're looking for - Proven experience More ❯

DEPT/AI has a single mission: to make the best work in the industry using Data & AI to enhance everything we do. This role sits within our Data & AI practice, which has deep expertise in leveraging AI. The team includes data strategists, consultants, data scientists and analysts that work alongside DEPT … and most challenging problems facing some of the best loved brands in the world - and doing this alongside an experienced team. This role is part of our EMEA Data craft team, an integrated craft across Europe driving data engineering, data science, and AI initiatives. We combine our expertise in data architecture, analytics … and AI to deliver exceptional data-driven solutions that build lasting relationships with our clients like Footlocker, Nikon, Rituals, and Philips ROLE OVERVIEW The Lead Data Engineer is responsible for building and leading our data engineering capabilities across EMEA and setting technical standards. This senior technical leadership role will drive the strategic vision for More ❯

Purpose of the Job: Design, build, and maintain robust data systems and pipelines that support data storage, processing, and analysis on the Cloud. Work with large datasets, ensuring data quality, scalability, and performance, while collaborating. closely with data scientists, analysts, and other engineering teams to understand their data needs and … provide them with high-quality, accessible data. They are responsible for ensuring that the underlying data infrastructure supports the organizations broader data and business goals, enabling more effective data-driven decision-making. Key Accountabilities: • Design and implement scalable, efficient, and secure data architectures, ensuring optimal data flow across systems in … and process across the team along with BI lead. • Influence the evolution of business and system requirements and contribute to the design of technical solutions to feed a delivery pipeline that increasingly employs Agile methods such as SCRUM and Kanban • You will be required to develop unit tested code and then support test cycles including post implementation validation. You More ❯

Social network you want to login/join with: We are looking for an experienced Data Governance Lead to drive enterprise-wide data governance initiatives with a focus on modern cloud data platforms, specifically Databricks and Microsoft Azure. This role will define and enforce data policies, standards, and best practices that ensure … high data quality, security, and regulatory compliance across our data ecosystem. You will collaborate with cross-functional teams to embed governance into our cloud-based data architecture and analytics processes. Key Responsibilities: Develop and implement enterprise-level data governance frameworks, standards, and operating models, aligned with business objectives and compliance requirements. Collaborate … with data engineering and platform teams to integrate data governance within Databricks and Azure environments, including Data Lake, Synapse, and Purview. Define and enforce data classification, access management, and lineage tracking using Azure-native and third-party tools. Lead the Data Governance Council, facilitate stakeholder engagement, and ensure alignment across More ❯

hunt for builders . No, we've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries such as … to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We're Intuita - a fast growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for … in the data pipelines. • Stay updated with the latest Azure technologies and industry best practices to continuously enhance data engineering capabilities. Looking at our current pipeline of work, we can also consider those with an Analytics Engineering lean, with experience within BigQuery (GCP) with data modelling in DBT and mobile/telecoms industry More ❯

Senior Machine Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they … our colleagues too; we won Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the people inside and outside our … Deploying Infrastructure as Code (IAC) across various environments such as dev, uat and prod Handling large volumes of data in various stages of the data pipeline, from ingestion to processing Proven experience with feature stores, using them for both offline model development and online production usage Building integrations between cloud-based systems using APIs, specifically More ❯

Senior Machine Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they … our colleagues too; we won Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the people inside and outside our … Deploying Infrastructure as Code (IAC) across various environments such as dev, uat and prod Handling large volumes of data in various stages of the data pipeline, from ingestion to processing Proven experience with feature stores, using them for both offline model development and online production usage Building integrations between cloud-based systems using APIs, specifically More ❯

and want to take your career further in a thriving office environment? Are you a strong communicator who works well within a team? Do you understand data pipeline tools and data modelling? Were seeking an SQL Developer to join our expanding Database team in Leeds! In the role, you will: Analyse business requirements through collaboration … with stakeholders, IT Management, and the user community Develop new systems, integrate third-party platforms, and maintain existing applications Use data to deliver business improvements and support informed decision-making Work with stakeholders on data extraction and manipulation tasks Write and optimise in-application SQL statements Provide user support for report errors, debugging, and issue resolution … experience in a database developer/data engineer role Proficiency in SQL and Python Experience with cloud platforms (AWS, GCP, or Azure) Familiarity with data pipeline tools (e.g., SSIS, Spark) Strong grasp of data warehousing and data modelling principles Experience undertaking development work in C# Ability to create and troubleshoot SSRS More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £60,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … stakeholders across the business. Key Responsibilities: Develop scalable and secure data architectures ensuring optimal data flow Cloud data platform development, data modelling, shaping and technical planning Implementing best practices around data security, governance, privacy, and compliance Ensure company data is secure, accurate, maintained and available. Mentor data More ❯

Place Informatics is helping redefine how the UK's leading organisations understand people and places. We transform billions of data points on movement and demographics into powerful insights that drive smarter decisions in Retail, Tourism, Local Government, Outdoor Leisure and Real Estate. As part of our passionate team, you'll help the team who unlock patterns in human … that make a real-world impact. If you're driven by curiosity and want your work to influence the future of location analytics, join us and help make data work smarter. About the Role: Senior Database Administrator (DBA)/Data Ops Engineer You will be responsible for the management, optimisation, and reliability of our databases and … implement processes for loading, validating, and managing data sets Ensure data security, integrity, and compliance with relevant standards Automate routine database and data pipeline tasks to improve efficiency Support the development and deployment of new data-driven products and features Collaborate with cross-functional teams to deliver high-quality data More ❯

a great place to work and as our business expands, we are looking for ambitious, talented people to join us. We are looking for a technically proficient Senior Data Engineer to join our growing Data team. Your primary focus will be on ensuring data quality, stability, and reliability … from the moment data arrives in its rawest form to when it is used in decision-making dashboards and customer-facing reports. You will optimise the transformation pipeline from start to finish, guaranteeing that datasets are robust, tested, secure, and business-ready. Our data platform is built using Databricks, with data pipelines written … in PySpark and orchestrated using Airflow. You will be expected to challenge and improve current transformations, ensuring they meet our performance, scalability, and data governance needs. This includes work with complex, nested data structures, ensuring they are reliably parsed and transformed. Experience in managing sensitive data (PII) and implementing GDPR policies is required. You More ❯

Job Position: Graduate Data Analyst (Engineer/Scientist) - via the Graduate Development Programme Locations: Sheffield and South Yorkshire Starting Salary: £25,000 Application Requirements: Minimum 2:1 or above in a STEM (Science, Technology, Engineering, and Math) subject. Experience in analysing data. Right to work in the UK unsponsored for the duration of the programme. Ability to work … delivering excellence. If you have a keen attention to detail and accuracy, a knack for spotting trends and patterns and the ability to tell a compelling story using data, you'll thrive in our environment. We value resourcefulness, resilience, and a passion for driving change. Join us and be part of a community that cares, collaborates, and thrives … together. Understanding the types of roles available to a Data Analyst: Data Analyst: Kick-start your career as a Data Analyst, where you'll transform complex data into actionable insights, create dynamic visualisations and drive business decisions. You'll work with cutting-edge tools, collaborate with stakeholders, and develop automated reports and More ❯

Job Position: Graduate Data Analyst (Engineer/Scientist) - via the Graduate Development Programme Locations: We are able to consider candidates across the North West Starting Salary: £25,000 Application Requirements: Minimum 2:1 or above in a STEM (Science, Technology, Engineering, and Math) subject. Experience in analysing data. Right to work in the UK unsponsored for the duration … delivering excellence. If you have a keen attention to detail and accuracy, a knack for spotting trends and patterns and the ability to tell a compelling story using data, you'll thrive in our environment. We value resourcefulness, resilience, and a passion for driving change. Join us and be part of a community that cares, collaborates, and thrives … together. Understanding the types of roles available to a Data Analyst: Data Analyst: Kick-start your career as a Data Analyst, where you'll transform complex data into actionable insights, create dynamic visualisations and drive business decisions. You'll work with cutting-edge tools, collaborate with stakeholders, and develop automated reports and More ❯

DV Cleared Data Consultant – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you. Morela is proud to partner with one of the UK … s leading data consultancies, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled DV Cleared Data Consultant to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects. … operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a DV Cleared Data Consultant, you'll play a crucial role in designing and implementing data solutions that empower clients to make informed More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester(Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies)About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment.About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate … about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you.Key Responsibilities:Design, develop, maintain, and optimise data pipelines More ❯

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients' needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior … Data Engineer, you may assume multiple roles based on our clients' needs. The role is highly hands-on, supporting project delivery as a senior contributor and upskilling client team members. You might also take on a technical architect role, collaborating with the MadeTech team to identify growth opportunities within the account. You'll need a drive to deliver … criteria. Enthusiasm for learning and self-development Proficiency in Git (including Github Actions) and understanding of branch strategies Experience gathering and meeting requirements from clients and users on data projects Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments Managing cloud infrastructure with a DevOps approach Handling and transforming various data types (JSON More ❯

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients' needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior … Data Engineer, you may assume multiple roles based on our clients' needs. The role is highly hands-on, supporting project delivery as a senior contributor and upskilling client team members. You might also take on a technical architect role, collaborating with the MadeTech team to identify growth opportunities within the account. You'll need a drive to deliver … criteria. Enthusiasm for learning and self-development Proficiency in Git (including Github Actions) and understanding of branch strategies Experience gathering and meeting requirements from clients and users on data projects Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments Managing cloud infrastructure with a DevOps approach Handling and transforming various data types (JSON More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment. About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone … passionate about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you. Key Responsibilities: Design, develop, maintain, and optimise data More ❯

Job Title: Senior Data Engineer Location: Hybrid – 1 day per fortnight in the Wilmslow offices Working hours 0900 to 1730 The Role Following recent investment, The Citation Group are looking to build out their data capabilities to be Best in Class. As such, a fantastic opportunity has arisen for a strong data engineer to … work in the data engineering team, to expand and maintain the data infrastructure that provides the foundations from which our BI, Data Science and Operational Data teams deliver insights and revenue to the functions across the wider group. We’re looking for an individual who has experience working with enterprise grade data pipelines and infrastructure, who can implement processes on our modern tech stack with robust, pragmatic solutions. Responsibilities develop, and maintain ETL/ELT data pipelines using AWS services Data, Databricks and dbt Manage and optimize data storage solutions such as Amazon S3, Redshift, RDS, and DynamoDB. Implement and manage infrastructure-as-code More ❯