1 to 25 of 60 Data Pipeline Jobs in the North of England

continue to expand throughout the UK. Main duties of the job The role holder will be accountable for designing, building, and maintaining the data infrastructure and pipelines that enable efficient and accurate data collection, storage, processing, and analysis. The role holder will collaborate with cross-functional … data pipelines and optimise data processing and query performance. Implement monitoring systems and processes to track data pipeline health, identify issues and ensure timely resolution. Document data engineering processes, data flows, and system configurations to facilitate knowledge sharing ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

high-quality care. The ideal candidate will lead the design and execution of cloud-based based scalable data storage solutions, oversee ETL pipeline development and optimisation, establish and manage data schemas and dictionaries, develop data integration solutions, and lead data cleansing … lookout for performance bottlenecks and working to optimise data processing and query performance. This will help make sure your data pipeline is scalable and ready to handle big loads. You'll also be setting up monitoring frameworks to keep an eye on how your data ...

high-quality care. The ideal candidate will lead the design and execution of cloud-based based scalable data storage solutions, oversee ETL pipeline development and optimisation, establish and manage data schemas and dictionaries, develop data integration solutions, and lead data cleansing … lookout for performance bottlenecks and working to optimise data processing and query performance. This will help make sure your data pipeline is scalable and ready to handle big loads. You'll also be setting up monitoring frameworks to keep an eye on how your data ...

having you join our journey and seeing how far we can go, together! The position: We're looking for a Senior Database & Cloud Data Engineer who will be responsible for designing, developing, and maintaining robust, scalable, and secure data solutions across on-premises and cloud environments. … This role plays a key part in modernising our data infrastructure, optimising data pipelines, and ensuring the integrity, availability, and performance of the critical data assets. You will collaborate closely with architects, analysts, and business stakeholders to build cloud-native data platforms ...

Title: Data Engineer Location: York, 4x per week Salary: Up to £65,000 Why Apply? This is an opportunity to step into a high-impact Data Engineer role within a growing organisation that is investing heavily in its data capabilities. You'll play … central role in shaping a modern, cloud-based data platform that underpins analytics, reporting, and data products across the business. You will drive business value by designing, building, and maintaining a scalable, secure data platform. Delivering robust data pipelines and trusted datasets ...

Azure Data Engineer - £500PD - Hybrid We are seeking an Azure Data Engineer with strong experience in Databricks to design, build, and optimize scalable data pipelines and analytics solutions on the Azure cloud platform. The ideal candidate will have hands-on expertise across Azure data services, data modeling, ETL/ELT development, and collaborative engineering practices. Key Responsibilities * Design, develop, and maintain scalable data pipelines using Azure Databricks (Python, PySpark, SQL). * Build and optimize ETL/ELT workflows that ingest data from various on-prem ...

Company Nigel Wright are delighted to be partnering with the Institute of Directors in their search for a Senior Data Engineer.The Institute of Directors (IoD) is a thriving membership community for Directors in the UK and beyond, where you can connect with other leaders, develop your skills … multiple sources (internal systems, external datasets) Ensure data quality, cleansing and governance processes are implemented Monitor, troubleshoot and optimise data pipeline and data warehouse performance to ensure high availability and efficiency Liaise closely with business and IT stakeholders, including directors and senior leadership ...

Contract Data Engineer 3 month initial contract (with good chance of extension) Manchester, 2 days per week on-site Outside IR35 Start before Christmas Overview My client are a well knwon organsation just outside Manchester looking for a contract Data Engineer. You will review and improve … Skills Strong hands-on Data Engineering experience Advanced Python for data transformation Google Cloud Platform production experience Data pipeline design and optimisation Data quality automation and monitoring Customer data and identity matching GDPR and data governance delivery ...

looking for a Lead Data Architect to provide strategic leadership and technical expertise in the design and development of data solutions. This role involves setting technical standards, evaluating new technologies, and shaping our approach to data. You will lead a team of Data Architects … significant on-premise design experience. 5+ years in data engineering or business intelligence roles. Extensive ETL and data pipeline design experience, technology agnostic. Proficiency in SQL and experience with data engineering coding languages such as Python, R, or Spark. Understanding of data ...

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £65,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think … scalable pipelines, secure platforms, and data systems that directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines ...

will be open and honest and show that you are reliable. As our Business Intelligence Analyst , you will be responsible for transforming organisational data into meaningful insight. This role will focus on understanding data structures within Databricks, preparing data for analysis, and building impactful … Power BI dashboards and automated reports. It is ideal for someone who is technically capable, data-driven and passionate about enabling the business to make informed decisions. This role sits within our Commercial Finance team and reports into the FP&A Manager. Job Responsibilities Your key responsibilities ...

award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data ...

award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data ...

where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Role We are looking for an experienced, driven, and hands-on data engineer with strong data … lead the delivery of a key migration project. You will play a key role in the migration and redevelopment of an existing Data Warehouse into a modern AWS-based environment. This position focuses on analysing current ETL processes, understanding existing data structures, and re-engineering them ...

fast-growing UK-based company helping customers navigate complex financial and insurance claims. Our success is built on trust, innovation, and data-driven decision-making - and now we're looking to expand our analytics team to support smarter, faster business outcomes. We are seeking a Senior Data Engineer to join their high-performing data team and help shape the future of our data ecosystem. You will play a key role in designing, building, and scaling robust data platforms that support analytics, reporting, and advanced insight across the organisation. ...

Company description: Water Utility Company based in Yorkshire region of England. Job description: Data Engineering Technical Lead Hello! Thanks for stopping by. Let us tell you about all the great reasons to join us here at Yorkshire Water: We offer a competitive salary, depending on experience … bonus (£1000 maximum bonus opportunity for the performance year) Attractive pension scheme (up to 12% company contribution) Development opportunities in line with the Data Engineering Technical Lead progression plan 25 days annual leave plus bank holidays plus an extra wellness day! Life assurance cover of 4 times pensionable ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial … markets. They are expanding their engineering capability in Newcastle and are looking for a talented Data Engineer to join their team. This role will focus on building and optimising systems that make complex datasets accessible, reliable, and valuable for the business. As a Data Engineer ...

Master Data Management (MDM) Analyst - Manchester - Hybrid (3 days on-site) - Up to £50k Client Details: A data-driven recruitment organisation based in Manchester is looking for an MDM Analyst to support and improve its master data capability, with Tamr at the core … platform. The Role: Support day-to-day operation of the Tamr platform Ensure data quality, integrity and accurate mastering across key data domains Work closely with Finance, Operations and Analytics teams Contribute to data governance and stewardship initiatives Key Responsibilities: Monitor data ...

take a strategic, high-level view of the data platform while still diving deep when needed. You will focus on observability, automation, pipeline performance, operational excellence, and cloud cost optimisation. You'll work cross-functionally with Data Engineering, DevOps, and FinOps teams, helping ensure that … Essential Strong experience working with Azure cloud platform Background in data engineering and building/maintaining data pipelines Experience with pipeline monitoring, observability, and incident troubleshooting Strong automation mindset and ability to build resilient, self-healing data workflows Nice to Have Knowledge ...

Databricks Data Engineer - Leeds - Up to £70,000 Location: Leeds (Hybrid - 2 days per week onsite) Job Type: Permanent About the Company Our client is a rapidly growing data-driven consultancy helping enterprise-scale organisations modernise their data estates. With several major new projects … kicking off in early 2026, they are expanding their Leeds engineering hub and looking for a Databricks-focused Data Engineer to join their high-performing team. You will design, build, and optimise cloud-based data pipelines that feed analytics, AI, and real-time insights. ...

Data & Analytics Manager Sheffield – Hybrid (3 days in, 2 days home) £45,000 - £65,000 DEO + excellent benefits A prestigious Sheffield based organisation is looking for a confident and forward-thinking Data & Analytics Manager to bring clarity, insight and strategic impact to the way they … information across the business. If you love turning data into powerful stories, enjoy influencing decisions at every level and thrive in environments where you can shape how analytics is understood and used, this role offers an exciting opportunity to make a real mark. Working closely with teams across ...

Contract Data Engineer - Databricks & Azure (SC Cleared) Location: Newcastle (2-3 days onsite per week) Rate: £450 per day (Outside IR35) Duration: 6 months Clearance: Active SC clearance is mandatory Expenses: Not reimbursed - candidates must be based in or near Newcastle About the Role We are seeking … experienced Data Engineer with strong expertise in Databricks and Azure to join a high-profile Public Sector project. This is a 6-month contract, outside IR35, requiring Security Clearance (SC) and regular onsite presence in Newcastle. Key Responsibilities Design, develop, and maintain scalable data pipelines using ...