1 to 25 of 70 DemandTrendPermanent Data Pipeline Jobs in the North of England

Job summary The role holder is responsible for the leading the design, development, and ongoing enhancement of organisations data infrastructure and pipelines to support advanced data collection, storage, processing, and analysis. Main duties of the job The role holder is accountable for a team of data engineers, fostering a culture of technical excellence and … continuous improvement. The role holder will work collaboratively with cross-functional teams, including analysts, software engineers, and key stakeholders, to ensure that data solutions are robust, scalable, and aligned with the strategic goals of delivering high-quality care for our patients. About us Since 2012, CHEC has been working with the NHS to increase patient choice and provide … engineering solutions and provide comprehensive reports. Identify and address performance bottlenecks, optimise data processing and query performance for scalability. Implement monitoring frameworks to oversee data pipeline health, swiftly resolving issues to maintain system integrity. Conduct performance tuning to fulfil scalability and availability targets. Develop and enforce stringent data security measures, including access controls More ❯

with a flexible, student-powered workforce. The platform enables partnersfrom local pubs to multinational chainsto optimise staffing in real-time, enhancing efficiency and profitability. The Role As a Data Engineer, you'll play a pivotal role in shaping the data infrastructure. Your responsibilities will include: Building and Maintaining Data Pipelines: Design and implement scalable … data scientists, software engineers, and internal stakeholders to understand data needs and deliver solutions that drive data-driven decisions. Monitoring and Troubleshooting: Oversee pipeline performance, address issues promptly, and maintain comprehensive data documentation. What Youll Bring Technical Expertise: Proficiency in Python and SQL; experience with data processing frameworks such … architecture, data modelling, and scalable data solutions. Backend Development: Willingness to develop proficiency in backend technologies (e.g., Python with Django) to support data pipeline integrations. Cloud Platforms: Familiarity with AWS or Azure, including services like Apache Airflow, Terraform, or SageMaker. Data Quality Management: Experience with data versioning and quality More ❯

We are looking for a highly skilled and motivated Lead Data Engineer to join our growing data team. In this role, you will lead a small team of Data Engineers and Analysts, driving the design, development, and maintenance of scalable, secure, and high-performance data solutions on the Microsoft Azure platform. You … will provide hands-on technical leadership while shaping the strategic direction of the data infrastructure to support analytics, reporting, and business intelligence across the organisation. Location: Stockton on Tees Department: Data & Analytics Employment Type: Full-Time/Permanent/Hybrid Key Responsibilities Lead and mentor a team of Data Engineers/Analysts, fostering a … culture of innovation, collaboration, and continuous improvement. Design, build, and optimise data pipelines, data models, and data warehouses using Azure Synapse Analytics, Azure Data Factory, and Azure SQL. Ensure the reliability and performance of data pipelines and infrastructure. Collaborate with stakeholders and analysts to deliver impactful dashboards and reports using More ❯

We are looking for a highly skilled and motivated Lead Data Engineer to join our growing data team. In this role, you will lead a small team of Data Engineers and Analysts, driving the design, development, and maintenance of scalable, secure, and high-performance data solutions on the Microsoft Azure platform. You … will provide hands-on technical leadership while shaping the strategic direction of the data infrastructure to support analytics, reporting, and business intelligence across the organisation. Location: Stockton on Tees Department: Data & Analytics Employment Type: Full-Time/Permanent/Hybrid Key Responsibilities Lead and mentor a team of Data Engineers/Analysts, fostering a … culture of innovation, collaboration, and continuous improvement. Design, build, and optimise data pipelines, data models, and data warehouses using Azure Synapse Analytics, Azure Data Factory, and Azure SQL. Ensure the reliability and performance of data pipelines and infrastructure. Collaborate with stakeholders and analysts to deliver impactful dashboards and reports using More ❯

products and ship updates to customers rapidly. Could you be the next innovator to join us? What’s it all about? Insight and Intelligence drives Atom. As a Data Engineer you will be creating an efficient, sustainable, and agile data analytics platform for a data driven digital bank. You will be using a range … of database technologies and a combination of event driven techniques and batch processing methodologies. In addition you will be expanding and optimizing our cloud-based data & data pipelines as part of a cross functional team. As a Data Engineer at Atom, you will support our software engineers, data architects, and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. What will your ‘typical’ day look like.... (there’s no 2 days the same in Atom): Build and maintain data ETL jobs using a range of tools & techniques Effective use of database and streaming techniques and More ❯

Lead Data Engineer- AWSLeeds (Hybrid) About the Business: Our client is a nationally recognised leader in their industry, operating across the UK with a reputation for innovation and excellence. As part of their continued investment in data, they are building a high-performing data function to support business-wide transformation and insights. This is … a greenfield opportunity to help shape the future of data engineering in a complex, large-scale environment. The Role: We are seeking an experienced Lead Data Engineer to play a pivotal role in the design, build, and implementation of a new enterprise data platform. The business is currently migrating to AWS, and you will … S3, Glue, Lambda, Redshift, Athena, EMR). Experience designing and building data lakes and modern data platforms. Proficiency with Python, SQL, and data pipeline orchestration tools (e.g., Airflow, dbt). Strong understanding of data modelling, ETL/ELT processes, and distributed systems. Knowledge of data security, governance, and compliance More ❯

Data Manager–£36,000- £47,000 + Benefits– Liverpool, L3 The Role Are you experienced in managing clinical data and ensuring its accuracy? Do you have the technical skills to handle imaging-related datasets and streamline workflows with Python?If so, this could be the perfect opportunity for you! We are MyCardium AI , an innovative company … at the forefront of cardiac imaging and AI technology. We are now seeking a Data Manager to join our growing team in Liverpool. You will be responsible for managing the lifecycle of clinical study data, ensuring accuracy, compliance and smooth data handling processes. Working closely with project managers, imaging analysts and sponsor representatives, you … will help ensure that study data is reliable, secure and supports high-quality clinical outcomes. If this sounds like the right opportunity for you, we'd love to hear from you. Apply today and join us on our journey to transform healthcare with AI. This role is 4 days office based (Liverpool)/1 day WFH. Key Responsibilities More ❯

and want to take your career further in a thriving office environment? Are you a strong communicator who works well within a team? Do you understand data pipeline tools and data modelling? Were seeking an SQL Developer to join our expanding Database team in Leeds! In the role, you will: Analyse business requirements through collaboration … with stakeholders, IT Management, and the user community Develop new systems, integrate third-party platforms, and maintain existing applications Use data to deliver business improvements and support informed decision-making Work with stakeholders on data extraction and manipulation tasks Write and optimise in-application SQL statements Provide user support for report errors, debugging, and issue resolution … experience in a database developer/data engineer role Proficiency in SQL and Python Experience with cloud platforms (AWS, GCP, or Azure) Familiarity with data pipeline tools (e.g., SSIS, Spark) Strong grasp of data warehousing and data modelling principles Experience undertaking development work in C# Ability to create and troubleshoot SSRS More ❯

Senior Data Engineer - Azure, Data Factory, Datalakes, SQL - £65,000 - Remote Industry: Retail & eCommerce Role: Senior Data Engineer Location: Remote Salary: £65,000 Benefits The Company We're working with one of the UK's leading retail and e-commerce brands; a business that's experiencing rapid growth and investing heavily in data, analytics, and technology to stay ahead of the competition. With millions of customers, an ever-expanding online presence, and a dynamic product offering, data is at the heart of every decision they make. Their mission is to transform how data is captured, engineered, and consumed across the organisation. Enabling & empowering smarter insights and creating … seamless customer experiences. The Role As a Senior Data Engineer, you'll be a key player in building and evolving a modern Azure-based data platform that underpins decision-making across the business. The Senior Data Engineer will design, deliver, and optimise scalable data solutions, ensuring the right data is More ❯

Join Barclays as a Digital Customer Data Engineer, where you'll be leading the development for a new shared data platform that is transforming how individuals/organisations interact with the bank. Your role involves using the latest data and AI engineering skills to deliver a digital capability. As part of our team, you … ll also benefit from being part of a vast professional network, collaborating with industry mentors and experts. To be successful you should have experience with: Modern data engineering practices, inc. event-driven and data lake. Digital platform development, inc. experience developing colleague and customer facing applications. Banking software development. Deep technical awareness of cloud and data technology, such as Kafka, Data Bricks, microservices, API. Some other highly valued skills may include: Technical design: Analysis and documentation of system characteristics, inc. designing solutions to meet multi-faceted non-functional requirements. Communication Skills: Ability to clearly convey project goals to senior leadership, updates, and technical details to stakeholders at all levels, including non-technical More ❯

Azure Data Engineer - Databricks - Hybrid - Manchester - Up to £65,000 A well-established organisation is seeking a talented Azure Data Engineer to join their growing data team. This is a fantastic opportunity to work on high-impact projects using modern cloud technologies, including Azure and Databricks, in a collaborative and forward-thinking environment. The … Role: You'll be responsible for designing, building, and maintaining scalable data pipelines and solutions that support business intelligence, analytics, and operational reporting. Working closely with data architects, analysts, and stakeholders, you'll help unlock the value of data across the organisation. Key Responsibilities: Develop and optimise data pipelines using Azure Data … Azure Data Services (Data Factory, Databricks, Synapse) Strong knowledge of Python, SQL, and Spark Experience with data modelling, ETL/ELT processes, and pipeline orchestration Familiarity with CI/CD and DevOps practices in a data engineering context Excellent communication and stakeholder engagement skills Desirable: Experience with Delta Lake, Power BI More ❯

Azure Data Engineer - Databricks - Hybrid - Manchester - Up to £65,000 A well-established organisation is seeking a talented Azure Data Engineer to join their growing data team. This is a fantastic opportunity to work on high-impact projects using modern cloud technologies, including Azure and Databricks, in a collaborative and forward-thinking environment. The … Role: You'll be responsible for designing, building, and maintaining scalable data pipelines and solutions that support business intelligence, analytics, and operational reporting. Working closely with data architects, analysts, and stakeholders, you'll help unlock the value of data across the organisation. Key Responsibilities: Develop and optimise data pipelines using Azure Data … Azure Data Services (Data Factory, Databricks, Synapse) Strong knowledge of Python, SQL, and Spark Experience with data modelling, ETL/ELT processes, and pipeline orchestration Familiarity with CI/CD and DevOps practices in a data engineering context Excellent communication and stakeholder engagement skills Desirable: Experience with Delta Lake, Power BI More ❯

Azure Data Engineer - Databricks - Hybrid - Manchester - Up to £65,000 A well-established organisation is seeking a talented Azure Data Engineer to join their growing data team. This is a fantastic opportunity to work on high-impact projects using modern cloud technologies, including Azure and Databricks, in a collaborative and forward-thinking environment. The … Role: You'll be responsible for designing, building, and maintaining scalable data pipelines and solutions that support business intelligence, analytics, and operational reporting. Working closely with data architects, analysts, and stakeholders, you'll help unlock the value of data across the organisation. Key Responsibilities: Develop and optimise data pipelines using Azure Data … Azure Data Services (Data Factory, Databricks, Synapse) Strong knowledge of Python, SQL, and Spark Experience with data modelling, ETL/ELT processes, and pipeline orchestration Familiarity with CI/CD and DevOps practices in a data engineering context Excellent communication and stakeholder engagement skills Desirable: Experience with Delta Lake, Power BI More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester(Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies)About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment.About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate … about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you.Key Responsibilities:Design, develop, maintain, and optimise data pipelines More ❯

Data Engineer - Manchester - £55,000 + Bonus The Company: Lorien Global are working with one of the biggest names in the North West. Having recently completed a large-scale migration, the business is now investing in data to unlock new products, smarter technologies, and unrivalled customer experiences on a global scale. The Role: We're looking … for a Data Engineer to join the growing Data Engineering team, playing a key role in maintaining and evolving a modern AWS-based data platform. You'll be designing and optimising pipelines, supporting the migration of the existing SQL Server Data Warehouse to AWS, and helping to deliver scalable, real-time data … technologies and apply them where relevant The Skill Requirements: Hands-on experience with AWS services (Glue, Lambda, S3, Redshift, EMR) Strong skills in Python, SQL, PySpark and pipeline orchestration Proven understanding of data warehousing and data lakehouse concepts Excellent problem-solving skills with the ability to resolve performance bottlenecks Clear communicator, comfortable working More ❯

Lead Cloud Data Engineer – Liverpool – Hybrid - £70k A well-established professional services business that's modernising their data infrastructure and embracing cloud-first technologies are looking for a Lead Cloud Data Enigneer. Based Liverpool City Centre, they're investing significantly in their data capabilities to enhance client services, improve operational efficiency, and … drive strategic decision-making through advanced analytics and robust data management practices. The Role They're looking for an exceptional Lead Cloud Data Engineer to spearhead their data engineering initiatives and drive technical excellence across their cloud infrastructure. You'll be architecting sophisticated data solutions that power critical business operations whilst leading … dataset processing Deep understanding of data security frameworks, encryption protocols, access management and regulatory compliance Proven track record building automated, scalable ETL frameworks and data pipeline architectures Outstanding analytical and problem-solving abilities with talent for converting business needs into technical solutions Excellent stakeholder management and documentation skills Team leadership experience with ability to mentor More ❯

now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not … limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers More ❯

now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not … limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers More ❯

AWS Data Engineer – Leeds/Hybrid - Upto £60K We’re looking for a Data Engineer to join a growing data team and play a key role in designing, building, and maintaining cloud-native data platforms. The role is based in Leeds (2 days per week on-site) with flexibility for hybrid working. … The role: Design and implement scalable data architectures in the cloud, ensuring secure and reliable data pipelines. Work across the full data lifecycle, supporting data scientists, analysts, and engineering teams. Lead development projects, data modelling, and cloud data platform deployments. Mentor data engineers and contribute to … best practices across the team. Key skills: Strong experience with AWS data services (S3, Redshift, Glue, Lambda, Lake Formation, CloudFormation). Proficiency in SQL, Python (Pandas), Spark or Iceberg. Experience with data warehouse design, ETL/ELT, and CI/CD pipelines (GitHub, CodeBuild). Knowledge of infrastructure as code, performance tuning, and data More ❯

AWS Data Engineer – Leeds/Hybrid - Upto £60K We’re looking for a Data Engineer to join a growing data team and play a key role in designing, building, and maintaining cloud-native data platforms. The role is based in Leeds (2 days per week on-site) with flexibility for hybrid working. … The role: Design and implement scalable data architectures in the cloud, ensuring secure and reliable data pipelines. Work across the full data lifecycle, supporting data scientists, analysts, and engineering teams. Lead development projects, data modelling, and cloud data platform deployments. Mentor data engineers and contribute to … best practices across the team. Key skills: Strong experience with AWS data services (S3, Redshift, Glue, Lambda, Lake Formation, CloudFormation). Proficiency in SQL, Python (Pandas), Spark or Iceberg. Experience with data warehouse design, ETL/ELT, and CI/CD pipelines (GitHub, CodeBuild). Knowledge of infrastructure as code, performance tuning, and data More ❯

Data Engineer – Unlock Insights, Drive Performance Job Title: Data Engineer Salary: £44,133 – £55,166 plus bonus Contract: Permanent Hours: Full-time, Monday to Friday About Graham & Brown Welcome to Graham & Brown, where creativity, innovation, and data-driven decision-making combine to deliver exceptional outcomes for our customers worldwide. Since 1946, we've been … paint, and home décor products, serving both retail and commercial markets across multiple channels and international sites. At Graham & Brown, we value curiosity, collaboration, and continuous improvement. Our data and analytics capabilities are central to our business, enabling smarter decisions, seamless operations, and better customer experiences. Joining us means being part of a dynamic, forward-thinking team where … your technical expertise has a real impact on global operations and growth. The Role We are seeking a skilled and proactive Data Engineer to join our IT and Data & Analytics team. You will be responsible for designing, building, and maintaining data pipelines and integrations as we migrate our data warehouse from Microsoft More ❯

Data Engineering Manager Location: York/Leeds or Manchester (Hybrid) Salary: up to £62,000 + benefits Elevation Recruitment Group are looking for a Data Engineering Manager to lead our clients existing team of data engineers, driving delivery in a complex, fast-moving environment. The successful Data Engineering Manager will have a … strong background as a hands-on data engineer before moving into leadership, be capable of navigating diverse data sources spread across multiple systems and helping the organisation unlock the power of its data. Experience with modern data platform rollouts, especially Microsoft Fabric on Azure will set you apart, as will a track record of … delivering in Agile/Scrum settings. Key duties & Responsibilities: Manage, mentor and develop an existing high-performing data engineering team. Oversee the design, development, and optimisation of data pipelines, warehouses and platforms. Lead projects in complex, multi-source data environments. Maintain governance standards, data lineage and data dictionaries. Collaborate with More ❯

Data Scientist (Hybrid - Manchester) A growing data and analytics company is on the lookout for a Data Scientist to take ownership of its monitoring and alerting infrastructure. This is a fantastic opportunity to play a hands-on role in designing scalable solutions that safeguard data quality and system reliability across a suite … solving complex problems, and wants to shape how monitoring is done across multiple projects and departments. Key Responsibilities: Design and build robust monitoring and alerting systems to maintain data health and accuracy Define KPIs and thresholds in collaboration with technical and non-technical stakeholders Develop and productionise machine learning and statistical … models (Python, PySpark) Deploy monitoring solutions on AWS infrastructure Create scalable frameworks for future monitoring needs Investigate anomalies and ensure quick resolution of issues in the data pipeline Advocate for data quality best practices across the business Provide mentorship and contribute to a culture of continuous improvement About You: Proficient in Python and SQL Experience More ❯

Data Scientist (Hybrid - Manchester) A growing data and analytics company is on the lookout for a Data Scientist to take ownership of its monitoring and alerting infrastructure. This is a fantastic opportunity to play a hands-on role in designing scalable solutions that safeguard data quality and system reliability across a suite … solving complex problems, and wants to shape how monitoring is done across multiple projects and departments. Key Responsibilities: Design and build robust monitoring and alerting systems to maintain data health and accuracy Define KPIs and thresholds in collaboration with technical and non-technical stakeholders Develop and productionise machine learning and statistical … models (Python, PySpark) Deploy monitoring solutions on AWS infrastructure Create scalable frameworks for future monitoring needs Investigate anomalies and ensure quick resolution of issues in the data pipeline Advocate for data quality best practices across the business Provide mentorship and contribute to a culture of continuous improvement About You: Proficient in Python and SQL Experience More ❯

make Smoove a great place to work and as our business expands, we are looking for ambitious, talented people to join us. We are seeking an experienced Principal Data Engineer to define, lead, and scale the technical strategy of our data platform. This is a senior, hands-on leadership role at the intersection of architecture, governance … and engineering excellence, where you will shape how data is collected, processed, and delivered across the organisation. You will own the end-to-end quality, performance, and scalability of our data systems - from raw ingestion through to trusted datasets powering business-critical analytics and reporting. This includes setting standard sand influencing the strategic roadmap for data infrastructure. Our stack is built on both AWS and Azure, using Databricks across data domains and you will lead the evolution of this ecosystem to meet future business needs. You'll ensure that data is secure, compliant, discoverable, and business-ready, enabling analysts, data scientists, and stakeholders to make confident, data More ❯