51 to 75 of 964 Data Pipeline Jobs in the UK excluding London

Join us in shaping the future of sustainable housing. We're building a cutting-edge regional data platform that unites retrofit programme data from local authorities, contractors, and IoT telemetry to drive smarter decisions and demonstrate real-world impact. As a Data Engineer, you'll design and develop scalable data pipelines and … dimensional models on an enterprise-grade data lake, enabling high-quality, insight-rich datasets and APIs. Your work will power dashboards and reporting tools that help partners track outcomes, measure value, and accelerate carbon reduction. If you're passionate about data, innovation, and making a tangible difference, we want to hear … from you! Please note, this is a fixed term contract for a period of 12 months. What you will be doing. Design and develop Extract, Transform and Load (ETL) pipeline processes to automate the access to source data, quality check and increase the usage. Asist with the development of new data analysis and reporting systems. More ❯

Senior Data Architect is required by this leading organisation in their field as they look to improve their enterprise and information architectures, ensuring they are robust, future-ready with a capability to support current and future business needs. The focus will be to empower data-led and AI-enhanced decision making across the organisation. You will … be required to deliver a clear, scalable data framework aligned with the overall enterprise data strategy, with an emphasis on data mesh, enabling the use of AI/GenAI within the business. Responsibilities include - Communicating the enterprise data strategy and operating model to various teams across the business Roadmap definition/strategic … GCP Data mesh Data Governance Data Lakehouse, warehouse and virtualisation concepts MDM/Metadata management ETL/ELT processes and data pipeline builds Data readiness for AI Strong understanding of business architecture Be part of a team shaping the future of data-driven technology within the organisation. More ❯

Job Title: Senior Data Engineer Location: Leeds, on-site 2x per week Salary: Up to £85,000 Why Apply? Our client is looking for a talented Senior Data Engineer to play a key role in their ongoing digital transformation. This position offers the chance to develop the initial data strategy, design scalable pipelines from … scratch, and create a data lake that will be central to reporting initiatives. If you are experienced in managing AWS based data infrastructures and eager to drive innovative solutions, this role is perfect for you. This is a unique opportunity to influence the data strategy and define data architecture from the outset … ll work in a collaborative, forward thinking environment where innovation is encouraged, with flexible working arrangements and opportunities for professional growth. Responsibilities Design, build, and optimise scalable, automated data pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup and ongoing evolution of a centralised data lake in AWS to More ❯

Job Title: Senior Data Engineer Location: Leeds, on-site 2x per week Salary: Up to £85,000 Why Apply? Our client is looking for a talented Senior Data Engineer to play a key role in their ongoing digital transformation. This position offers the chance to develop the initial data strategy, design scalable pipelines from … scratch, and create a data lake that will be central to reporting initiatives. If you are experienced in managing AWS based data infrastructures and eager to drive innovative solutions, this role is perfect for you. This is a unique opportunity to influence the data strategy and define data architecture from the outset … ll work in a collaborative, forward thinking environment where innovation is encouraged, with flexible working arrangements and opportunities for professional growth. Responsibilities Design, build, and optimise scalable, automated data pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup and ongoing evolution of a centralised data lake in AWS to More ❯

Data Engineer (with Data Analytics Background) Location: City of London Employment Type: Full-time Salary: £90,000–£100,000 Sector: Fintech We’re looking for a well-rounded, communicative Data Engineer with a strong background in data analytics and experience within the Fintech sector . This role is ideal for someone who … began their career as a Data Analyst and has since transitioned into a more engineering-focused position, someone who enjoys understanding the business context just as much as building the data solutions behind it. You’ll work extensively with Python , Snowflake , SQL , and dbt to design, build, and maintain scalable, high-quality data pipelines … and models that support decision-making across the business. This is a hands-on, collaborative role, suited to someone who’s confident communicating with data, product, and engineering teams, not a “heads-down coder” type. Top 4 Core Skills Python — workflow automation, data processing, and ETL/ELT development. Snowflake — scalable data architecture, performance More ❯

Data Engineer (with Data Analytics Background) Location: City of London Employment Type: Full-time Salary: £90,000–£100,000 Sector: Fintech We’re looking for a well-rounded, communicative Data Engineer with a strong background in data analytics and experience within the Fintech sector . This role is ideal for someone who … began their career as a Data Analyst and has since transitioned into a more engineering-focused position, someone who enjoys understanding the business context just as much as building the data solutions behind it. You’ll work extensively with Python , Snowflake , SQL , and dbt to design, build, and maintain scalable, high-quality data pipelines … and models that support decision-making across the business. This is a hands-on, collaborative role, suited to someone who’s confident communicating with data, product, and engineering teams, not a “heads-down coder” type. Top 4 Core Skills Python — workflow automation, data processing, and ETL/ELT development. Snowflake — scalable data architecture, performance More ❯

Contract Role – Data AWS Engineer – Northampton/Hybrid – 6 months – Inside IR35 7+ years of experienced in designing, building, and maintaining data pipelines and architectures on the Amazon Web Services (AWS) cloud platform. Skilled in scalable, reliable, and efficient data solutions, often using AWS services like S3, Redshift, EMR, Glue, and Kinesis. This involves … designing ETL processes, ensuring data security, and collaborating with other teams for data analysis and business requirements Role Overview: Job Title: Data AWS Engineer Location: Northampton (hybrid: 2-3 days in office) Contract Type: Contract Duration: 6 months Key Responsibilities: Designing and Building Data Pipelines: Creating and implementing data pipelines … to move data between different systems and applications on AWS. Data Warehouse Management: Designing, building, and maintaining data warehouses using AWS services like Redshift. ETL Process Development: Developing and maintaining Extract, Transform, Load (ETL) processes to move and transform data. Data Governance and Security: Implementing data governance and security policies More ❯

Contract Role – Data AWS Engineer – Northampton/Hybrid – 6 months – Inside IR35 7+ years of experienced in designing, building, and maintaining data pipelines and architectures on the Amazon Web Services (AWS) cloud platform. Skilled in scalable, reliable, and efficient data solutions, often using AWS services like S3, Redshift, EMR, Glue, and Kinesis. This involves … designing ETL processes, ensuring data security, and collaborating with other teams for data analysis and business requirements Role Overview: Job Title: Data AWS Engineer Location: Northampton (hybrid: 2-3 days in office) Contract Type: Contract Duration: 6 months Key Responsibilities: Designing and Building Data Pipelines: Creating and implementing data pipelines … to move data between different systems and applications on AWS. Data Warehouse Management: Designing, building, and maintaining data warehouses using AWS services like Redshift. ETL Process Development: Developing and maintaining Extract, Transform, Load (ETL) processes to move and transform data. Data Governance and Security: Implementing data governance and security policies More ❯

Contract Role – Data AWS Engineer – Northampton/Hybrid – 6 months – Inside IR35 7+ years of experienced in designing, building, and maintaining data pipelines and architectures on the Amazon Web Services (AWS) cloud platform. Skilled in scalable, reliable, and efficient data solutions, often using AWS services like S3, Redshift, EMR, Glue, and Kinesis. This involves … designing ETL processes, ensuring data security, and collaborating with other teams for data analysis and business requirements Role Overview: Job Title: Data AWS Engineer Location: Northampton (hybrid: 2-3 days in office) Contract Type: Contract Duration: 6 months Key Responsibilities: Designing and Building Data Pipelines: Creating and implementing data pipelines … to move data between different systems and applications on AWS. Data Warehouse Management: Designing, building, and maintaining data warehouses using AWS services like Redshift. ETL Process Development: Developing and maintaining Extract, Transform, Load (ETL) processes to move and transform data. Data Governance and Security: Implementing data governance and security policies More ❯

Data Engineer – Python | SQL | Azure | Microsoft Fabric Location: London Salary: £90,000 + benefits Financial Services Are you a skilled Data Engineer with strong coding expertise and a passion for building scalable data solutions? We’re looking for a talented professional to join our team and play a key role in designing, developing, and … optimising modern data platforms on Azure Cloud — with a focus on an exciting Microsoft Fabric implementation. What you’ll do Design and build robust data pipelines and ETL processes using Python and SQL. Contribute to the rollout and optimisation of Microsoft Fabric, shaping the next-generation data platform. Work across Azure services (Data Factory, Synapse, Databricks, Data Lake, Functions) to deliver secure and scalable data solutions. Optimise data workflows for performance, reliability, and cost efficiency. Collaborate with analysts, data scientists, and business stakeholders to ensure high-quality, trusted data is available for decision-making. Implement best practices for data More ❯

Data Engineer – Python | SQL | Azure | Microsoft Fabric Location: London Salary: £90,000 + benefits Financial Services Are you a skilled Data Engineer with strong coding expertise and a passion for building scalable data solutions? We’re looking for a talented professional to join our team and play a key role in designing, developing, and … optimising modern data platforms on Azure Cloud — with a focus on an exciting Microsoft Fabric implementation. What you’ll do Design and build robust data pipelines and ETL processes using Python and SQL. Contribute to the rollout and optimisation of Microsoft Fabric, shaping the next-generation data platform. Work across Azure services (Data Factory, Synapse, Databricks, Data Lake, Functions) to deliver secure and scalable data solutions. Optimise data workflows for performance, reliability, and cost efficiency. Collaborate with analysts, data scientists, and business stakeholders to ensure high-quality, trusted data is available for decision-making. Implement best practices for data More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, we’re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector – we are always in search of the best … you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on … with over 3 years of relevant experience in data engineering, platform engineering, or a related field, with demonstrated hands-on expertise in NiFi and data pipeline design in regulated environments. Responsibilities: Design, develop, and maintain robust and secure data pipelines using NiFi and related big data technologies. Troubleshoot and optimize NiFi More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, we’re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector – we are always in search of the best … you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on … with over 3 years of relevant experience in data engineering, platform engineering, or a related field, with demonstrated hands-on expertise in NiFi and data pipeline design in regulated environments. Responsibilities: Design, develop, and maintain robust and secure data pipelines using NiFi and related big data technologies. Troubleshoot and optimize NiFi More ❯

We are looking for a Lead Data Architect to provide strategic leadership and technical expertise in the design and development of data solutions. This role involves setting technical standards, evaluating new technologies, and shaping our approach to data. You will lead a team of Data Architects, Engineers, and Analysts, defining data architecture … frameworks and ensuring the development of scalable, robust, and cost-effective solutions. The ideal candidate will have a passion for data, be technology-agnostic, and possess excellent client-facing skills. Lead Data Architect Annual Salary: circa £85,000 Location: Flexible, hybrid working with some client travel Day to day of the role: Shape the approach to … platforms in Azure/AWS or significant on-premise design experience. 5+ years in data engineering or business intelligence roles. Extensive ETL and data pipeline design experience, technology agnostic. Proficiency in SQL and experience with data engineering coding languages such as Python, R, or Spark. Understanding of data warehouse and More ❯

you, this means working on challenging projects that demand innovation, collaboration, and thought leadership . Role – We are looking for a talented Analytics Engineer to join our growing data and analytics team. You will play a pivotal role in shaping the organisation’s data-driven strategy, working across data engineering, analytics, and business domains … to design scalable, high-quality data models and pipelines. This is a fantastic opportunity to work on cutting-edge projects using technologies such as Snowflake, dbt, Data Vault, and Azure/AWS , while collaborating with data architects, data scientists, and business stakeholders to deliver insights that drive measurable impact. Key Responsibilities: Act … as the bridge between engineering teams and business stakeholders , translating requirements into data solutions. Design, build, and maintain data pipelines and transformations that turn raw data into structured, analysis-ready datasets. Develop and optimise data models (including Data Vault and dimensional modelling) to support large-scale analytics. Implement and enforce More ❯

you, this means working on challenging projects that demand innovation, collaboration, and thought leadership . Role – We are looking for a talented Analytics Engineer to join our growing data and analytics team. You will play a pivotal role in shaping the organisation’s data-driven strategy, working across data engineering, analytics, and business domains … to design scalable, high-quality data models and pipelines. This is a fantastic opportunity to work on cutting-edge projects using technologies such as Snowflake, dbt, Data Vault, and Azure/AWS , while collaborating with data architects, data scientists, and business stakeholders to deliver insights that drive measurable impact. Key Responsibilities: Act … as the bridge between engineering teams and business stakeholders , translating requirements into data solutions. Design, build, and maintain data pipelines and transformations that turn raw data into structured, analysis-ready datasets. Develop and optimise data models (including Data Vault and dimensional modelling) to support large-scale analytics. Implement and enforce More ❯

Remote Data Architect sought by a well-established company in their industry; our client is seeking an adept professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. This unique opportunity is offered on a … remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: - Leading the design and implementation of innovative cloud data platforms. - Setting standards … using Azure, AWS, or exceptional on-premise design expertise. - At least 5 years in data engineering or business intelligence roles. - Proficiency in ETL and data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and demonstrable data modelling More ❯

Remote Data Architect sought by a well-established company in their industry; our client is seeking an adept professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. This unique opportunity is offered on a … remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: - Leading the design and implementation of innovative cloud data platforms. - Setting standards … using Azure, AWS, or exceptional on-premise design expertise. - At least 5 years in data engineering or business intelligence roles. - Proficiency in ETL and data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and demonstrable data modelling More ❯

We are searching for an experienced GIS Data Specialist/Geospatial Data Specialist for an extremely exciting technology focused business, someone who has extensive experience of working with and managing Geospatial Data and Geodata . This role is offered on a hybrid or remote working basis. You MUST however be able to attend team … will need to live within a commutable distance of one of the above offices, either Reading or Exeter. We are searching for someone who is very passionate about data, automation, and driving change through smart processes. You will be leading the way with regards to transforming how data is managed, processed and delivered across our client … s business. You will take ownership of complex ETL workflows, you will be developing automation tools, and you will ensure data is accurate, delivered in a timely fashion whilst making sure it is fit for purpose. Key Duties: - Lead and maintain ETL processes, improving automation and data quality. Use tools like Power BI/Excel or More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £65,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … stakeholders across the business. Key Responsibilities: Develop scalable and secure data architectures ensuring optimal data flow Cloud data platform development, data modelling, shaping and technical planning Implementing best practices around data security, governance, privacy, and compliance Ensure company data is secure, accurate, maintained and available. Mentor data More ❯

Lead Data Engineer - London - Hybrid - £85,000 - £90,000 My client is seeking a highly skilled Lead Data Engineer to join their agile data team in London. This hybrid position requires 3 days per week in the office, offering the opportunity to lead a small team while remaining technically hands-on. The role is … annual leave plus buy and sell options Hybrid working: 3 days per week in London office And many more Role and Responsibilities Architect, develop, and continuously improve robust data pipelines to support large-scale data ingestion, transformation, and delivery. Utilize Azure and Databricks platforms to ensure high-throughput and reliable data … movement across diverse data sources, enabling seamless integration, cleansing, and enrichment of data for analytics and reporting needs. Implement best practices for data pipeline orchestration, monitoring, and error handling to ensure consistent and dependable data flows. Optimize and fine-tune Azure-based data platforms by leveraging deep expertise in More ❯

Lead Data Engineer - London - Hybrid - £85,000 - £90,000 My client is seeking a highly skilled Lead Data Engineer to join their agile data team in London. This hybrid position requires 3 days per week in the office, offering the opportunity to lead a small team while remaining technically hands-on. The role is … annual leave plus buy and sell options Hybrid working: 3 days per week in London office And many more Role and Responsibilities Architect, develop, and continuously improve robust data pipelines to support large-scale data ingestion, transformation, and delivery. Utilize Azure and Databricks platforms to ensure high-throughput and reliable data … movement across diverse data sources, enabling seamless integration, cleansing, and enrichment of data for analytics and reporting needs. Implement best practices for data pipeline orchestration, monitoring, and error handling to ensure consistent and dependable data flows. Optimize and fine-tune Azure-based data platforms by leveraging deep expertise in More ❯

Lead Data Engineer - London - Hybrid - £85,000 - £90,000 My client is seeking a highly skilled Lead Data Engineer to join their agile data team in London. This hybrid position requires 3 days per week in the office, offering the opportunity to lead a small team while remaining technically hands-on. The role is … annual leave plus buy and sell options Hybrid working: 3 days per week in London office And many more Role and Responsibilities Architect, develop, and continuously improve robust data pipelines to support large-scale data ingestion, transformation, and delivery. Utilize Azure and Databricks platforms to ensure high-throughput and reliable data … movement across diverse data sources, enabling seamless integration, cleansing, and enrichment of data for analytics and reporting needs. Implement best practices for data pipeline orchestration, monitoring, and error handling to ensure consistent and dependable data flows. Optimize and fine-tune Azure-based data platforms by leveraging deep expertise in More ❯

Following the acquisition of Brookson by People2.0, the responsibilities of the Data and Analytics team have significantly expanded. We are now seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer within the Data and Analytics team, you will play a pivotal role in designing, maintaining, and optimising … the data architecture for People2.0 Group. This architecture ensures the seamless flow of data from source systems to the Data Warehouse, providing a robust foundation of aggregated analytical base tables and operational sources. Our data architecture is critical in enabling People2.0 Group to become a data-driven organisation. Your responsibilities … will include maintaining existing data pipelines, developing new branches within the architecture, and collaborating closely with stakeholders across the business. You will engage with stakeholders from various regions, including EMEA, US, and APAC, ensuring that the architecture aligns with regional and global requirements. Reporting directly to the Senior Data Engineer within the Data and More ❯

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Data Engineer with Insurance experience to play a … key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You’ll help shape the data strategy, improve data quality, and empower the business to make data-driven decisions. As a Lead Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built More ❯