76 to 100 of 363 Data Pipeline Jobs in the UK excluding London

Location: Central London (Hybrid - 3 days in office) Salary: Up to £62,000 per annum Contract Type: Fixed Term (18 months) Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're … looking for a hands-on Data Engineer to help build the foundations of their future data estate. This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from … across the organisation - including CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets. You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation. What You'll Be Doing: Design and build robust, automated data pipelines using Azure Data More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester(Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies)About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment.About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate … about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you.Key Responsibilities:Design, develop, maintain, and optimise data pipelines More ❯

Like data and love solving problems? Want to work on a number of new and exciting data projects and help deliver a BI & Data strategy for a growing organisation You’re probably looking for a role that challenges you daily, a role where your efforts aren’t focused mostly on maintenance and support. You … want to be working on varied data projects and utilising the full set of your technology skills whilst driving new areas like Azure/cloud, and all the new tools to play with – Azure Data Factory, Azure Databricks – what about AI In this predominantly remote you will help create, mature, and grow, a data … new Azure data solution to release the power and potential of the data across the organisation.We need a few basics from you: Data pipeline creation Strong ETL development experience with Azure Data Factory Datawarehouse and data storage concepts - star schema/snowflake/Kimball Azure Databricks and AI Power More ❯

Data Prodict Manager: We are seeking a dynamic and driven Data Operations Manager to lead a team of data engineers. You will oversee the daily operations of our data infrastructure and ensure the accuracy, availability, and security of data across the organization. This role will lead a team of data engineers and analysts, manage data workflows, and collaborate with cross-functional teams to support data-driven decision-making. You will support the Head of Data in the delivery of the data operations roadmap. Key Responsibilities of the Data Product Manager: Data Infrastructure Management: Oversee the design … implementation, and maintenance of data pipelines, databases, and data warehouses. Process Optimization: Develop and refine data operations processes to improve efficiency, scalability, reliability and observability. Drive Engineering Excellence: Lead and manage all engineering activities across internal and external teams, ensuring high productivity and quality of execution. AWS Expertise: Strong expertise across AWS products, including More ❯

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients' needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior … Data Engineer, you may assume multiple roles based on our clients' needs. The role is highly hands-on, supporting project delivery as a senior contributor and upskilling client team members. You might also take on a technical architect role, collaborating with the MadeTech team to identify growth opportunities within the account. You'll need a drive to deliver … criteria. Enthusiasm for learning and self-development Proficiency in Git (including Github Actions) and understanding of branch strategies Experience gathering and meeting requirements from clients and users on data projects Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments Managing cloud infrastructure with a DevOps approach Handling and transforming various data types (JSON More ❯

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients' needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior … Data Engineer, you may assume multiple roles based on our clients' needs. The role is highly hands-on, supporting project delivery as a senior contributor and upskilling client team members. You might also take on a technical architect role, collaborating with the MadeTech team to identify growth opportunities within the account. You'll need a drive to deliver … criteria. Enthusiasm for learning and self-development Proficiency in Git (including Github Actions) and understanding of branch strategies Experience gathering and meeting requirements from clients and users on data projects Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments Managing cloud infrastructure with a DevOps approach Handling and transforming various data types (JSON More ❯

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients' needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior … Data Engineer, you may assume multiple roles based on our clients' needs. The role is highly hands-on, supporting project delivery as a senior contributor and upskilling client team members. You might also take on a technical architect role, collaborating with the MadeTech team to identify growth opportunities within the account. You'll need a drive to deliver … criteria. Enthusiasm for learning and self-development Proficiency in Git (including Github Actions) and understanding of branch strategies Experience gathering and meeting requirements from clients and users on data projects Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments Managing cloud infrastructure with a DevOps approach Handling and transforming various data types (JSON More ❯

Like data and love solving problems? Want to work on a number of new and exciting data projects and help deliver a BI & Data strategy for a growing organisation? You're probably looking for a role that challenges you daily, a role where your efforts aren't focused mostly on maintenance and support. You … want to be working on varied data projects and utilising the full set of your technology skills whilst driving new areas like Azure/cloud, and all the new tools to play with - Azure Data Factory, Azure Databricks - what about AI? In this predominantly remote you will help create, mature, and grow, a data … Azure data solution to release the power and potential of the data across the organisation. We need a few basics from you: Data pipeline creation Strong ETL development experience with Azure Data Factory Datawarehouse and data storage concepts - star schema/snowflake/Kimball Azure Databricks and AI Power More ❯

DATA SCIENCE ENGINEER - EDV CLEAREDBRAND NEW PERMANENT OPPORTUNITY AVAILABLE WITHIN A LEADING COMPANY FOR A DATA SCIENCE ENGINEER WITH ENHANCED DV CLEARANCE * Permanent opportunity for a data engineer/data scientist with enhanced DV clearance.* Industry leading consultancy supporting mission critical government projects.* Salary up to £95,000 DOE plus DV Bonus. … Manchester based in an easily accessible location.* To apply please call or email WHO ARE WE We are recruiting Data Science Engineers at various levels with AI/Machine Learning experience to work with an industry leading consultancy supporting mission critical Government projects with office locations in and around Manchester. Our teams are what leads us forward and … the best to the table. Due to the nature of these clients, you must hold DV clearance to work on Defence and National Security projects. WE NEED THE DATA SCIENCE ENGINEER TO HAVE.... * Enhanced DV Clearance.* Experience in Data Engineering/Data Science.* Ability to develop Extract, Transform, Load (ETL) or Extract, Load, Transform More ❯

Data Engineer – Leeds– SQL | Power BI | Azure | ETL Ready to drive innovation with T-SQL and BI, shaping a cutting-edge data platform? Do you have the expertise to build and maintain complex data warehouses and Power BI solutions? Excited to solve BI challenges and support data-driven decision-making across the … business? A fantastic new opportunity has arisen with a professional services company for an experienced Data Engineer. You'll be joining a growing team with offices across the UK, committed to ambitious growth and employee wellbeing. This role is based in their Leeds office, offering hybrid working. What's in it for you? Salary up to … Factory to ensure the warehouse can support large-scale reporting and analytics needs. Your T-SQL expertise will be crucial for managing complex queries and troubleshooting data pipeline issues. Key Skills: SQL/T-SQL Power BI or Tableau Experience with data warehousing and ETL/ELT processes Azure If you're passionate about shaping More ❯

teams that build massively scalable software and systems, architect low latency infrastructure solutions, proactively guard against cyber threats, and leverage machine learning alongside financial engineering to continuously turn data into action. Create new businesses, transform finance, and explore a world of opportunity at the speed of markets . Engineering, which is comprised of our Technology Division and global … Want to push the limit of digital possibilities? Start here. Who We Look For Goldman Sachs Engineers are innovators and problem-solvers, building solutions in risk management, big data, mobile and more. We look for creative collaborators who evolve, adapt to change and thrive in a fast-paced global environment. Asset & Wealth Management Division: Across Asset and Wealth … solutions that span Sales, Client Servicing, Research, Portfolio Management and Trading. You will work across a variety of systems & programming languages to create a data pipeline to ingest millions of data points per day and create a highly available data processing and REST services to distribute data to different More ❯

JOB TITLE: Senior Data Engineer SALARY: £70,929 - £78,810 LOCATION: Edinburgh, Manchester, Leeds or Bristol HOURS: Full time WORKING PATTERN: Hybrid, 40% (or two days) in an office site About this opportunity At Lloyds Banking Group, we're moving to the next stages of our digital transformation, and it's our job within the Chief Security Office … CSO) to ensure that we keep our customers, colleagues and assets safe from threat. The CSO's Security Data Services lab does this by using data to build security insights by working collaboratively with our Data Management and Analytics teams. This is an exciting opportunity for a Senior Data Engineer to join … the Security Data Services lab to collaborate with the Data Operations, Software Engineers, Data Scientists, and Business SMEs to design, develop, integrate and test Data Product features on the product roadmaps to meet customer needs. What you'll do Engineer Data Products that are stable, scalable, performant, accessible, testable and More ❯

JOB TITLE: Senior Data Engineer SALARY: £70,929 - £78,810 LOCATION: Edinburgh, Manchester, Leeds or Bristol HOURS: Full time WORKING PATTERN: Hybrid, 40% (or two days) in an office site About this opportunity At Lloyds Banking Group, we're moving to the next stages of our digital transformation, and it's our job within the Chief Security Office … CSO) to ensure that we keep our customers, colleagues and assets safe from threat. The CSO's Security Data Services lab does this by using data to build security insights by working collaboratively with our Data Management and Analytics teams. This is an exciting opportunity for a Senior Data Engineer to join … the Security Data Services lab to collaborate with the Data Operations, Software Engineers, Data Scientists, and Business SMEs to design, develop, integrate and test Data Product features on the product roadmaps to meet customer needs. What you'll do Engineer Data Products that are stable, scalable, performant, accessible, testable and More ❯

JOB TITLE: Senior Data Engineer SALARY: £70,929 - £78,810 LOCATION: Edinburgh, Manchester, Leeds or Bristol HOURS: Full time WORKING PATTERN: Hybrid, 40% (or two days) in an office site About this opportunity At Lloyds Banking Group, we're moving to the next stages of our digital transformation, and it's our job within the Chief Security Office … CSO) to ensure that we keep our customers, colleagues and assets safe from threat. The CSO's Security Data Services lab does this by using data to build security insights by working collaboratively with our Data Management and Analytics teams. This is an exciting opportunity for a Senior Data Engineer to join … the Security Data Services lab to collaborate with the Data Operations, Software Engineers, Data Scientists, and Business SMEs to design, develop, integrate and test Data Product features on the product roadmaps to meet customer needs. What you'll do Engineer Data Products that are stable, scalable, performant, accessible, testable and More ❯

JOB TITLE: Senior Data Engineer SALARY: £70,929 - £78,810 LOCATION: Edinburgh, Manchester, Leeds or Bristol HOURS: Full time WORKING PATTERN: Hybrid, 40% (or two days) in an office site About this opportunity At Lloyds Banking Group, we're moving to the next stages of our digital transformation, and it's our job within the Chief Security Office … CSO) to ensure that we keep our customers, colleagues and assets safe from threat. The CSO's Security Data Services lab does this by using data to build security insights by working collaboratively with our Data Management and Analytics teams. This is an exciting opportunity for a Senior Data Engineer to join … the Security Data Services lab to collaborate with the Data Operations, Software Engineers, Data Scientists, and Business SMEs to design, develop, integrate and test Data Product features on the product roadmaps to meet customer needs. What you'll do Engineer Data Products that are stable, scalable, performant, accessible, testable and More ❯

growing organisation? Do you have a passion for enabling people to perform at their best? If so, we want to hear from you. We are looking for a Data Engineer (Python) to join our Data Science and Technology team at BIT. As a Data Engineer you will be responsible for the technical delivery of … building and maintaining robust, scalable technology. You will play a crucial role in maintaining and enhancing Predictiv - our online research platform running at production scale - while delivering innovative data engineering solutions for client-facing projects. This is an exciting opportunity to use your technical skills while contributing to meaningful, high-impact projects. You will gain hands-on experience … platforms (e.g., AWS, GCP, or Azure). An understanding of DevOps concepts such as Infrastructure as Code, CI/CD, or MLOps. Knowledge of Python-based data pipeline frameworks (e.g. Airflow, Metaflow) and Python-based product development packages (e.g. FastAPI, Streamlit). An interest in developing or improving full stack product development skills. Who are we and More ❯

benefits to support your finances, wellbeing and family. Working Pattern: Permanent Full Time Flexible First options available The Role We are recruiting for the position of a Lead Data Engineer in SSE's Group Data and Analytics team. This team acts as a Centre for Enablement (CfE) for the SSE organisation and are involved in a … variety of activities: practical project development work, advising on best practice, investigation into new capabilities and other activities that further data driven solutions across SSE. You Will - Act as a subject matter expert in the data engineering/data solutions space as a key member of the CfE. - Understand business requirements and discuss with … stakeholders a recommended solution approach. Work in an inclusive manner with team members in terms of architecture and design of a solution. - Lead, mentor and advise the CfE data solutions team in their work. - Lead and undertake practical work as well as provide advice and guidance to business units in SSE. This will mainly relate to data More ❯

benefits to support your finances, wellbeing and family. Working Pattern: Permanent Full Time Flexible First options available The Role We are recruiting for the position of a Lead Data Engineer in SSE's Group Data and Analytics team. This team acts as a Centre for Enablement (CfE) for the SSE organisation and are involved in a … variety of activities: practical project development work, advising on best practice, investigation into new capabilities and other activities that further data driven solutions across SSE. You Will - Act as a subject matter expert in the data engineering/data solutions space as a key member of the CfE. - Understand business requirements and discuss with … stakeholders a recommended solution approach. Work in an inclusive manner with team members in terms of architecture and design of a solution. - Lead, mentor and advise the CfE data solutions team in their work. - Lead and undertake practical work as well as provide advice and guidance to business units in SSE. This will mainly relate to data More ❯

benefits to support your finances, wellbeing and family. Working Pattern: Permanent Full Time Flexible First options available The Role We are recruiting for the position of a Lead Data Engineer in SSE's Group Data and Analytics team. This team acts as a Centre for Enablement (CfE) for the SSE organisation and are involved in a … variety of activities: practical project development work, advising on best practice, investigation into new capabilities and other activities that further data driven solutions across SSE. You Will - Act as a subject matter expert in the data engineering/data solutions space as a key member of the CfE. - Understand business requirements and discuss with … stakeholders a recommended solution approach. Work in an inclusive manner with team members in terms of architecture and design of a solution. - Lead, mentor and advise the CfE data solutions team in their work. - Lead and undertake practical work as well as provide advice and guidance to business units in SSE. This will mainly relate to data More ❯

Robert Half Technology are assisting a market leading financial services organisation to recruit a Junior Data Engineer. Hybrid working - London based Role The Junior Data Engineer will assist in the design, development, and maintenance of scalable data pipelines and ETL/ELT processes in Azure. Write efficient and reliable SQL queries for data extraction, transformation, and analysis. Support data integration from various sources (internal systems, third-party vendors) into centralised data platforms. Monitor and troubleshoot data jobs and pipelines to ensure consistent and reliable delivery. Collaborate with analytics and reporting teams to deliver high-quality datasets for business intelligence. Participate in code reviews, documentation, and … team discussions as part of a collaborative engineering culture. Ensure data quality, integrity, and security best practices are upheld. Profile The Junior Data Engineer will ideally have a degree in Computer Science, Engineering, Mathematics, or a related field. 1-3 years of experience in a data engineering, data analytics, or software engineering More ❯

SENIOR ANALYTICS ENGINEER UP TO £80,000 + BENEFITS PRIMARILY REMOTE Looking to take ownership of scalable data models, shape a brand-new analytics function, and work with the modern data stack from day one? THE COMPANY: I'm working with a fast-scaling, tech-driven organisation that's investing heavily in its data capabilities. As part of a wider data transformation, they're building out a dedicated Analytics Engineering team focused on creating scalable, trusted data infrastructure. With strong support from BI, Data Science, and Engineering teams, this function is central to how the business defines and uses data going forward. THE ROLE … skills and hands-on experience with dbt (or similar tools) Experience designing as well as building data models Exposure to Snowflake and/or data pipeline tools Understanding of testing, CI/CD, and data quality frameworks THE BENEFITS: You will receive a salary dependent on experience-up to £80,000. On top More ❯

SENIOR ANALYTICS ENGINEER UP TO £80,000 + BENEFITS PRIMARILY REMOTE Looking to take ownership of scalable data models, shape a brand-new analytics function, and work with the modern data stack from day one? THE COMPANY: I'm working with a fast-scaling, tech-driven organisation that's investing heavily in its data capabilities. As part of a wider data transformation, they're building out a dedicated Analytics Engineering team focused on creating scalable, trusted data infrastructure. With strong support from BI, Data Science, and Engineering teams, this function is central to how the business defines and uses data going forward. THE ROLE … skills and hands-on experience with dbt (or similar tools) Experience designing as well as building data models Exposure to Snowflake and/or data pipeline tools Understanding of testing, CI/CD, and data quality frameworks THE BENEFITS: You will receive a salary dependent on experience-up to £80,000. On top More ❯

Prestigious opportunity for a Data Platform Engineer within a pioneering technology team based in Manchester. Following a period of significant growth, investment and a cloud transformation, we are inviting you to join our success story! As our Azure Data Platform Engineer, you will be responsible for:- Designing, building, and maintaining scalable data solutions on … Microsoft Azure. Designing and implementing scalable data pipelines using Azure Data Factory, Databricks, Synapse Analytics, and other Azure services. Leading technical workstreams and supporting project delivery. Acting as the subject-matter expert for cloud-based data engineering. Ensure data governance, security, and compliance standards are met. Monitoring and troubleshooting data platform performance and issues. Automate data ingestion, transformation, and integration processes. Document technical solutions and maintain best practices. If you possess a combination of some of the following skills, then LETS TALK! Proven experience with Azure data services (SQL, Data Factory, Data Lake, Synapse, Databricks, Azure SQL and Cosmos DB More ❯

Role title: Data engineer Rate: £425/d - £462/d Onsite requirement: Inside IR35 Contract lenght: 12 months Job Description : We are seeking a highly skilled and motivated Data Engineer to join our team in the Public Sector and Government industry. This is a full-time contract position with a duration of 12 months. The … successful candidate will be responsible for designing, developing, and maintaining our data infrastructure, ensuring efficient data migration, and supporting our data warehousing needs. Key Responsibilities : Design, develop, and maintain data pipelines using Data Stage, Red Shift, QuickSight, and S3. Perform data migration and ETL processes for both batch … and real-time data. Develop and optimise data warehouses to support business intelligence and analytic. Implement DevSecOps practices to ensure data security and compliance. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Ensure data quality and integrity across all data sources and systems. Utilise Java, SQL More ❯

employees to work with artificial intelligence (AI). One of BCAI's many training offerings is the 18-month expert program, in which employees develop into experts in data engineering and data science. "In a few years, software competence will be standard for every engineer", says Máté. As part of the expert program, the group leader … is training to become a data engineer. A data engineer's job is to organize, cleanse and make data available to others for use in training an artificial intelligence, for example. "As a leader, I feel a responsibility to educate myself in the field and be a role model. I didn't know anything … test reports should be generated automatically. He is bringing this project into the advanced training program to become a data engineer. The idea: "The data pipeline begins with the collection, conversion and structured storage of raw data. By means of AI, relevant data is automatically printed in the report, which only needs to More ❯