226 to 250 of 1,010 Data Pipeline Jobs in the UK excluding London

Robert Half Technology are assisting a market-leading pharmaceuticals organisation to recruit a Data Engineer on a contract basis. Outside IR35. Hybrid working - London based (one day per week on site). Role * The Data Engineer will design, develop, and maintain data infrastructure to ensure reliability, scalability, and performance.* Collaborate with data scientists, analysts, and business stakeholders to fulfil their data requirements and support their work.* Collect, process, and transform datasets from various sources, ensuring data quality and integrity.* Optimise and maintain the organisation's Snowflake infrastructure, providing performance tuning, enhancements, and regular "MOT" checks.* Develop and maintain DBT pipelines, mainly on Snowflake, to enable … efficient transformation and modelling of data.* Implement efficient data models and schemes for storage and retrieval, optimising processes for improved performance.* Troubleshoot and resolve data pipeline and infrastructure issues swiftly and effectively.* Keep abreast of industry trends and emerging technologies in data engineering and cloud infrastructure, continuously improving skills and knowledge. Profile * The More ❯

DV Cleared Data Engineers – Bristol – AWS or Azure – All levels We’re supporting a leading global consultancy with the expansion of their secure data engineering team, and we’re looking for DV Cleared Data Engineers to join major projects in Bristol. If you hold active DV clearance and want to work on cutting-edge … mission-critical programmes in a highly collaborative technical environment, this is an excellent opportunity. They are considering all levels from Junior Data Engineers to Principal - as long as you hold DV Clearance!! What You’ll Be Doing Designing and delivering secure, high-performance data pipelines and analytics platforms Working across AWS or Azure environments, building scalable … national infrastructure and security programmes with real impact What We’re Looking For Active DV clearance (essential) Strong background in data engineering, ETL, and data pipeline development Experience with AWS or Azure cloud technologies Excellent coding skills in Python, SQL, or Scala Understanding of data warehousing, modelling, and streaming technologies Confident working in More ❯

Robert Half have partnered with one of our Pharmaceutical manufacturing organisations to help them recruit for an experience Snowflake Data Engineer on an initial 6 months experienced based out of their London office. You will play a key role in designing and managing our Snowflake data warehouse and leveraging dbt (Data Build Tool) to … transform raw data into reliable, analysis-ready datasets that support regulatory compliance, operational efficiency, and innovation. Responsibilities: Design, develop, and maintain scalable data pipelines to support manufacturing, quality, and supply chain data workflows. Implement and manage data transformation models using dbt to standardise and validate datasets. Optimise and monitor performance of Snowflake … data warehouse environments. Collaborate with cross-functional teams (Data Scientists, Quality, Manufacturing, IT) to define data requirements and deliver reliable data solutions. Develop and maintain ETL/ELT workflows using modern orchestration and integration tools (e.g., Airflow, Fivetran, or similar). Implement data governance, lineage, and documentation best practices. Support More ❯

Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. … As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You … ll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you More ❯

Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. … As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You … ll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you More ❯

Data Engineer - Azure Databricks , Apache Kafka Permanent Basingstoke (Hybrid - x2 PW) Circa £70,000 + Excellent Package Overview We're looking for a skilled Data Analytics Engineer to help drive the evolution of our clients data platform. This role is ideal for someone who thrives on building scalable data solutions and is … confident working with modern tools such as Azure Databricks , Apache Kafka , and Spark . In this role, you'll play a key part in designing, delivering, and optimising data pipelines and architectures. Your focus will be on enabling robust data ingestion and transformation to support both operational and analytical use cases. If you're passionate about … data engineering and want to make a meaningful impact in a collaborative, fast-paced environment, we want to hear from you !! Role and Responsibilities Designing and building scalable data pipelines using Apache Spark in Azure Databricks Developing real-time and batch data ingestion workflows, ideally using Apache Kafka Collaborating with data scientists More ❯

Data Engineer – Sports Betting Location: London - Hybrid Salary: £100,000 + Bonus + Benefits A leading name in the sports betting industry is looking for a talented Data Engineer to help design, build, and scale data solutions that power trading, risk, and customer insight models. You’ll play a central role in transforming raw … data into actionable intelligence, working closely with data scientists, quants, and business stakeholders to shape cutting-edge betting products. Key Responsibilities Build and optimise data pipelines and ETL workflows in AWS using Python and SQL. Partner with analysts and quants to deliver reliable datasets for predictive modelling and pricing. Design and maintain data models supporting trading, risk, and customer behaviour analytics. Develop Power BI dashboards to provide insights across trading and product teams. Ensure high standards of data governance, quality, and scalability. Collaborate with product, trading, and technology teams to support innovation in the betting platform. What you’ll bring Proven experience as a Data Engineer in More ❯

Data Engineer – Sports Betting Location: London - Hybrid Salary: £100,000 + Bonus + Benefits A leading name in the sports betting industry is looking for a talented Data Engineer to help design, build, and scale data solutions that power trading, risk, and customer insight models. You’ll play a central role in transforming raw … data into actionable intelligence, working closely with data scientists, quants, and business stakeholders to shape cutting-edge betting products. Key Responsibilities Build and optimise data pipelines and ETL workflows in AWS using Python and SQL. Partner with analysts and quants to deliver reliable datasets for predictive modelling and pricing. Design and maintain data models supporting trading, risk, and customer behaviour analytics. Develop Power BI dashboards to provide insights across trading and product teams. Ensure high standards of data governance, quality, and scalability. Collaborate with product, trading, and technology teams to support innovation in the betting platform. What you’ll bring Proven experience as a Data Engineer in More ❯

Akkodis is partnering with a reputable client in Finance and they are looking for a Data Engineer with strong Databricks experience to expand their IT Team. They are currently improving their CX transformation programme and making changes to their institutional reporting suite. Job title: Data Engineer - Data BricksSTART :ASAPLocation: Liverpool Street - 3 days a … eek (NON Negotiable), the rest WFHDuration: 3 months rolling contractType of contract : Freelance, Inside IR35Level: mid-Senior Duties and Tasks: Develop and optimize data pipelines using Databricks and Spark.Design and implement data models and ETL processes in Snowflake.Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.Ensure data quality, integrity, and security across platforms.Monitor and troubleshoot data workflows and performance issues. Requirements: Proven experience with Databricks and Snowflake.Strong proficiency in SQL and Python.Extract Load Transform procedures, Data Lineage & Analysis.Familiarity with cloud platforms (e.g., Azure, AWS, or GCP).Experience with CI/CD and version control tools (e.g., Git).Excellent problem-solving and More ❯

DV Cleared Data Engineers Wanted – London – AWS or Azure – Senior/Principal We’re supporting a leading global consultancy with the expansion of their secure data engineering team, and we’re looking for DV Cleared Data Engineers to join major projects in London. If you hold active DV clearance and want to work on … cutting-edge, mission-critical programmes in a highly collaborative technical environment, this is an excellent opportunity. What You’ll Be Doing Designing and delivering secure, high-performance data pipelines and analytics platforms Working across AWS or Azure environments, building scalable, reliable data solutions Collaborating with cross-functional teams including engineers, data scientists, and architects … national infrastructure and security programmes with real impact What We’re Looking For Active DV clearance (essential) Strong background in data engineering, ETL, and data pipeline development Experience with AWS or Azure cloud technologies Excellent coding skills in Python, SQL, or Scala Understanding of data warehousing, modelling, and streaming technologies Confident working in More ❯

Head of Data Engineering Our longstanding financial services client is currently hiring a Head of Data Engineering to lead a high-performing Data Engineering function overseeing the delivery and optimisation of two enterprise-scale data platforms on Azure. With a blend of technical leadership and strategic vision, you'll chair our clients … Data Board, define the data strategy, and drive the roadmap that underpins innovation across the business as our client continues their journey into Azure Cloud Services. To be successful, you will have recent experience owning & delivering an Azure-based data platforms (Databricks, streaming device data, Smart Data, ERP systems) coupled … with hands on capabilites implementing robust data ingestions pipelines (ETL/ELT) and introduced even-driven architecture (Kafka) to enable scalable, real-time solutions. Our client is offering a basic salary between £120,000 to £140, % bonus/40% LTIP + 7.5k car allowance + additional benefits to be based in Wolverhampton or Chatham on a hybrid basis. More ❯

Lead Data Analyst – Data & Analysis Join us on our journey At Nando’s, our purpose is simple: to Create Lasting Happiness – for our people, our customers, and the communities we’re part of. Born in Johannesburg and growing worldwide, we’ve always been about more than flame-grilled PERi-PERi chicken. We’re about warmth, belonging … and creating experiences that matter – for our teams, for our guests, and for you. Now, we’re building exciting new digital and data capabilities. Our tech team has expanded rapidly over the last five years, and we’re bringing fresh ideas and innovation to the restaurant industry. This is your chance to help shape that journey. The role … We’re looking for a Lead Data Analyst to join our Data & Analysis team. This role isn’t just about crunching numbers – it’s about using data to tell stories, spark ideas, and make real impact. You’ll guide how we use data to make decisions, help shape our data More ❯

Lead Data Analyst – Data & Analysis Join us on our journey At Nando’s, our purpose is simple: to Create Lasting Happiness – for our people, our customers, and the communities we’re part of. Born in Johannesburg and growing worldwide, we’ve always been about more than flame-grilled PERi-PERi chicken. We’re about warmth, belonging … and creating experiences that matter – for our teams, for our guests, and for you. Now, we’re building exciting new digital and data capabilities. Our tech team has expanded rapidly over the last five years, and we’re bringing fresh ideas and innovation to the restaurant industry. This is your chance to help shape that journey. The role … We’re looking for a Lead Data Analyst to join our Data & Analysis team. This role isn’t just about crunching numbers – it’s about using data to tell stories, spark ideas, and make real impact. You’ll guide how we use data to make decisions, help shape our data More ❯

Lead Data Analyst – Data & Analysis Join us on our journey At Nando’s, our purpose is simple: to Create Lasting Happiness – for our people, our customers, and the communities we’re part of. Born in Johannesburg and growing worldwide, we’ve always been about more than flame-grilled PERi-PERi chicken. We’re about warmth, belonging … and creating experiences that matter – for our teams, for our guests, and for you. Now, we’re building exciting new digital and data capabilities. Our tech team has expanded rapidly over the last five years, and we’re bringing fresh ideas and innovation to the restaurant industry. This is your chance to help shape that journey. The role … We’re looking for a Lead Data Analyst to join our Data & Analysis team. This role isn’t just about crunching numbers – it’s about using data to tell stories, spark ideas, and make real impact. You’ll guide how we use data to make decisions, help shape our data More ❯

Data Science Engineer – Azure | Databricks | AI Innovation Permanent | Birmingham (Hybrid) Amtis is proud to partner with an advanced, data-driven organisation — a business that’s not just talking about AI, but actively building intelligent systems powered by Azure, Databricks, and real-world machine learning applications. This is a hands-on engineering role where you’ll be … at the core of designing, developing, and optimising modern data platforms that enable predictive analytics, AI experimentation, and large-scale automation. You’ll work in an environment where data truly drives business decisions — not just dashboards. If you’re excited by high-volume, high-velocity data challenges and want to work on next-gen … infrastructure that supports advanced analytics and AI workloads, this is your opportunity. What You’ll Be Doing Designing and building scalable, reusable data pipelines using Azure Databricks, Data Factory, and modern cloud tooling Developing secure, flexible data models and optimising performance across massive datasets Collaborating with data scientists to productionise AI models More ❯

Senior Data Engineer (Snowflake) Manchester Based - Hybrid working 4 days in office Salary £75K to £80K A Consultancy firm is looking for an experienced Senior Data Engineer to their data team. You will drive innovative data solutions within our organisation. The main focus of this Senior Data Engineer/Snowflake … Specialist role is to serve as the technical authority and leader for complex data engineering initiatives, with a specialised emphasis on Snowflake Cloud Data Warehouse architecture and its internal features. You will be responsible for the following activities Design and Build Data Pipelines: The role involves leveraging expertise in ANSI-SQL and Python to … design and construct robust and efficient data pipelines. Implement Data Models: You will be responsible for applying deep expertise in various data models, specifically Dimensional, ER (Entity-Relationship), and Data Vault, to structure data. Manage Key Stakeholders: A critical function is managing product owners and stakeholders to align technical delivery with business More ❯

Senior Data Engineer (Snowflake) Manchester Based - Hybrid working 4 days in office Salary £75K to £80K A Consultancy firm is looking for an experienced Senior Data Engineer to their data team. You will drive innovative data solutions within our organisation. The main focus of this Senior Data Engineer/Snowflake … Specialist role is to serve as the technical authority and leader for complex data engineering initiatives, with a specialised emphasis on Snowflake Cloud Data Warehouse architecture and its internal features. You will be responsible for the following activities Design and Build Data Pipelines: The role involves leveraging expertise in ANSI-SQL and Python to … design and construct robust and efficient data pipelines. Implement Data Models: You will be responsible for applying deep expertise in various data models, specifically Dimensional, ER (Entity-Relationship), and Data Vault, to structure data. Manage Key Stakeholders: A critical function is managing product owners and stakeholders to align technical delivery with business More ❯

Position: Azure Data Engineer Employment Type: Contract Start: ASAP (November/December 2025) Duration: 6 Months Location: West Midlands, UK Language(s): English Focus on SAP is a specialist SAP and ERP Recruitment organisation offering both permanent and contract staffing solutions on a global scale. Client – Partnered with a global leader in digital transformation and IT services, working … people and communities they serve. For you, this means working on challenging projects that demand innovation, collaboration, and thought leadership . Role – We are seeking an experienced Azure Data Engineer to join a leading technology-driven organisation. You will play a key role in designing, building, and optimising data pipelines and integration workflows within the Microsoft … Azure ecosystem. You will work closely with cross-functional teams to deliver efficient, scalable, and secure data solutions that enable advanced analytics and business intelligence capabilities. Key Responsibilities: Design, build, and maintain data pipelines using Azure Data Factory (ADF) . Develop ETL/ELT processes to integrate and transform large datasets across cloud and More ❯

Position: Azure Data Engineer Employment Type: Contract Start: ASAP (November/December 2025) Duration: 6 Months Location: West Midlands, UK Language(s): English Focus on SAP is a specialist SAP and ERP Recruitment organisation offering both permanent and contract staffing solutions on a global scale. Client – Partnered with a global leader in digital transformation and IT services, working … people and communities they serve. For you, this means working on challenging projects that demand innovation, collaboration, and thought leadership . Role – We are seeking an experienced Azure Data Engineer to join a leading technology-driven organisation. You will play a key role in designing, building, and optimising data pipelines and integration workflows within the Microsoft … Azure ecosystem. You will work closely with cross-functional teams to deliver efficient, scalable, and secure data solutions that enable advanced analytics and business intelligence capabilities. Key Responsibilities: Design, build, and maintain data pipelines using Azure Data Factory (ADF) . Develop ETL/ELT processes to integrate and transform large datasets across cloud and More ❯

Data Engineer Location: Paddington, London (Onsite) Salary: Up to £100,000 Job Type: Full Time We’re partnered with a well-funded early-stage tech company that’s using data and AI to bring greater financial intelligence to complex, data-heavy industries. Having recently secured significant investment from top-tier VCs, they’re now … entering a rapid growth phase and expanding their engineering team in London. They’re looking for a Data Engineer to help design and scale the core systems that power their platform - turning fragmented data into meaningful insights. You’ll work closely with technical leadership to build robust, modern data pipelines and play a key … Engineer or similar. Strong background with the modern data stack (e.g. Airbyte, dbt, BigQuery, Dagster, or equivalents). Skilled in SQL, data modelling, and pipeline orchestration. Analytical, pragmatic, and product-minded — focused on delivering impact. Comfortable in a fast-paced, collaborative, and evolving environment. A genuine interest in building technology that makes real-world More ❯

Data Engineer Location: Paddington, London (Onsite) Salary: Up to £100,000 Job Type: Full Time We’re partnered with a well-funded early-stage tech company that’s using data and AI to bring greater financial intelligence to complex, data-heavy industries. Having recently secured significant investment from top-tier VCs, they’re now … entering a rapid growth phase and expanding their engineering team in London. They’re looking for a Data Engineer to help design and scale the core systems that power their platform - turning fragmented data into meaningful insights. You’ll work closely with technical leadership to build robust, modern data pipelines and play a key … Engineer or similar. Strong background with the modern data stack (e.g. Airbyte, dbt, BigQuery, Dagster, or equivalents). Skilled in SQL, data modelling, and pipeline orchestration. Analytical, pragmatic, and product-minded — focused on delivering impact. Comfortable in a fast-paced, collaborative, and evolving environment. A genuine interest in building technology that makes real-world More ❯

Data Engineer Location: Paddington, London (Onsite) Salary: Up to £100,000 Job Type: Full Time We’re partnered with a well-funded early-stage tech company that’s using data and AI to bring greater financial intelligence to complex, data-heavy industries. Having recently secured significant investment from top-tier VCs, they’re now … entering a rapid growth phase and expanding their engineering team in London. They’re looking for a Data Engineer to help design and scale the core systems that power their platform - turning fragmented data into meaningful insights. You’ll work closely with technical leadership to build robust, modern data pipelines and play a key … Engineer or similar. Strong background with the modern data stack (e.g. Airbyte, dbt, BigQuery, Dagster, or equivalents). Skilled in SQL, data modelling, and pipeline orchestration. Analytical, pragmatic, and product-minded — focused on delivering impact. Comfortable in a fast-paced, collaborative, and evolving environment. A genuine interest in building technology that makes real-world More ❯

three-time gold investor in people award winner, an advocate of supporting women in engineering and developing their people to be the best they can be? As a data engineer specialising in generative AI; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. The opportunity: The business is looking for a Data Engineer to join an Information Management GenAI delivery Office, who will be able to evaluate design, deploy, improve and support the companies data sets. The Data Engineer will ensure data pipelines … are designed to be resilient, secure and responsive. You will use your data engineering expertise to collaborate with different internal customers regarding their data, ensuring they are optimised and secured for their needs. The Data Engineer will provide knowledge in data management and data quality to guarantee compliance to company More ❯

the best talent to strengthen our reputation as both a design practice and an employer of choice. We are seeking a motivated Junior BI Analyst to join our data analytics team. This role is perfect for an entry-level professional looking to build expertise in business intelligence, data management, and emerging AI technologies. The successful candidate … will support data-driven decision making across the organization while developing technical skills in data analysis and visualization. Key Responsibilities: Data Management & Quality Perform data cleansing, validation, and quality assurance processes Identify and resolve data inconsistencies and anomalies Document data sources, transformations, and cleansing procedures Monitor data pipelines and ensure timely data updates Business Intelligence & Reporting Develop and maintain standard business reports and dashboards Create ad-hoc reports based on stakeholder requirements Support the creation of KPIs and performance metrics Assist in data visualization best practices implementation AI Integration & Prompt Engineering Create and optimize AI prompts for various business applications Collaborate More ❯

the best talent to strengthen our reputation as both a design practice and an employer of choice. We are seeking a motivated Junior BI Analyst to join our data analytics team. This role is perfect for an entry-level professional looking to build expertise in business intelligence, data management, and emerging AI technologies. The successful candidate … will support data-driven decision making across the organization while developing technical skills in data analysis and visualization. Key Responsibilities: Data Management & Quality Perform data cleansing, validation, and quality assurance processes Identify and resolve data inconsistencies and anomalies Document data sources, transformations, and cleansing procedures Monitor data pipelines and ensure timely data updates Business Intelligence & Reporting Develop and maintain standard business reports and dashboards Create ad-hoc reports based on stakeholder requirements Support the creation of KPIs and performance metrics Assist in data visualization best practices implementation AI Integration & Prompt Engineering Create and optimize AI prompts for various business applications Collaborate More ❯