226 to 250 of 338 Data Pipeline Jobs in the UK excluding London

Technical Business Analyst, SC Cleared We are seeking a highly skilled Technical Business Analyst with over 8 years of experience to support the evolution of enterprise modern cloud data platform used for ingesting and processing large volumes of streaming and batch data sets to support analytically and AI use-case. As a key interface between the … technical and business stakeholders, you will be responsible for translating data engineering, architectural and analytically requirements into detailed, actionable user stories with clear audit tracking and version control. Key Responsibilities Collaborate with Data Architects, Engineering teams, Security, Product teams and business stakeholders to gather, analyse, and translate their needs into clear and technically sound requirements. Facilitate … with stakeholders to mitigate issues. Champion agile practices, facilitating sprint planning and retrospectives where needed. Key Skills 8+ years of experience as a Technical Business Analyst in complex, data-centric environments. Proven ability to write technical user stories for data pipelines, ETL processes, and analytics platforms. Strong understanding of data platforms, data More ❯

analytics capability, creating a brand-new vertical for revenue management. With reporting still heavily manual in the UK market, the company is investing in building a modern, scalable data infrastructure - and they're looking for a contractor to help lay the foundations. THE ROLE As a Contract Analytics Engineer, you'll play a pivotal role in setting up … the data warehouse and enabling self-serve reporting for the business. Your responsibilities will include: Supporting the design of the data model in Redshift. Implementing a Medallion architecture (bronze, silver, gold). Using DBT to model data, configure tables, and set up tests (including unit testing). Creating a data mart and … star schema for financial and revenue reporting. Advising on orchestration best practices using Airflow. Optimising data pipelines for downstream BI tools (Power BI/Looker). This role won't require building from scratch, but you'll need a solid understanding of incremental loads and strong problem-solving ability to structure data efficiently. Success will be More ❯

join our software group and help build the next generation AI-driven scientific platform. In this role, you will design, build, and optimize backend systems that power intelligent, data-driven applications. You will focus on creating high-performance APIs, architecting scalable data management tooling, and ensuring the reliability of services that integrate advanced AI frameworks with … laboratory workflows. You'll work closely with ML researchers, platform engineers, and scientists to develop systems that can handle diverse workloads and scale seamlessly, including structured SQL database, data lake houses, and vector databases. This is an opportunity to apply your deep backend expertise to a cutting-edge AI platform with real scientific impact. If you are passionate … Building Design & Build APIs: Design and build high-performance, secure, and well-documented APIs that integrate with AI-driven applications. Database Architecture & Scaling: Architect schemas and manage diverse data systems (SQL, NoSQL, Vector DBs, and others) for optimal performance and scalability. Backend Systems Development: Drive the implementation of backend services, focusing on performance, maintainability, and reliability. Performance & Reliability More ❯

Join a dynamic team committed to driving data excellence. Our client is seeking a Data Engineer to become an integral part of their Azure - Data team in Fareham. This permanent, hybrid role will require you to work three days a week in the office, starting on November 3, 2025. You will play a key … role in enhancing their Microsoft Business Intelligence capabilities. **Key Responsibilities:** - Develop and maintain data pipelines and architectures using Azure tools. - Collaborate with cross-functional teams to support data-driven decision-making. - Implement best practices in data management and security. - Optimize data flow and collection for improved analytics performance. - Design effective data … and demonstrate a commitment to collaboration and innovation. Our client values inclusivity and welcomes candidates from diverse backgrounds. If you are excited about the prospect of shaping impactful data solutions and working in a supportive environment, we encourage you to apply for this opportunity. Your contributions will be vital in supporting the team's growth and success. More ❯

Data Engineer (Defence) £45,000 - 55,000 GBP Onsite WORKING Location: Stevenage, Cambridge, East of England - United Kingdom Type: Permanent Data Engineer - Generative AI | Defence Technology A leading international defence organisation is seeking an experienced Data Engineer with a focus on Generative AI to join their IM GenAI Delivery Office in the UK. You … support advanced defence systems and critical internal projects. What you'll do: Develop and maintain robust, secure, and high-integrity datasets for internal defence applications. Design and optimise data pipelines to ensure reliable, compliant, and scalable solutions. Apply your expertise in Generative AI, NLP, and OCR to enhance and automate data processes. Build ETL workflows, APIs … and other data integration solutions tailored for mission-critical environments . Provide guidance on emerging technologies and support the roadmap for next-generation defence data solutions . Skills and experience: Strong knowledge of SQL (MS SQL, Oracle) and noSQL databases (e.g., MongoDB, Neo4J, InfluxDB). Hands-on experience with data processing and integration tools More ❯

Lead Data Engineer- £70,000 Industry: Banking and Financial Services Location : Flexible- Basingstoke (3 Days a Week) Overview of Role: This role will lead the design and optimisation of our Azure Databricks data platform , ensuring it is secure, scalable, and well governed. You'll take ownership of change controls, lineage, and documentation while driving adoption of … best practice. Alongside this, you'll support AI/ML initiatives and provide technical guidance to colleagues, driving value from data. Key Responsibilities Lead the roadmap for data engineering, ensuring alignment with business needs and regulatory requirements. Own the design and optimisation of the Azure Databricks platform, focusing on performance, resilience, and compliance. Implement change controls, lineage, and … observability to detect and resolve issues. Maintain clear documentation of data pipelines, models, and governance processes. Implement tools to improve data quality, efficiency, and adoption. Support AI/ML delivery by building/optimising, ensuring platform readiness. Manage SQL workloads within Databricks, balancing cost and performance Ensure access controls, GDPR compliance, and security standards Work with More ❯

Operational Engineer 6 Months SC CLEARED Hybrid 2/3 days Telford £550 Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with cross-functional teams to gather requirements, define technical … specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are … upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualization using Denodo. Proficiency in SAS for data analytics and reporting. Oracle More ❯

Operational Engineer 6 Months SC CLEARED Hybrid 2/3 days Telford 550 Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with cross-functional teams to gather requirements, define technical … specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are … upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualization using Denodo. Proficiency in SAS for data analytics and reporting. Oracle More ❯

will bring with you a proven track record of selling and leading large-scale, high-impact programmes, preferably in the life sciences sector, along with significant experience in data analytics, business intelligence, quantitative research, and automation solutions. This role will be pivotal in managing and expanding DT’s book of business. The successful candidate will be responsible for … our team and our purpose to enable healthcare organisations to be future ready. About You As a Senior Principal, you are passionate about leading and delivering high-impact, data-driven solutions for life science clients. You thrive on orchestrating multidisciplinary teams, fostering collaboration across business units, and inspiring a culture of innovation and excellence. You are accountable for … development of DT’s capabilities and reputation in the market. You will thrive in this role if you are passionate about strategic growth, possess deep domain expertise in data and analytics for life sciences, and are energised by leading teams to deliver measurable, sustainable impact in a dynamic, client-focused environment. Key Responsibilities Client Delivery & Excellence Lead delivery More ❯

will bring with you a proven track record of selling and leading large-scale, high-impact programmes, preferably in the life sciences sector, along with significant experience in data analytics, business intelligence, quantitative research, and automation solutions. This role will be pivotal in managing and expanding DT’s book of business. The successful candidate will be responsible for … our team and our purpose to enable healthcare organisations to be future ready. About You As a Senior Principal, you are passionate about leading and delivering high-impact, data-driven solutions for life science clients. You thrive on orchestrating multidisciplinary teams, fostering collaboration across business units, and inspiring a culture of innovation and excellence. You are accountable for … development of DT’s capabilities and reputation in the market. You will thrive in this role if you are passionate about strategic growth, possess deep domain expertise in data and analytics for life sciences, and are energised by leading teams to deliver measurable, sustainable impact in a dynamic, client-focused environment. Key Responsibilities Client Delivery & Excellence Lead delivery More ❯

will bring with you a proven track record of selling and leading large-scale, high-impact programmes, preferably in the life sciences sector, along with significant experience in data analytics, business intelligence, quantitative research, and automation solutions. This role will be pivotal in managing and expanding DT’s book of business. The successful candidate will be responsible for … our team and our purpose to enable healthcare organisations to be future ready. About You As a Senior Principal, you are passionate about leading and delivering high-impact, data-driven solutions for life science clients. You thrive on orchestrating multidisciplinary teams, fostering collaboration across business units, and inspiring a culture of innovation and excellence. You are accountable for … development of DT’s capabilities and reputation in the market. You will thrive in this role if you are passionate about strategic growth, possess deep domain expertise in data and analytics for life sciences, and are energised by leading teams to deliver measurable, sustainable impact in a dynamic, client-focused environment. Key Responsibilities Client Delivery & Excellence Lead delivery More ❯

Cambridge, Gatwick, Milton Keynes, Reading Business Line Enabling Functions Job Type Permanent/FTC Date published 07-Aug-2025 20282 Connect to your Industry Are you passionate about data science and AI? Do you want to apply your skills and knowledge to help shape the future of Deloitte? If so, we have an exciting opportunity for you to … join our Enabling Functions team as an AI Engineer & Data Scientist. You be part of an exciting innovative team that delivers cutting edge GenAI solutions. As an AI Engineer & Data Scientist, you will work on innovative projects that leverage data and AI to enhance our internal capabilities and deliver value to our employees. You … lead every decision we make and action we take, guiding us to deliver impact how and where it matters most. Connect to your opportunity As an AI Engineer & Data Scientist, you will be expected to: Build Agentic AI and GenAI solutions, from PoC to production, using agile methodologies and best practices. Apply advanced analytical techniques, such as machine More ❯

Cambridge, Gatwick, Milton Keynes, Reading Business Line Enabling Functions Job Type Permanent/FTC Date published 07-Aug-2025 20282 Connect to your Industry Are you passionate about data science and AI? Do you want to apply your skills and knowledge to help shape the future of Deloitte? If so, we have an exciting opportunity for you to … join our Enabling Functions team as an AI Engineer & Data Scientist. You be part of an exciting innovative team that delivers cutting edge GenAI solutions. As an AI Engineer & Data Scientist, you will work on innovative projects that leverage data and AI to enhance our internal capabilities and deliver value to our employees. You … lead every decision we make and action we take, guiding us to deliver impact how and where it matters most. Connect to your opportunity As an AI Engineer & Data Scientist, you will be expected to: Build Agentic AI and GenAI solutions, from PoC to production, using agile methodologies and best practices. Apply advanced analytical techniques, such as machine More ❯

Cambridge, Gatwick, Milton Keynes, Reading Business Line Enabling Functions Job Type Permanent/FTC Date published 07-Aug-2025 20282 Connect to your Industry Are you passionate about data science and AI? Do you want to apply your skills and knowledge to help shape the future of Deloitte? If so, we have an exciting opportunity for you to … join our Enabling Functions team as an AI Engineer & Data Scientist. You be part of an exciting innovative team that delivers cutting edge GenAI solutions. As an AI Engineer & Data Scientist, you will work on innovative projects that leverage data and AI to enhance our internal capabilities and deliver value to our employees. You … lead every decision we make and action we take, guiding us to deliver impact how and where it matters most. Connect to your opportunity As an AI Engineer & Data Scientist, you will be expected to: Build Agentic AI and GenAI solutions, from PoC to production, using agile methodologies and best practices. Apply advanced analytical techniques, such as machine More ❯

Cambridge, Gatwick, Milton Keynes, Reading Business Line Enabling Functions Job Type Permanent/FTC Date published 07-Aug-2025 20282 Connect to your Industry Are you passionate about data science and AI? Do you want to apply your skills and knowledge to help shape the future of Deloitte? If so, we have an exciting opportunity for you to … join our Enabling Functions team as an AI Engineer & Data Scientist. You be part of an exciting innovative team that delivers cutting edge GenAI solutions. As an AI Engineer & Data Scientist, you will work on innovative projects that leverage data and AI to enhance our internal capabilities and deliver value to our employees. You … lead every decision we make and action we take, guiding us to deliver impact how and where it matters most. Connect to your opportunity As an AI Engineer & Data Scientist, you will be expected to: Build Agentic AI and GenAI solutions, from PoC to production, using agile methodologies and best practices. Apply advanced analytical techniques, such as machine More ❯

We are seeking a Senior Backend Python Developer to support the development of our AI-driven marketing platform, with a strong focus on performance, scalability, and data pipeline architecture click apply for full job details More ❯

We are seeking a Senior Backend Python Developer to support the development of our AI-driven marketing platform, with a strong focus on performance, scalability, and data pipeline architecture click apply for full job details More ❯

technology and ability to lead a team. You will hold proven experience of architecting solutions using Python (FastAPI/FlasK) and will lead the technical designs for APIs, data pipelines, cloud infrastructure and backend orchestration. You will also have experience with AWS, while familiarity with MongoDB would be advantageous to your application. In this role of significant responsibility More ❯

technology and desire to mentor a team. You will hold proven experience of architecting solutions using Python (FastAPI/FlasK) and will lead the technical designs for APIs, data pipelines, cloud infrastructure and backend orchestration. You will also have experience with AWS, while familiarity with MongoDB would be advantageous to your application. In this role of significant responsibility More ❯

Lead Data Engineer - £65-70k + bonus + benefits - Basingstoke 3 days a week The Opportunity: We are looking for a Lead Data Engineer to join a Basingstoke based organisation who are investing heavily in their Digital Transformation Programme. The Role: There is currently 1 Data Engineer in the team and you'll … join to play a proactive role in the delivery of their next-generation data platform, manage/mentor the existing person and drive the design, development and governance of the data pipelines. You'll be working really closely with stakeholders across the technology function and within the business and will the availability, integrity and compliance of … background/attributes include: - In depth experience of modern data solution architecture design and delivery in a hybrid cloud environment but predominantly Azure/Databricks - Experience of pipeline orchestration management - Strong exprerience with Databricks - Experience of implementing machine learning and AI - Tooling such as Purview and Unity Catalog as well as the use of observability tools such More ❯

smooth and efficient functioning and development of our databases and pipelines. You will be responsible for developing, optimising and managing these databases and ensuring a high-level of data quality and integrity. You will be defining the principles and processes that underpin data management while ensuring we maintain the highest standards for data management … repeatable and scalable. Create and manage database schemas, tables, stored procedures, indexes, and triggers. Ensuring high availability of databases through clustering, replication, and other techniques. Implement and maintain data pipelines and ETL processes for real-time and batch data ingestion. Monitor database performance and proactively address issues related to tuning and optimization. Ensure data security, privacy, integrity, and compliance with internal and external regulations. Collaborate with third-party suppliers, software developers, data analysts, DevOps, and other stakeholders to meet project requirements. Plan and implement database backups, restores, and disaster recovery strategies. Taking an active role in supporting and in finding the root cause of operational issues and preventing recurrences. Support More ❯

Data Engineer £55000 GBP Onsite WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Data Engineer - Generative AI Hybrid (2-3 days on-site) - UK-based £45,000-£55,000 + Benefits Join a growing international team at the forefront of Generative AI and data innovation. You'll be working within a developing … cross-functional environment, building and maintaining high-quality, secure datasets that underpin critical internal projects. This is a unique opportunity to apply your data engineering skills to a high-impact, defence-focused setting where your work directly supports national capability. What you'll be doing: Designing, deploying, and optimising secure and resilient data pipelines Collaborating with … internal stakeholders to ensure datasets are tailored, reliable, and compliant with governance standards Applying your expertise in data management, processing, and quality assurance Staying ahead of emerging technologies, contributing to the technology roadmap Delivering innovative solutions in NLP, OCR, and Generative AI applications Experience required: Strong SQL skills (e.g. MS SQL, Oracle) and noSQL skills (e.g. MongoDB, Neo4J More ❯

to protect their organizations. We're driven by a mission to stay ahead of bad actors and safeguard the digital world. Join us in our pursuit to defend data and protect people. How We Work: At Proofpoint, you'll be part of a global team that breaks barriers to redefine cybersecurity, guided by our BRAVE core values: Bold … organizations' greatest assets and biggest risks: vulnerabilities in people. With an integrated suite of cloud-based solutions, Proofpoint helps companies around the world stop targeted threats, safeguard their data, and make their users more resilient against cyber-attacks. Leading organizations of all sizes, including more than half of the Fortune 1000, rely on Proofpoint for people-centric security … pivotal role, you will drive the implementation of cloud infrastructure and services enabling the research, training and productionisation of advanced ML models powering our email threat detection and data loss prevention products. You will collaborate closely with Data Scientists, Backend and Data Engineers to lead major initiatives end-to-end ensuring that our ML More ❯

Job Title: Lead Data Engineer Location: Warwick (Hybrid - once per week onsite) Remuneration: From £700 per day (via umbrella company) Contract Details: Fixed Term Contract, 6 months, Full Time Are you ready to take the lead in transforming data engineering? Our client, a forward-thinking organisation, is seeking a highly skilled and hands-on Lead Data Engineer to drive their Data & Insights platform built on the Azure stack. This is a Databricks-heavy role , ideal for someone who thrives in technical environments and enjoys working directly with cutting-edge tools. Why This Role Stands Out This is not just a leadership role - it's a hands … on engineering opportunity where your Databricks expertise will be front and centre . You'll be the go-to person for all things Databricks, from architecture and configuration to pipeline promotion and troubleshooting. Key Responsibilities Lead and deliver hands-on data engineering across all layers of the Azure-based data platform. Act as the Databricks More ❯

Our client, leading UK retailer, are currently looking to hire a Machine Learning Engineer (Data/ML) based from their offices in London. Job Title: Machine Learning Engineer (Data/ML) Location: London/Hybrid - Once a week (Thursday) in London Duration: 6 Months Day Rate: £425-475 per day (Inside IR35 - Umbrella) This is a … greenfield based project with crossover from another tech team conducting a similar model. You will collaborate with the Data Scientist, Data Architect, and cross-functional Tech Teams , supporting the build phase while contributing hands-on technical expertise. Key Responsibilities: Work with the Senior Engineer/Tech Lead to implement and optimise data pipelines and … ML models. Develop high-quality, maintainable code in Python and PySpark. Use SQL and Jupiter to analyse, transform and validate data for ML use cases. Operate in a cloud environment (AWS/Azure - moving towards Azure). Collaborate with stakeholders and technical teams to deliver solutions that support business growth. Skills & Experience Required: Strong hands-on experience in More ❯