601 to 625 of 1,153 Data Pipeline Jobs in the UK excluding London

emissions for a cleaner, brighter future. The role: As a Senior SAP Functional Business Analyst, you will help drive our goals by: Acting as a bridge between the data team (e.g., SAP BW, data engineering, and BI reporting colleagues), the business, and the SAP technical team by helping to build the data foundation and … develop reporting solutions based on SAP processes and data flows. Engaging directly with business stakeholders to understand and clarify reporting and analytics requirements, primarily in the finance (Record-to-Report) domain, and translating them into technical specifications aligned with SAP Business Warehouse (BW/4HANA) and SAP Analytics Cloud (SAC) architecture and development standards. Analysing SAP ERP (ECC … transactions to identify relevant extractors, tables, and logic for reporting, while acting as a subject matter expert in Financial and other SAP processes, transaction flows, and data structures. Collaborating with data team to design, develop, and validate robust data pipelines and models, ensuring data integrity, consistency, and completeness through validation against ECC More ❯

Senior Data Engineer | Systematic Trading A Top-tier quant fund is hiring a Senior Data Engineer to help architect and scale a global Data Lakehouse that feeds directly into live trading strategies. If you’ve already been building data infrastructure inside a hedge fund or HFT shop, you’ll know what this … role really means: low-latency, high-availability, globally distributed data pipelines that quant teams trust every day. This is your chance to level up from patching legacy pipelines to building the core platform used by quant researchers and traders across desks and regions. What You’ll Be Driving Architect and build a global Lakehouse platform (Data Lake + OLAP) in AWS Develop scalable data pipelines in Python , working with SDKs and data libs Own end-to-end data modeling , ingestion, validation, and optimization for high-concurrency access Tune performance of cross-region, multi-format data stores (columnar, real-time, etc.) Deliver tailored solutions directly to quants More ❯

Senior Data Engineer | Systematic Trading A Top-tier quant fund is hiring a Senior Data Engineer to help architect and scale a global Data Lakehouse that feeds directly into live trading strategies. If you’ve already been building data infrastructure inside a hedge fund or HFT shop, you’ll know what this … role really means: low-latency, high-availability, globally distributed data pipelines that quant teams trust every day. This is your chance to level up from patching legacy pipelines to building the core platform used by quant researchers and traders across desks and regions. What You’ll Be Driving Architect and build a global Lakehouse platform (Data Lake + OLAP) in AWS Develop scalable data pipelines in Python , working with SDKs and data libs Own end-to-end data modeling , ingestion, validation, and optimization for high-concurrency access Tune performance of cross-region, multi-format data stores (columnar, real-time, etc.) Deliver tailored solutions directly to quants More ❯

Senior Data Engineer | Systematic Trading A Top-tier quant fund is hiring a Senior Data Engineer to help architect and scale a global Data Lakehouse that feeds directly into live trading strategies. If you’ve already been building data infrastructure inside a hedge fund or HFT shop, you’ll know what this … role really means: low-latency, high-availability, globally distributed data pipelines that quant teams trust every day. This is your chance to level up from patching legacy pipelines to building the core platform used by quant researchers and traders across desks and regions. What You’ll Be Driving Architect and build a global Lakehouse platform (Data Lake + OLAP) in AWS Develop scalable data pipelines in Python , working with SDKs and data libs Own end-to-end data modeling , ingestion, validation, and optimization for high-concurrency access Tune performance of cross-region, multi-format data stores (columnar, real-time, etc.) Deliver tailored solutions directly to quants More ❯

Data Engineer Salary: £70,000 Location: London (3 Days per Week in Office) Join a fast-paced analytics team driving data innovation at a global tech powerhouse! Take ownership of modern data pipelines, shape the future of reporting, and make an immediate impact in a collaborative, forward-thinking environment. The Opportunity This is an … exciting opportunity to step into a senior-level data engineering role within a global technology business that's transforming the way customers connect with everyday services. You'll play a key part in building and optimizing modern data pipelines, supporting a major migration from Tableau to Looker, and ensuring the delivery of clean, reliable, and scalable … data solutions. The team operates with a strong focus on collaboration, innovation, and autonomy, giving you the chance to influence data strategy and mentor others. You'll work closely with analytics and marketing stakeholders to bring data-driven insights to life and help shape the future of customer experience. This is a role for More ❯

TensorFlow, or similar). Interest in AI-driven automation, predictive analytics , and intelligent risk modelling . Experience with Rust , WebAssembly , or cross-runtime architectures . Solid grounding in data pipelines, APIs, and distributed messaging systems (Kafka, ZeroMQ, etc.). Why Apply This is a flagship product being rolled out across the bank’s global capital markets division — you More ❯

TensorFlow, or similar). Interest in AI-driven automation, predictive analytics , and intelligent risk modelling . Experience with Rust , WebAssembly , or cross-runtime architectures . Solid grounding in data pipelines, APIs, and distributed messaging systems (Kafka, ZeroMQ, etc.). Why Apply This is a flagship product being rolled out across the bank’s global capital markets division — you More ❯

TensorFlow, or similar). Interest in AI-driven automation, predictive analytics , and intelligent risk modelling . Experience with Rust , WebAssembly , or cross-runtime architectures . Solid grounding in data pipelines, APIs, and distributed messaging systems (Kafka, ZeroMQ, etc.). Why Apply This is a flagship product being rolled out across the bank’s global capital markets division — you More ❯

A fantastic opportunity has arisen for a Data Engineer specialising in Generative AI to join a developing international and transversal structure, supporting the design, build, and maintenance of data sets for internal customers across the organisation. Please note that due to the nature of the client’s business, only candidates who currently hold full sole British … Citizenship (without limitations) will be considered. This role performs the duties of a Data Engineer and reports to the IM GenAI Delivery Office Lead. Key Responsibilities: Evaluate, design, deploy, and support data pipelines and data sets to ensure they are resilient, secure, and responsive. Collaborate with internal customers to optimise and secure data for their specific needs. Provide expertise in data management, quality, and governance to ensure compliance with organisational standards. Stay up to date with new technologies, contributing to the technology roadmap and delivering innovative solutions. Support and maintain data sets for internal customers, ensuring sustainability and long-term usability. The ideal candidate would have: Experience More ❯

A fantastic opportunity has arisen for a Data Engineer specialising in Generative AI to join a developing international and transversal structure, supporting the design, build, and maintenance of data sets for internal customers across the organisation. Please note that due to the nature of the client’s business, only candidates who currently hold full sole British … Citizenship (without limitations) will be considered. This role performs the duties of a Data Engineer and reports to the IM GenAI Delivery Office Lead. Key Responsibilities: Evaluate, design, deploy, and support data pipelines and data sets to ensure they are resilient, secure, and responsive. Collaborate with internal customers to optimise and secure data for their specific needs. Provide expertise in data management, quality, and governance to ensure compliance with organisational standards. Stay up to date with new technologies, contributing to the technology roadmap and delivering innovative solutions. Support and maintain data sets for internal customers, ensuring sustainability and long-term usability. The ideal candidate would have: Experience More ❯

A fantastic opportunity has arisen for a Data Engineer specialising in Generative AI to join a developing international and transversal structure, supporting the design, build, and maintenance of data sets for internal customers across the organisation. Please note that due to the nature of the client’s business, only candidates who currently hold full sole British … Citizenship (without limitations) will be considered. This role performs the duties of a Data Engineer and reports to the IM GenAI Delivery Office Lead. Key Responsibilities: Evaluate, design, deploy, and support data pipelines and data sets to ensure they are resilient, secure, and responsive. Collaborate with internal customers to optimise and secure data for their specific needs. Provide expertise in data management, quality, and governance to ensure compliance with organisational standards. Stay up to date with new technologies, contributing to the technology roadmap and delivering innovative solutions. Support and maintain data sets for internal customers, ensuring sustainability and long-term usability. The ideal candidate would have: Experience More ❯

AI Engineer on a contract basis. Outside IR35. Hybrid working - London based. Role * The AI Engineer will design, develop, and implement AI and machine learning solutions to support data-driven decision-making and business innovation in pharmaceuticals.* Collaborate with data scientists, data engineers, and business analysts to build scalable AI models for research, development … and commercial operations.* Develop, test, and optimise machine learning algorithms and predictive models relevant to pharmaceutical data.* Integrate AI models with existing data pipelines, laboratory systems, and business applications.* Ensure the reliability, scalability, and performance of AI systems across multiple platforms.* Maintain clear documentation and contribute to best practices in model governance, regulatory compliance, and MLOps.* Stay abreast … in Python and familiar with key libraries such as TensorFlow, PyTorch, and scikit-learn.* Experience working with cloud platforms such as Azure, AWS, or GCP, ideally within a data engineering or MLOps context.* Strong understanding of data processing, feature engineering, and model evaluation techniques, with experience handling complex scientific datasets.* Excellent problem-solving and analytical skills More ❯

Data Engineering Lead 📍 Hybrid – 1–2 days per week in Old Street, London | 💰 £60,000–£70,000 per annum | 📅 18-month FTC (potential to go permanent) We’re working with Better Society Capital , the UK’s leading impact investor, to help them find their first-ever Data Engineering Lead . This is a rare opportunity to … build something from the ground up, shaping how data is managed, integrated, and used to drive meaningful social change. In this hands-on, strategic role, you’ll design and develop modern data pipelines using SQL , Python , and Azure/Fabric , while also guiding the wider organisation through their data transformation journey. You’ll be … the link between technology and the business, understanding needs, building solutions, and championing data-driven decision-making across teams. They’re looking for a self-starter who can bring both technical expertise and strong stakeholder skills, someone who’s confident leading conversations, defining standards, and making data accessible to everyone. You’ll play a central role More ❯

Data Engineering Lead 📍 Hybrid – 1–2 days per week in Old Street, London | 💰 £60,000–£70,000 per annum | 📅 18-month FTC (potential to go permanent) We’re working with Better Society Capital , the UK’s leading impact investor, to help them find their first-ever Data Engineering Lead . This is a rare opportunity to … build something from the ground up, shaping how data is managed, integrated, and used to drive meaningful social change. In this hands-on, strategic role, you’ll design and develop modern data pipelines using SQL , Python , and Azure/Fabric , while also guiding the wider organisation through their data transformation journey. You’ll be … the link between technology and the business, understanding needs, building solutions, and championing data-driven decision-making across teams. They’re looking for a self-starter who can bring both technical expertise and strong stakeholder skills, someone who’s confident leading conversations, defining standards, and making data accessible to everyone. You’ll play a central role More ❯

Data Engineering Lead 📍 Hybrid – 1–2 days per week in Old Street, London | 💰 £60,000–£70,000 per annum | 📅 18-month FTC (potential to go permanent) We’re working with Better Society Capital , the UK’s leading impact investor, to help them find their first-ever Data Engineering Lead . This is a rare opportunity to … build something from the ground up, shaping how data is managed, integrated, and used to drive meaningful social change. In this hands-on, strategic role, you’ll design and develop modern data pipelines using SQL , Python , and Azure/Fabric , while also guiding the wider organisation through their data transformation journey. You’ll be … the link between technology and the business, understanding needs, building solutions, and championing data-driven decision-making across teams. They’re looking for a self-starter who can bring both technical expertise and strong stakeholder skills, someone who’s confident leading conversations, defining standards, and making data accessible to everyone. You’ll play a central role More ❯

Location : Milton Keynes, hybrid Type of employmnbet : Contract or Permanent Lead end-to-end data workflows—from requirement-to-delivery—including data product creation and secure data transfer from Google Cloud Platform to PostgreSQL. 1. Develop & Schedule SQL Views via DAGs Design and implement SQL views aligned with business needs, prioritizing clarity, reusability, and … those views, ensuring reliable execution on daily, weekly, or customized schedules. 2. Execute Cross‐Platform ETL with AWS Glue Develop, deploy, and maintain AWS Glue jobs to extract data from GCP (such as BigQuery or GCS) and load it into PostgreSQL. Set up secure connectivity, schedule jobs via cron or trigger mechanisms, and ensure data pipelines … are reliable and idempotent. 3. Monitor, Troubleshoot & Resolve Incidents Continuously oversee ETL workflows in Airflow and AWS Glue, proactively responding to alerts and errors. Conduct root cause analysis for pipeline failures—whether due to schema mismatches or performance bottlenecks—and apply robust fixes. Document resolutions to strengthen system resilience. 4. Design, Build, & Govern Data Products Architect, construct More ❯

Location : Milton Keynes, hybrid Type of employmnbet : Contract or Permanent Lead end-to-end data workflows—from requirement-to-delivery—including data product creation and secure data transfer from Google Cloud Platform to PostgreSQL. 1. Develop & Schedule SQL Views via DAGs Design and implement SQL views aligned with business needs, prioritizing clarity, reusability, and … those views, ensuring reliable execution on daily, weekly, or customized schedules. 2. Execute Cross‐Platform ETL with AWS Glue Develop, deploy, and maintain AWS Glue jobs to extract data from GCP (such as BigQuery or GCS) and load it into PostgreSQL. Set up secure connectivity, schedule jobs via cron or trigger mechanisms, and ensure data pipelines … are reliable and idempotent. 3. Monitor, Troubleshoot & Resolve Incidents Continuously oversee ETL workflows in Airflow and AWS Glue, proactively responding to alerts and errors. Conduct root cause analysis for pipeline failures—whether due to schema mismatches or performance bottlenecks—and apply robust fixes. Document resolutions to strengthen system resilience. 4. Design, Build, & Govern Data Products Architect, construct More ❯

Location : Milton Keynes, hybrid Type of employmnbet : Contract or Permanent Lead end-to-end data workflows—from requirement-to-delivery—including data product creation and secure data transfer from Google Cloud Platform to PostgreSQL. 1. Develop & Schedule SQL Views via DAGs Design and implement SQL views aligned with business needs, prioritizing clarity, reusability, and … those views, ensuring reliable execution on daily, weekly, or customized schedules. 2. Execute Cross‐Platform ETL with AWS Glue Develop, deploy, and maintain AWS Glue jobs to extract data from GCP (such as BigQuery or GCS) and load it into PostgreSQL. Set up secure connectivity, schedule jobs via cron or trigger mechanisms, and ensure data pipelines … are reliable and idempotent. 3. Monitor, Troubleshoot & Resolve Incidents Continuously oversee ETL workflows in Airflow and AWS Glue, proactively responding to alerts and errors. Conduct root cause analysis for pipeline failures—whether due to schema mismatches or performance bottlenecks—and apply robust fixes. Document resolutions to strengthen system resilience. 4. Design, Build, & Govern Data Products Architect, construct More ❯

you will do 🚀 Build fundamental models for education - solving the ultimate learning task of predicting student knowledge and optimal ‘next task’ Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable to any context - right now it’s … the English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather … models based on these results Optimise and fine-tune machine learning models for performance, scalability, and accuracy Essential skills 🙏 Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Experience working with entire ML systems and data pipelines in large-scale production systems Experience building automated data More ❯

you will do 🚀 Build fundamental models for education - solving the ultimate learning task of predicting student knowledge and optimal ‘next task’ Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable to any context - right now it’s … the English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather … models based on these results Optimise and fine-tune machine learning models for performance, scalability, and accuracy Essential skills 🙏 Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Experience working with entire ML systems and data pipelines in large-scale production systems Experience building automated data More ❯

you will do 🚀 Build fundamental models for education - solving the ultimate learning task of predicting student knowledge and optimal ‘next task’ Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable to any context - right now it’s … the English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather … models based on these results Optimise and fine-tune machine learning models for performance, scalability, and accuracy Essential skills 🙏 Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Experience working with entire ML systems and data pipelines in large-scale production systems Experience building automated data More ❯

Senior Data Engineers with a background are required by this major client, as they continue to expand their engineering capability in their Leeds offices, where you will provide best in class Data Engineering services to a wide range of major Public Sector organisations. As a result of the work that they do, this client requires applicants … national or dual UK national. Please note your application will not be taken forward if you cannot fulfil these requirements. In order to secure one of these Senior Data Engineer roles you must be able to demonstrate the following experience: Experience in prominent languages such as Python, Scala, Spark, SQL. Experience working with any database technologies from an … and experience using at least one Data Platform Technology such as Quantexa, Palantir and DataBricks Knowledge of test automation frameworks and ability to automate testing within the pipeline This is an opportunity for significant growth, but with a start-up feel and mentality. In this role you will have the chance to build and be part of More ❯

setup, including nodes, networks, and security frameworks. Deep understanding of cryptography, hashing algorithms, digital signatures, and encryption techniques. Knowledge of integration with enterprise systems, APIs, cloud services, and data pipelines. Hands-on experience with DevOps, containerization, CI/CD pipelines, and cloud platforms (AWS, Azure, GCP) for blockchain deployment. Strong experience in solution architecture, technical leadership, and mentoring More ❯

setup, including nodes, networks, and security frameworks. Deep understanding of cryptography, hashing algorithms, digital signatures, and encryption techniques. Knowledge of integration with enterprise systems, APIs, cloud services, and data pipelines. Hands-on experience with DevOps, containerization, CI/CD pipelines, and cloud platforms (AWS, Azure, GCP) for blockchain deployment. Strong experience in solution architecture, technical leadership, and mentoring More ❯

setup, including nodes, networks, and security frameworks. Deep understanding of cryptography, hashing algorithms, digital signatures, and encryption techniques. Knowledge of integration with enterprise systems, APIs, cloud services, and data pipelines. Hands-on experience with DevOps, containerization, CI/CD pipelines, and cloud platforms (AWS, Azure, GCP) for blockchain deployment. Strong experience in solution architecture, technical leadership, and mentoring More ❯