176 to 200 of 707 Data Pipeline Jobs in London

Data Delivery and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Data Business Analyst - MetaData, Cloud, Healthcare £Market Rate - Inside IR35 London/Hybrid - 2 days per week on site 3-6 months My client is an instantly recognisable Healthcare Insurer who urgently require a Data Business Analyst to join a business-critical programme. Key Requirements: Proven commercial experience working as a Data Business Analyst … within large, complex organisations (Healthcare/Insurance preferred). Experience working on large-scale Data programmes. The ability to analyse and document business processes to gather and define requirements. The ability to develop and maintain detailed project documentation, including business requirements, process flows, and Data models. Working knowledge of structured, unstructured and MetaData. Familiarity with Data pipelines for cloud environments (Azure, GCP, AWS, Snowflake). Awareness of medallion architecture (Gold, Silver, Bronze). Previous experience creating Data requirements for Data Engineers/Data Scientists. Proficiency in Data Analysis tools such as SQL, Python and R and the ability to write simple SQL scripts. Strong understanding of More ❯

Data Business Analyst - MetaData, Cloud, Healthcare £Market Rate - Inside IR35 London/Hybrid - 2 days per week on site 3-6 months My client is an instantly recognisable Healthcare Insurer who urgently require a Data Business Analyst to join a business-critical programme. Key Requirements: Proven commercial experience working as a Data Business Analyst … within large, complex organisations (Healthcare/Insurance preferred). Experience working on large-scale Data programmes. The ability to analyse and document business processes to gather and define requirements. The ability to develop and maintain detailed project documentation, including business requirements, process flows, and Data models. Working knowledge of structured, unstructured and MetaData. Familiarity with Data pipelines for cloud environments (Azure, GCP, AWS, Snowflake). Awareness of medallion architecture (Gold, Silver, Bronze). Previous experience creating Data requirements for Data Engineers/Data Scientists. Proficiency in Data Analysis tools such as SQL, Python and R and the ability to write simple SQL scripts. Strong understanding of More ❯

Senior Fabric Developer Data & Analytics Consultanc **y London/Hybri** d SDG Group is a global Consulting firm specialising in Data & Analytics. We are committed to unlocking an organisations' potential and hidden value by offering in-depth analytics expertise that empowers our clients' business models to become successful data-driven enterprises. Innovation is in … will play a pivotal role in designing, developing, and deploying enterprise-grade solutions using Microsoft Fabric. You will work closely with clients and internal teams to build scalable data pipelines, semantic models, and visualizations that support advanced analytics and business intelligence initiatives. Must be a willing to learn other Technology Stacks, Data Bricks, Sn **owflake. What … You'll** Be Doing Lead the design and implementation of solutions using Microsoft Fabric, including Data Factory, Dataflows, Lakehouses, and - Power BI.Architect and optimize data pipelines for performance, scalability, and re - liability.Develop and maintain semantic models and datasets for reporting and - analytics.Collaborate with cross-functional teams including data engineers, analysts, and business sta - keholders.Ensure More ❯

Company Description At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in fair and equitable way. With over 20 brands across 30+ countries, we strive for fair and … the worlds leading job-tech platform. Job Description The role of Product Analytics Manager in our company is at the intersection of several disciplines: Product Analytics, Insights Analytics, Data Engineering and Data Science. Your teams projects will cover a broad range of topics, from working with engineers to implement event tracking on our platforms, all the … way to generating data insights and sometimes building predictive models, ultimately helping our Product organisation deliver great products, which solve meaningful user problems. You and your team are part of a larger Product Analytics group, and will be working closely with Product Directors, Heads of Product, Data Engineers, Data Scientists and many other stakeholders More ❯

LEAD DATA ENGINEER £80,000 - £90,000 - LONDON Company Our client is a global leader in data and analytics , working with major brands across 90+ markets. They combine deep industry expertise, vast datasets, and advanced technology to help businesses understand people and drive smarter decisions. The company is backed by a top-tier private equity firm … and is currently investing heavily in its data and technology platforms, offering the feel of a scale-up within a global business. Role As a Lead Data Engineer , you'll take ownership of designing, maintaining, and evolving the data pipelines that power large-scale analytical and machine learning models. You'll work closely with … Data Scientists, Analysts, and Software Engineers to deliver robust, scalable data infrastructure. The focus areas include building and optimising pipelines for survey data, improving anti-fraud models, and supporting new data science initiatives.You'll manage two mid-level engineers, providing technical direction, mentoring, and helping the team refine ways of working. The More ❯

Senior Data Engineer – Insurance Sector Location: Hybrid (London-based with flexible working) Salary: £85K -£100K – this is dependent on skills and experience Join a growing data team that’s transforming how the insurance industry uses data to make smarter, faster decisions. As a Senior Data Engineer , you’ll design and deliver scalable … high-performing data solutions that power analytics, reporting, and risk insights across the business. You’ll work closely with analysts, actuaries, and underwriters to build pipelines, models, and architectures that bring structure, speed, and accuracy to complex insurance data. This is a fantastic opportunity to make a real impact while shaping the future of data engineering … within a forward-thinking organisation. What You’ll Be Doing Partnering with analysts and product owners to turn business needs into scalable data solutions. Designing and maintaining robust data pipelines and models for analytics and reporting. Applying best practices in data architecture, security, and performance. Working with modern tools including Azure, Databricks, Python, Azure More ❯

Senior Data Engineer – Insurance Sector Location: Hybrid (London-based with flexible working) Salary: £85K -£100K – this is dependent on skills and experience Join a growing data team that’s transforming how the insurance industry uses data to make smarter, faster decisions. As a Senior Data Engineer , you’ll design and deliver scalable … high-performing data solutions that power analytics, reporting, and risk insights across the business. You’ll work closely with analysts, actuaries, and underwriters to build pipelines, models, and architectures that bring structure, speed, and accuracy to complex insurance data. This is a fantastic opportunity to make a real impact while shaping the future of data engineering … within a forward-thinking organisation. What You’ll Be Doing Partnering with analysts and product owners to turn business needs into scalable data solutions. Designing and maintaining robust data pipelines and models for analytics and reporting. Applying best practices in data architecture, security, and performance. Working with modern tools including Azure, Databricks, Python, Azure More ❯

Senior Data Engineer – Insurance Sector Location: Hybrid (London-based with flexible working) Salary: £85K -£100K – this is dependent on skills and experience Join a growing data team that’s transforming how the insurance industry uses data to make smarter, faster decisions. As a Senior Data Engineer , you’ll design and deliver scalable … high-performing data solutions that power analytics, reporting, and risk insights across the business. You’ll work closely with analysts, actuaries, and underwriters to build pipelines, models, and architectures that bring structure, speed, and accuracy to complex insurance data. This is a fantastic opportunity to make a real impact while shaping the future of data engineering … within a forward-thinking organisation. What You’ll Be Doing Partnering with analysts and product owners to turn business needs into scalable data solutions. Designing and maintaining robust data pipelines and models for analytics and reporting. Applying best practices in data architecture, security, and performance. Working with modern tools including Azure, Databricks, Python, Azure More ❯

Senior Data Engineer – Insurance Sector Location: Hybrid (London-based with flexible working) Salary: £85K -£100K – this is dependent on skills and experience Join a growing data team that’s transforming how the insurance industry uses data to make smarter, faster decisions. As a Senior Data Engineer , you’ll design and deliver scalable … high-performing data solutions that power analytics, reporting, and risk insights across the business. You’ll work closely with analysts, actuaries, and underwriters to build pipelines, models, and architectures that bring structure, speed, and accuracy to complex insurance data. This is a fantastic opportunity to make a real impact while shaping the future of data engineering … within a forward-thinking organisation. What You’ll Be Doing Partnering with analysts and product owners to turn business needs into scalable data solutions. Designing and maintaining robust data pipelines and models for analytics and reporting. Applying best practices in data architecture, security, and performance. Working with modern tools including Azure, Databricks, Python, Azure More ❯

has big plans for its team and the wider business. I am seeking an exceptional Engineering Manager within Analytics to lead high-performing teams at the crossroads of data engineering, analytics, and real-world business impact. This role offers the chance to shape the architecture, culture, and strategy of a modern analytics ecosystem , driving innovation, scalability, and measurable … different types of projects at one time and adaptable in leading teams and upskilling those around you. In this role, you will: Lead, mentor, and inspire analytics and data engineering teams, fostering technical excellence and a culture of innovation. Architect and optimise ELT pipelines and workflows using dbt, Airflow, SQL, and Python. Oversee the design and evolution of … are able to bring: Bring 5+ years of experience in analytics and data engineering, including proven leadership within technical teams. Demonstrate deep expertise in data pipeline architecture, schema design, and transformation frameworks. Have strong proficiency across cloud-based data platforms and scalable infrastructure. Excel at developing teams, driving process optimisation, and championing collaboration More ❯

has big plans for its team and the wider business. I am seeking an exceptional Engineering Manager within Analytics to lead high-performing teams at the crossroads of data engineering, analytics, and real-world business impact. This role offers the chance to shape the architecture, culture, and strategy of a modern analytics ecosystem , driving innovation, scalability, and measurable … different types of projects at one time and adaptable in leading teams and upskilling those around you. In this role, you will: Lead, mentor, and inspire analytics and data engineering teams, fostering technical excellence and a culture of innovation. Architect and optimise ELT pipelines and workflows using dbt, Airflow, SQL, and Python. Oversee the design and evolution of … are able to bring: Bring 5+ years of experience in analytics and data engineering, including proven leadership within technical teams. Demonstrate deep expertise in data pipeline architecture, schema design, and transformation frameworks. Have strong proficiency across cloud-based data platforms and scalable infrastructure. Excel at developing teams, driving process optimisation, and championing collaboration More ❯

has big plans for its team and the wider business. I am seeking an exceptional Engineering Manager within Analytics to lead high-performing teams at the crossroads of data engineering, analytics, and real-world business impact. This role offers the chance to shape the architecture, culture, and strategy of a modern analytics ecosystem , driving innovation, scalability, and measurable … different types of projects at one time and adaptable in leading teams and upskilling those around you. In this role, you will: Lead, mentor, and inspire analytics and data engineering teams, fostering technical excellence and a culture of innovation. Architect and optimise ELT pipelines and workflows using dbt, Airflow, SQL, and Python. Oversee the design and evolution of … are able to bring: Bring 5+ years of experience in analytics and data engineering, including proven leadership within technical teams. Demonstrate deep expertise in data pipeline architecture, schema design, and transformation frameworks. Have strong proficiency across cloud-based data platforms and scalable infrastructure. Excel at developing teams, driving process optimisation, and championing collaboration More ❯

has big plans for its team and the wider business. I am seeking an exceptional Engineering Manager within Analytics to lead high-performing teams at the crossroads of data engineering, analytics, and real-world business impact. This role offers the chance to shape the architecture, culture, and strategy of a modern analytics ecosystem , driving innovation, scalability, and measurable … different types of projects at one time and adaptable in leading teams and upskilling those around you. In this role, you will: Lead, mentor, and inspire analytics and data engineering teams, fostering technical excellence and a culture of innovation. Architect and optimise ELT pipelines and workflows using dbt, Airflow, SQL, and Python. Oversee the design and evolution of … are able to bring: Bring 5+ years of experience in analytics and data engineering, including proven leadership within technical teams. Demonstrate deep expertise in data pipeline architecture, schema design, and transformation frameworks. Have strong proficiency across cloud-based data platforms and scalable infrastructure. Excel at developing teams, driving process optimisation, and championing collaboration More ❯

Data QA Engineer We are seeking a QA Engineer with a strong background in data and analytics to help ensure the accuracy and reliability of both data pipelines and machine learning models . This role combines hands-on testing, automation, and close collaboration with engineering and data teams. About the Role You … ll take ownership of quality assurance for data pipelines; you’ll have a strong understanding of SQL to verify data consistency and accuracy. You’ll support with automated QA solutions for data pipelines and testing the outputs of ML models. Responsibilities Design, develop, and execute comprehensive test plans and test cases for data pipelines and ML models. Implement and maintain automated testing frameworks for data and ML quality assurance Perform thorough manual testing during initial development and complex feature releases Collaborate closely with Data Engineers, Data Scientists, and Product Managers Proactively identify, document, and track bugs and quality issues. Participate in code reviews and provide More ❯

Data QA Engineer We are seeking a QA Engineer with a strong background in data and analytics to help ensure the accuracy and reliability of both data pipelines and machine learning models . This role combines hands-on testing, automation, and close collaboration with engineering and data teams. About the Role You … ll take ownership of quality assurance for data pipelines; you’ll have a strong understanding of SQL to verify data consistency and accuracy. You’ll support with automated QA solutions for data pipelines and testing the outputs of ML models. Responsibilities Design, develop, and execute comprehensive test plans and test cases for data pipelines and ML models. Implement and maintain automated testing frameworks for data and ML quality assurance Perform thorough manual testing during initial development and complex feature releases Collaborate closely with Data Engineers, Data Scientists, and Product Managers Proactively identify, document, and track bugs and quality issues. Participate in code reviews and provide More ❯

Data QA Engineer We are seeking a QA Engineer with a strong background in data and analytics to help ensure the accuracy and reliability of both data pipelines and machine learning models . This role combines hands-on testing, automation, and close collaboration with engineering and data teams. About the Role You … ll take ownership of quality assurance for data pipelines; you’ll have a strong understanding of SQL to verify data consistency and accuracy. You’ll support with automated QA solutions for data pipelines and testing the outputs of ML models. Responsibilities Design, develop, and execute comprehensive test plans and test cases for data pipelines and ML models. Implement and maintain automated testing frameworks for data and ML quality assurance Perform thorough manual testing during initial development and complex feature releases Collaborate closely with Data Engineers, Data Scientists, and Product Managers Proactively identify, document, and track bugs and quality issues. Participate in code reviews and provide More ❯

Data QA Engineer We are seeking a QA Engineer with a strong background in data and analytics to help ensure the accuracy and reliability of both data pipelines and machine learning models . This role combines hands-on testing, automation, and close collaboration with engineering and data teams. About the Role You … ll take ownership of quality assurance for data pipelines; you’ll have a strong understanding of SQL to verify data consistency and accuracy. You’ll support with automated QA solutions for data pipelines and testing the outputs of ML models. Responsibilities Design, develop, and execute comprehensive test plans and test cases for data pipelines and ML models. Implement and maintain automated testing frameworks for data and ML quality assurance Perform thorough manual testing during initial development and complex feature releases Collaborate closely with Data Engineers, Data Scientists, and Product Managers Proactively identify, document, and track bugs and quality issues. Participate in code reviews and provide More ❯

Data Engineer | AI Startup | Real-Time Data & ML Pipelines I’m currently partnered with a next-generation AI startup that’s building real-time intelligence systems capable of understanding and adapting to the world as it happens. They’re at the forefront of streaming data, continuous learning, and large-scale inference - and they’re … now looking for a Data Engineer to help power that mission. This isn’t a maintenance role. It’s a build-it-from-the-ground-up opportunity in a company that’s solving genuinely hard, technical problems around real-time data pipelines and ML infrastructure . ⚙️ The Opportunity The team is looking for a Data Engineer who can design and scale real-time data architectures and machine learning pipelines that drive continuous model training and experimentation. You’ll be working in close collaboration with ML engineers, product leads, and platform teams to make sure the company’s AI models are learning, and improving, in production. 🧠 What You’ll Be Doing Architect More ❯

Data Engineer | AI Startup | Real-Time Data & ML Pipelines I’m currently partnered with a next-generation AI startup that’s building real-time intelligence systems capable of understanding and adapting to the world as it happens. They’re at the forefront of streaming data, continuous learning, and large-scale inference - and they’re … now looking for a Data Engineer to help power that mission. This isn’t a maintenance role. It’s a build-it-from-the-ground-up opportunity in a company that’s solving genuinely hard, technical problems around real-time data pipelines and ML infrastructure . ⚙️ The Opportunity The team is looking for a Data Engineer who can design and scale real-time data architectures and machine learning pipelines that drive continuous model training and experimentation. You’ll be working in close collaboration with ML engineers, product leads, and platform teams to make sure the company’s AI models are learning, and improving, in production. 🧠 What You’ll Be Doing Architect More ❯

Mid-Level Azure Data Engineer - Investment Management - London/Hybrid We're partnered with a small but forward-thinking Investment Management company in London that's continuing to evolve its data capabilities. They're now looking for a Mid-Level Azure Data Engineer to join a team of five engineers and analysts who are … driving the build and optimisation of a modern Azure-based data platform. This is a great opportunity for someone who enjoys working end-to-end across the data lifecycle and wants to have real influence in a close-knit, collaborative environment. You'll be working with the latest Azure technologies to help the business make smarter … data-driven decisions. What you'll be doing Building and maintaining data pipelines using Azure Data Factory , Databricks , and Synapse Analytics Supporting the design and development of a centralised data platform Working closely with analysts and business stakeholders to understand data needs Enhancing data quality, governance, and performance More ❯

DATA PRODUCT MANAGER - LONDON UP TO £100,000 THE COMPANY An opportunity to work with a market-leading AI SaaS business. THE ROLE The successful Data Product Manager responsibilities will include: Own the data product roadmap and articulate the vision for the data platform. Conduct discovery sessions to align on business and … technical priorities. Manage internal data projects with high customer impact. Oversee data model management and ensure alignment with quality and performance goals. Collaborate cross-functionally with PMs, Data Scientists, Engineers, and Designers. YOUR SKILLS AND EXPERIENCE The successful Data Product Manager will have the following skills and experience: Strong data and analytics background, comfortable discussing data architecture and ML workflows with engineers. Experience managing large-scale data platforms and high-volume data pipelines. Prior experience working in product companies (ideally SaaS, digital, or consumer tech). Strong understanding of product development lifecycle and agile processes. Excellent communication and presentation skills - able to More ❯

leading lenders, brokers, and financial institutions make smarter decisions with data. Our reporting and MI products are at the centre of that mission, delivering the dashboards, insights, and data quality our customers rely on every day. We're looking for a Senior Product Owner - Data & Reporting to drive efficient and effective delivery of our MI and … You'll work hand-in-hand with engineers and analysts to prioritise, scope, and deliver reporting features that meet customer and internal needs. With your strong background in data and MI, you'll ensure reporting requirements are clearly defined, data quality is assured, and delivery stays on track. This role is all about turning requirements into … analysts and engineers are working to clear goals and delivery milestones. Work closely with internal stakeholders (commercial, product, analytics) to refine requirements, manage expectations, and communicate progress. Oversee data validation and quality checks, ensuring delivered dashboards and reports are accurate and reliable. Support analysts and engineers by removing blockers, clarifying requirements, and making delivery decisions quickly. Track progress More ❯

Lead Data Scientist - Regulatory Scanning Initiative This is a unique opportunity to lead a high-impact team, mentor junior talent, and drive innovation in a fast-growing company. You'll work alongside industry experts, collaborate with cross-functional teams, and have the freedom to explore new technologies and methodologies. At Vixio, we're on a mission to revolutionize … how businesses manage regulatory obligations through cutting-edge RegTech solutions combined with our human expertise. Join us as our Lead Data Scientist and play a pivotal role in shaping the future of regulatory intelligence. About the role: As our Lead Data Scientist , you will play a pivotal role in shaping and delivering data-driven … solutions that power our regulatory scanning, analytics, and generative AI capabilities. You'll take ownership of complex data science problems end-to-end, from framing business challenges with stakeholders, to deploying production-ready solutions. We're looking for someone who thrives in fast-moving environments, takes initiative, and delivers measurable results. Working closely with the Head of Regulatory More ❯

Datadog, Miro, Webflow, and Facebook. Role Overview Synthesia is building a modern, AI-powered back office. We are hiring a full-stack engineer to design and run the data layer that powers Finance ensuring data from finance systems land securely in a data warehouse and is easily consumed via Copilot (LLM) and Omni dashboards. … ll be a cornerstone in our shift to modern finance workflows. Key Responsibilities Design, develop, and maintain robust ETL/ELT pipelines to ingest, transform, and securely store data from NetSuite and other finance systems into Snowflake, ensuring data integrity, compliance, and security best practices (e.g., encryption, access controls, and auditing). Collaborate with finance and … data teams to define data models, schemas, and governance policies that support modern finance workflows, including automated reporting, forecasting, and anomaly detection. Implement data retrieval mechanisms optimized for LLM-based querying via Co-pilot and/or similar tools, enabling natural language access to financial data while maintaining accuracy and contextual relevance. More ❯