351 to 375 of 873 Data Pipeline Jobs in London

Senior Data Engineer London (3 days in office) | Up to £70,000 + Bonus I’m working with an employee-owned media agency that’s looking for a Senior Data Engineer to take ownership of their data platform and lead a small team. The role focuses on building and optimising data pipelines … shaping cloud data architecture, and supporting the use of AI across the business. You’ll stay hands-on while mentoring junior engineers and helping develop the agency’s future data capability. What you’ll bring: Strong background in data engineering – Python, SQL, and cloud (GCP or Azure). Experience designing and managing data pipelines and warehouse solutions . Solid understanding of data architecture and integration . AdTech or MarTech experience would be a real advantage. Confident leading and developing junior engineers. This is a fantastic opportunity to take the lead on data engineering within a creative, fast-moving business that values innovation and ownership. N.B - Unfortunately Visa More ❯

Senior Data Engineer London (3 days in office) | Up to £70,000 + Bonus I’m working with an employee-owned media agency that’s looking for a Senior Data Engineer to take ownership of their data platform and lead a small team. The role focuses on building and optimising data pipelines … shaping cloud data architecture, and supporting the use of AI across the business. You’ll stay hands-on while mentoring junior engineers and helping develop the agency’s future data capability. What you’ll bring: Strong background in data engineering – Python, SQL, and cloud (GCP or Azure). Experience designing and managing data pipelines and warehouse solutions . Solid understanding of data architecture and integration . AdTech or MarTech experience would be a real advantage. Confident leading and developing junior engineers. This is a fantastic opportunity to take the lead on data engineering within a creative, fast-moving business that values innovation and ownership. N.B - Unfortunately Visa More ❯

Type: Full-time, Permanent Salary: Up to £106,000 (OTE) + Benefits About the Company Our client is a leading next-generation technology consultancy, accelerating digital transformation across data, AI, and cloud . They’ve built a market-leading reputation for helping global organisations develop high-performing data and technology teams while delivering scalable, innovative solutions. … They’re now expanding their advanced delivery function , a high-impact team working across industries to deliver complex data projects, develop new services, and drive technical excellence. The Opportunity We’re seeking a highly skilled Senior Data Engineer (Snowflake) to join this dynamic and growing team. This role offers the chance to lead data engineering delivery across a range of client projects, designing and optimising cloud-based data architectures, mentoring team members, and working closely with stakeholders to deliver high-quality, scalable solutions. You’ll work extensively with Snowflake , Python , and SQL , leveraging leading cloud technologies (AWS, Azure, or GCP) and best practices in CI/CD and automation . More ❯

Type: Full-time, Permanent Salary: Up to £106,000 (OTE) + Benefits About the Company Our client is a leading next-generation technology consultancy, accelerating digital transformation across data, AI, and cloud . They’ve built a market-leading reputation for helping global organisations develop high-performing data and technology teams while delivering scalable, innovative solutions. … They’re now expanding their advanced delivery function , a high-impact team working across industries to deliver complex data projects, develop new services, and drive technical excellence. The Opportunity We’re seeking a highly skilled Senior Data Engineer (Snowflake) to join this dynamic and growing team. This role offers the chance to lead data engineering delivery across a range of client projects, designing and optimising cloud-based data architectures, mentoring team members, and working closely with stakeholders to deliver high-quality, scalable solutions. You’ll work extensively with Snowflake , Python , and SQL , leveraging leading cloud technologies (AWS, Azure, or GCP) and best practices in CI/CD and automation . More ❯

Type: Full-time, Permanent Salary: Up to £106,000 (OTE) + Benefits About the Company Our client is a leading next-generation technology consultancy, accelerating digital transformation across data, AI, and cloud . They’ve built a market-leading reputation for helping global organisations develop high-performing data and technology teams while delivering scalable, innovative solutions. … They’re now expanding their advanced delivery function , a high-impact team working across industries to deliver complex data projects, develop new services, and drive technical excellence. The Opportunity We’re seeking a highly skilled Senior Data Engineer (Snowflake) to join this dynamic and growing team. This role offers the chance to lead data engineering delivery across a range of client projects, designing and optimising cloud-based data architectures, mentoring team members, and working closely with stakeholders to deliver high-quality, scalable solutions. You’ll work extensively with Snowflake , Python , and SQL , leveraging leading cloud technologies (AWS, Azure, or GCP) and best practices in CI/CD and automation . More ❯

Type: Full-time, Permanent Salary: Up to £106,000 (OTE) + Benefits About the Company Our client is a leading next-generation technology consultancy, accelerating digital transformation across data, AI, and cloud . They’ve built a market-leading reputation for helping global organisations develop high-performing data and technology teams while delivering scalable, innovative solutions. … They’re now expanding their advanced delivery function , a high-impact team working across industries to deliver complex data projects, develop new services, and drive technical excellence. The Opportunity We’re seeking a highly skilled Senior Data Engineer (Snowflake) to join this dynamic and growing team. This role offers the chance to lead data engineering delivery across a range of client projects, designing and optimising cloud-based data architectures, mentoring team members, and working closely with stakeholders to deliver high-quality, scalable solutions. You’ll work extensively with Snowflake , Python , and SQL , leveraging leading cloud technologies (AWS, Azure, or GCP) and best practices in CI/CD and automation . More ❯

Contract Data Engineer - Google Cloud | Scientific Data | Research-Focused Organisation London (2-3 days a week onsite) £750 per day (Inside IR35) | 6-month contract The Company Harnham is partnering with a leading research and technology organisation that's leveraging data and AI to accelerate scientific innovation. They're looking for an experienced Data Engineer to join on a 6-month contract and help build and optimise data pipelines supporting large-scale scientific and R&D initiatives. The Role You'll be responsible for designing, developing, and maintaining robust data pipelines on Google Cloud. Working closely with other engineers and scientists, you'll ensure the delivery of clean … scalable data solutions that power high-impact research. Key Responsibilities Build and maintain data pipelines using modern tools on Google Cloud, including Python, Spark, SQL, BigQuery, and Cloud Storage. Ensure data pipelines meet the analytical and scientific needs of key applications. Deliver high-quality, production-grade code with testing and documentation. Develop, measure, and More ❯

Senior Platform Engineer £500-£600 per day Outside IR35 6-months Join one of the UK's leading online retailers as they evolve their next-generation data platform. This is an opportunity to shape the backbone of a modern data ecosystem, empowering analysts, ML engineers, and data scientists to deliver smarter, faster insights at … scale. The Role You'll play a key role in designing and engineering platform services that treat data as a core product. This means building scalable, secure, and observable systems that help teams confidently leverage data across the business. You'll work closely with a wide range of technical and non-technical partners to deliver resilient … infrastructure, champion data governance, and mentor others in engineering excellence. In this role, you will: Shape the data platform roadmap: Introduce modern observability, quality, and governance frameworks that elevate how teams access and trust data. Build and scale infrastructure: Develop services, APIs, and data pipelines using modern cloud tooling and automation-first principles. Drive More ❯

Senior Platform Engineer £500-£600 per day Outside IR35 6-months Join one of the UK's leading online retailers as they evolve their next-generation data platform. This is an opportunity to shape the backbone of a modern data ecosystem, empowering analysts, ML engineers, and data scientists to deliver smarter, faster insights at … scale. The Role You'll play a key role in designing and engineering platform services that treat data as a core product. This means building scalable, secure, and observable systems that help teams confidently leverage data across the business. You'll work closely with a wide range of technical and non-technical partners to deliver resilient … infrastructure, champion data governance, and mentor others in engineering excellence. In this role, you will: Shape the data platform roadmap: Introduce modern observability, quality, and governance frameworks that elevate how teams access and trust data. Build and scale infrastructure: Develop services, APIs, and data pipelines using modern cloud tooling and automation-first principles. Drive More ❯

Data Engineering Lead - Summary A leading global construction firm is seeking a Data Engineering Lead to drive the evolution of its hybrid Azure/Databricks data platform. This role is central to building scalable, high-performance data solutions that bridge infrastructure and business intelligence. Key Responsibilities:* Design and maintain robust data pipelines for ingestion, transformation, and delivery* Leverage Azure, Databricks, and Azure Data Factory to integrate and enrich data from diverse sources* Implement orchestration, monitoring, and error-handling best practices* Optimize hybrid cloud architecture for performance, scalability, and cost-efficiency* Lead a team of BI Developers, ensuring timely delivery of dashboards and data products* Promote adoption of best practices and continuous learning within the team* Enforce data quality, governance, and security standards Technical Requirements:* Deep experience with Azure, SQL, Databricks, Azure Data Factory, and medallion architecture* Strong ETL design and hybrid cloud integration skills* Proficiency in Power BI and DAX for dashboard development* Solid understanding of KPI More ❯

Job Title: Data Consultants - Multiple Positions ranging from Junior to Senior Principal Location: London (Hybrid – Flexible working with client site travel required) Salary: Competitive, based on experience (from 1 year to Principal level) -Multiple positions required Clearance Requirement: Active SC or DV Clearance is essential About the Company Leading consultancy partner headquartered in London Rapidly growing with ambitious … expansion plans Collaborative and forward-thinking culture Focused on delivering data solutions that drive measurable business impact Role Overview Broad role spanning data science, engineering, analytics, and strategy Client-facing position with opportunities across diverse industries Design, implement, and optimize end-to-end data solutions Work on high-impact, dynamic projects with flexibility to … innovate Key Responsibilities Translate client challenges into actionable data solutions Develop and deploy scalable data pipelines and architectures Perform data analysis, modeling, and machine learning tasks Deliver actionable insights via reports, dashboards, and visualizations Advise on data governance, compliance, and best practices Collaborate across multidisciplinary teams to deliver project goals Keep pace More ❯

Job Title: Data Consultants - Multiple Positions ranging from Junior to Senior Principal Location: London (Hybrid – Flexible working with client site travel required) Salary: Competitive, based on experience (from 1 year to Principal level) -Multiple positions required Clearance Requirement: Active SC or DV Clearance is essential About the Company Leading consultancy partner headquartered in London Rapidly growing with ambitious … expansion plans Collaborative and forward-thinking culture Focused on delivering data solutions that drive measurable business impact Role Overview Broad role spanning data science, engineering, analytics, and strategy Client-facing position with opportunities across diverse industries Design, implement, and optimize end-to-end data solutions Work on high-impact, dynamic projects with flexibility to … innovate Key Responsibilities Translate client challenges into actionable data solutions Develop and deploy scalable data pipelines and architectures Perform data analysis, modeling, and machine learning tasks Deliver actionable insights via reports, dashboards, and visualizations Advise on data governance, compliance, and best practices Collaborate across multidisciplinary teams to deliver project goals Keep pace More ❯

Job Title: Data Consultants - Multiple Positions ranging from Junior to Senior Principal Location: London (Hybrid – Flexible working with client site travel required) Salary: Competitive, based on experience (from 1 year to Principal level) -Multiple positions required Clearance Requirement: Active SC or DV Clearance is essential About the Company Leading consultancy partner headquartered in London Rapidly growing with ambitious … expansion plans Collaborative and forward-thinking culture Focused on delivering data solutions that drive measurable business impact Role Overview Broad role spanning data science, engineering, analytics, and strategy Client-facing position with opportunities across diverse industries Design, implement, and optimize end-to-end data solutions Work on high-impact, dynamic projects with flexibility to … innovate Key Responsibilities Translate client challenges into actionable data solutions Develop and deploy scalable data pipelines and architectures Perform data analysis, modeling, and machine learning tasks Deliver actionable insights via reports, dashboards, and visualizations Advise on data governance, compliance, and best practices Collaborate across multidisciplinary teams to deliver project goals Keep pace More ❯

Job Title: Data Consultants - Multiple Positions ranging from Junior to Senior Principal Location: London (Hybrid – Flexible working with client site travel required) Salary: Competitive, based on experience (from 1 year to Principal level) -Multiple positions required Clearance Requirement: Active SC or DV Clearance is essential About the Company Leading consultancy partner headquartered in London Rapidly growing with ambitious … expansion plans Collaborative and forward-thinking culture Focused on delivering data solutions that drive measurable business impact Role Overview Broad role spanning data science, engineering, analytics, and strategy Client-facing position with opportunities across diverse industries Design, implement, and optimize end-to-end data solutions Work on high-impact, dynamic projects with flexibility to … innovate Key Responsibilities Translate client challenges into actionable data solutions Develop and deploy scalable data pipelines and architectures Perform data analysis, modeling, and machine learning tasks Deliver actionable insights via reports, dashboards, and visualizations Advise on data governance, compliance, and best practices Collaborate across multidisciplinary teams to deliver project goals Keep pace More ❯

Datasmoothie is a data analysis solution designed specifically for market researchers.They are part … of the Global Data Management Tower within Ipsos and their products offer an all-in-one solutions that helps users create and manage their data pipeline automating the process to assist in handling the full breadth of data processing and analysis tasks. This is a leadership role within the team building Promptly, our … revolutionary AI agent platform that is transforming market research. You will be at the forefront of innovation, shaping a product that allows researchers to analyze complex survey data instantly using natural language. As a senior Python developer, you will lead architecture and backend development, taking ownership of key features from concept to deployment. You will design and implement More ❯

Data Engineering Lead - Hybrid - Azure/Databricks - London Permanent Salary: £90,000 Are you a seasoned Data Engineering professional ready to lead the charge in building scalable, high-performance data platforms? An industry leading, global firm is seeking a Data Engineering Lead to drive innovation across their hybrid Azure/Databricks environment. … About the role: Shape data strategy for global projects Lead a talented team of BI Developers Enjoy a flexible working culture and industry-leading benefits Work with cutting-edge tech in a collaborative, inclusive environment Key Responsibilities: Architect and optimize robust data pipelines for large-scale ingestion, transformation, and delivery Leverage Azure and Databricks to enable … seamless data integration and enrichment Implement best practices for orchestration, monitoring, and error handling Lead and mentor a BI team, ensuring timely delivery of dashboards and data products Champion data governance, quality, and security across platforms Requirements: Proven expertise in Azure, SQL, Databricks, and Azure Data Factory Experience implementing medallion architecture frameworks More ❯

Senior Data Engineer with 5+ years’ experience, and 2+ years in a Hedge Fund and/or in Systematic Trading Technology, sought by one of the original Quantitative Hedge Funds, with a 20+ year track-record. The firm are renowned for a healthy, supportive, and collegiate working environment and culture, with no siloes, boasting an industry-leading staff … tenure. You will join a 5-strong Data Engineering team in a Senior Individual Contributor capacity, working directly with Quant Researchers, Portfolio Managers and Traders, and designing and engineering the ingestion, storage, transformation and distribution of tick, timeseries, reference and alternative datasets. The technology stack spanson-premise and cloud infrastructure with technologies and tooling such as Python, dbt … KDB+, Snowflake, SQL, interfacing with Market Data vendors such as Bloomberg, Refinitiv, Factset and MorningStar. This is an exciting time for you to join the team they consolidate our technology estate, revamp how they process and filter data, and overhaul the way data is accessed by their consumers, while continuing to onboard new datasets More ❯

Senior Data Engineer with 5+ years’ experience, and 2+ years in a Hedge Fund and/or in Systematic Trading Technology, sought by one of the original Quantitative Hedge Funds, with a 20+ year track-record. The firm are renowned for a healthy, supportive, and collegiate working environment and culture, with no siloes, boasting an industry-leading staff … tenure. You will join a 5-strong Data Engineering team in a Senior Individual Contributor capacity, working directly with Quant Researchers, Portfolio Managers and Traders, and designing and engineering the ingestion, storage, transformation and distribution of tick, timeseries, reference and alternative datasets. The technology stack spanson-premise and cloud infrastructure with technologies and tooling such as Python, dbt … KDB+, Snowflake, SQL, interfacing with Market Data vendors such as Bloomberg, Refinitiv, Factset and MorningStar. This is an exciting time for you to join the team they consolidate our technology estate, revamp how they process and filter data, and overhaul the way data is accessed by their consumers, while continuing to onboard new datasets More ❯

Senior Data Engineer with 5+ years’ experience, and 2+ years in a Hedge Fund and/or in Systematic Trading Technology, sought by one of the original Quantitative Hedge Funds, with a 20+ year track-record. The firm are renowned for a healthy, supportive, and collegiate working environment and culture, with no siloes, boasting an industry-leading staff … tenure. You will join a 5-strong Data Engineering team in a Senior Individual Contributor capacity, working directly with Quant Researchers, Portfolio Managers and Traders, and designing and engineering the ingestion, storage, transformation and distribution of tick, timeseries, reference and alternative datasets. The technology stack spanson-premise and cloud infrastructure with technologies and tooling such as Python, dbt … KDB+, Snowflake, SQL, interfacing with Market Data vendors such as Bloomberg, Refinitiv, Factset and MorningStar. This is an exciting time for you to join the team they consolidate our technology estate, revamp how they process and filter data, and overhaul the way data is accessed by their consumers, while continuing to onboard new datasets More ❯

Senior Data Engineer with 5+ years’ experience, and 2+ years in a Hedge Fund and/or in Systematic Trading Technology, sought by one of the original Quantitative Hedge Funds, with a 20+ year track-record. The firm are renowned for a healthy, supportive, and collegiate working environment and culture, with no siloes, boasting an industry-leading staff … tenure. You will join a 5-strong Data Engineering team in a Senior Individual Contributor capacity, working directly with Quant Researchers, Portfolio Managers and Traders, and designing and engineering the ingestion, storage, transformation and distribution of tick, timeseries, reference and alternative datasets. The technology stack spanson-premise and cloud infrastructure with technologies and tooling such as Python, dbt … KDB+, Snowflake, SQL, interfacing with Market Data vendors such as Bloomberg, Refinitiv, Factset and MorningStar. This is an exciting time for you to join the team they consolidate our technology estate, revamp how they process and filter data, and overhaul the way data is accessed by their consumers, while continuing to onboard new datasets More ❯

Lead Data Engineer £100,000 – £120,000 Hybrid – Surrey (1 day in office every fortnight) This is a high-impact Lead Data Engineer role, where you’ll work across a cutting-edge data stack (AWS, Databricks, Spark, dbt) to design scalable platforms and products that enable self-service analytics, advanced modelling, and AI-driven … decision-making. You’ll report into the Head of Data Engineering, supporting a team of engineers through mentorship, coaching, and technical guidance. The role is less about admin-style management and more about making engineers better — building capability, driving best practices, and acting as a foundational support. Key responsibilities include: Leading data engineering projects and managing … sub-teams Designing, optimising, and scaling data platforms in AWS/Databricks Driving coding standards, frameworks, and best practices Building and supporting modern data pipelines and products Coaching and mentoring engineers to raise technical excellence Partnering with product managers, data & AI engineers to deliver solutions to major business problems, including Generative AI applications What More ❯

onsite per week) Contract Type: Contract Duration: 6–12 months (possibility of extension) Start Date: ASAP Overview We are seeking an experienced Machine Learning Engineer to join our data science and AI engineering team on a contract basis in London. The ideal candidate will be responsible for designing, developing, and deploying machine learning models and scalable data … advanced analytics and intelligent automation initiatives. This role offers a hybrid work arrangement , combining flexibility with collaboration, and is ideal for a contractor who thrives in fast-paced, data-driven environments. Key Responsibilities Design, build, and deploy machine learning models and AI-driven solutions to address business challenges. Collaborate with data scientists to transition prototypes into … and deep learning architectures . Hands-on experience with MLOps tools and frameworks (e.g., MLflow, Kubeflow, SageMaker, Vertex AI). Experience with data engineering concepts — ETL pipelines, data lakes, and cloud data platforms. Proficiency with cloud services (AWS, Azure, or GCP) for model deployment and orchestration. Knowledge of containerization and orchestration tools (Docker, Kubernetes More ❯

onsite per week) Contract Type: Contract Duration: 6–12 months (possibility of extension) Start Date: ASAP Overview We are seeking an experienced Machine Learning Engineer to join our data science and AI engineering team on a contract basis in London. The ideal candidate will be responsible for designing, developing, and deploying machine learning models and scalable data … advanced analytics and intelligent automation initiatives. This role offers a hybrid work arrangement , combining flexibility with collaboration, and is ideal for a contractor who thrives in fast-paced, data-driven environments. Key Responsibilities Design, build, and deploy machine learning models and AI-driven solutions to address business challenges. Collaborate with data scientists to transition prototypes into … and deep learning architectures . Hands-on experience with MLOps tools and frameworks (e.g., MLflow, Kubeflow, SageMaker, Vertex AI). Experience with data engineering concepts — ETL pipelines, data lakes, and cloud data platforms. Proficiency with cloud services (AWS, Azure, or GCP) for model deployment and orchestration. Knowledge of containerization and orchestration tools (Docker, Kubernetes More ❯

onsite per week) Contract Type: Contract Duration: 6–12 months (possibility of extension) Start Date: ASAP Overview We are seeking an experienced Machine Learning Engineer to join our data science and AI engineering team on a contract basis in London. The ideal candidate will be responsible for designing, developing, and deploying machine learning models and scalable data … advanced analytics and intelligent automation initiatives. This role offers a hybrid work arrangement , combining flexibility with collaboration, and is ideal for a contractor who thrives in fast-paced, data-driven environments. Key Responsibilities Design, build, and deploy machine learning models and AI-driven solutions to address business challenges. Collaborate with data scientists to transition prototypes into … and deep learning architectures . Hands-on experience with MLOps tools and frameworks (e.g., MLflow, Kubeflow, SageMaker, Vertex AI). Experience with data engineering concepts — ETL pipelines, data lakes, and cloud data platforms. Proficiency with cloud services (AWS, Azure, or GCP) for model deployment and orchestration. Knowledge of containerization and orchestration tools (Docker, Kubernetes More ❯

onsite per week) Contract Type: Contract Duration: 6–12 months (possibility of extension) Start Date: ASAP Overview We are seeking an experienced Machine Learning Engineer to join our data science and AI engineering team on a contract basis in London. The ideal candidate will be responsible for designing, developing, and deploying machine learning models and scalable data … advanced analytics and intelligent automation initiatives. This role offers a hybrid work arrangement , combining flexibility with collaboration, and is ideal for a contractor who thrives in fast-paced, data-driven environments. Key Responsibilities Design, build, and deploy machine learning models and AI-driven solutions to address business challenges. Collaborate with data scientists to transition prototypes into … and deep learning architectures . Hands-on experience with MLOps tools and frameworks (e.g., MLflow, Kubeflow, SageMaker, Vertex AI). Experience with data engineering concepts — ETL pipelines, data lakes, and cloud data platforms. Proficiency with cloud services (AWS, Azure, or GCP) for model deployment and orchestration. Knowledge of containerization and orchestration tools (Docker, Kubernetes More ❯