376 to 400 of 873 Data Pipeline Jobs in London

Senior Data Engineer - Hybrid - Contract - Outside IR35 Our client is expanding their core data engineering function and hiring two Senior Data Engineers to strengthen a modern, scalable data platform. Both will be Databricks specialists, with one role focused on deep technical delivery and the other combining hands-on engineering with team leadership … Tables (DLT) pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and … deployments. (For leadership-focused role) Mentor and upskill engineers, define coding standards, and embed engineering excellence across the team. What’s Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and More ❯

Senior Data Engineer - Hybrid - Contract - Outside IR35 Our client is expanding their core data engineering function and hiring two Senior Data Engineers to strengthen a modern, scalable data platform. Both will be Databricks specialists, with one role focused on deep technical delivery and the other combining hands-on engineering with team leadership … Tables (DLT) pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and … deployments. (For leadership-focused role) Mentor and upskill engineers, define coding standards, and embed engineering excellence across the team. What’s Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and More ❯

Senior Data Engineer - Hybrid - Contract - Outside IR35 Our client is expanding their core data engineering function and hiring two Senior Data Engineers to strengthen a modern, scalable data platform. Both will be Databricks specialists, with one role focused on deep technical delivery and the other combining hands-on engineering with team leadership … Tables (DLT) pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and … deployments. (For leadership-focused role) Mentor and upskill engineers, define coding standards, and embed engineering excellence across the team. What’s Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and More ❯

Senior Data Engineer - Hybrid - Contract - Outside IR35 Our client is expanding their core data engineering function and hiring two Senior Data Engineers to strengthen a modern, scalable data platform. Both will be Databricks specialists, with one role focused on deep technical delivery and the other combining hands-on engineering with team leadership … Tables (DLT) pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and … deployments. (For leadership-focused role) Mentor and upskill engineers, define coding standards, and embed engineering excellence across the team. What’s Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and More ❯

We believe in better. And we make it happen. Better content. Better products. And better careers. Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise and innovate. We turn big ideas into the products … Machine Learning Engineer to advance our personalised recommendation systems by developing efficient, low-latency solutions that serve millions of users globally. The successful candidate will collaborate closely with data scientists, engineers, and product managers to design intelligent content recommendation mechanisms and drive the ongoing advancement of our … Machine Learning Platform. Model Development: Design, train, and optimise machine learning models focused on user personalisation, encompassing recommendation engines, ranking algorithms, user segmentation, and content analysis. Data Pipeline Engineering: Construct and maintain robust and scalable data pipelines for feature engineering and model training utilising both structured and unstructured large-scale datasets. Production Deployment: Deploy and More ❯

We believe in better. And we make it happen. Better content. Better products. And better careers. Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise and innovate. We turn big ideas into the products … Machine Learning Engineer to advance our personalised recommendation systems by developing efficient, low-latency solutions that serve millions of users globally. The successful candidate will collaborate closely with data scientists, engineers, and product managers to design intelligent content recommendation mechanisms and drive the ongoing advancement of our … Machine Learning Platform. Model Development: Design, train, and optimise machine learning models focused on user personalisation, encompassing recommendation engines, ranking algorithms, user segmentation, and content analysis. Data Pipeline Engineering: Construct and maintain robust and scalable data pipelines for feature engineering and model training utilising both structured and unstructured large-scale datasets. Production Deployment: Deploy and More ❯

We believe in better. And we make it happen. Better content. Better products. And better careers. Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise and innovate. We turn big ideas into the products … Machine Learning Engineer to advance our personalised recommendation systems by developing efficient, low-latency solutions that serve millions of users globally. The successful candidate will collaborate closely with data scientists, engineers, and product managers to design intelligent content recommendation mechanisms and drive the ongoing advancement of our … Machine Learning Platform. Model Development: Design, train, and optimise machine learning models focused on user personalisation, encompassing recommendation engines, ranking algorithms, user segmentation, and content analysis. Data Pipeline Engineering: Construct and maintain robust and scalable data pipelines for feature engineering and model training utilising both structured and unstructured large-scale datasets. Production Deployment: Deploy and More ❯

to help the engineering team refactor the ‘research-level’ code into production-ready code. You will be responsible for expanding and optimizing our cloud infrastructure and data pipeline architecture, as well as optimising data flow and collection throughout our custom-built Clinical Management Interface (CMI). You will work closely with the Data … seamless integration with their pipelines and clearly document all your work. Essential requirements: - Minimum 3 years professional software development experience - Expert proficiency in Python in software development and data science/processing - Strong working knowledge of R - Proven experience in refactoring "research-level" code into production-ready software - Proven experience of collaborating effectively in cross-functional team environment More ❯

to help the engineering team refactor the ‘research-level’ code into production-ready code. You will be responsible for expanding and optimizing our cloud infrastructure and data pipeline architecture, as well as optimising data flow and collection throughout our custom-built Clinical Management Interface (CMI). You will work closely with the Data … seamless integration with their pipelines and clearly document all your work. Essential requirements: - Minimum 3 years professional software development experience - Expert proficiency in Python in software development and data science/processing - Strong working knowledge of R - Proven experience in refactoring "research-level" code into production-ready software - Proven experience of collaborating effectively in cross-functional team environment More ❯

Lead Data Engineer Salary: £90,000 - £115,000 Location: West London (3 Days in Office) Using data science at their core, they transform complex property and customer data into insights that enhance targeting, retention, and performance. The Opportunity This flexible, data-driven start-up places Data Science at the heart … of its business, using cutting-edge UK property data to deliver powerful insights for real estate partners and retailers. By leveraging advanced analytics, predictive modelling, and customer segmentation, the company helps clients better understand and engage with their audiences, improving marketing precision, timing, and overall performance. With a strong technical foundation and a collaborative team led by experienced … data leaders, the company is building efficient, automated data pipelines and scalable systems to power intelligent decision-making. This is an exciting opportunity for forward-thinking professionals to join a growing team, shape best practices, and make a real impact in a fast-evolving data and technology environment. The Role and Responsibilities This is More ❯

The Finance Systems & IT Support Analyst acts as the dedicated technical specialist for all Finance-related systems, providing expert-level support, system administration, and data management across platforms such as Microsoft Dynamics, SQL Server, Visual Studio, Power Bi, Metabase and associated tools. In addition to Finance systems expertise, this role provides general IT function, contributing to the stability … ensuring smooth operation and timely issue resolution. Support and administer Microsoft Dynamics, Evision and related financial applications. Develop and maintain SQL scripts, queries, and reports to support Finance data analysis and system integrations. Manage data pipelines and transformations using DBT and other tools to ensure data accuracy and integrity. Maintain and optimise Metabase dashboards … reports) Proficient in SQL for query writing, data manipulation, and reporting. Working knowledge of Metabase and Power BI. Experience with DBT for data transformation and pipeline management. Excellent troubleshooting, communication, and documentation skills. Desirable: Exposure to ERP or finance system integrations and data warehousing concepts. Experience supporting or developing APIs or data More ❯

The Finance Systems & IT Support Analyst acts as the dedicated technical specialist for all Finance-related systems, providing expert-level support, system administration, and data management across platforms such as Microsoft Dynamics, SQL Server, Visual Studio, Power Bi, Metabase and associated tools. In addition to Finance systems expertise, this role provides general IT function, contributing to the stability … ensuring smooth operation and timely issue resolution. Support and administer Microsoft Dynamics, Evision and related financial applications. Develop and maintain SQL scripts, queries, and reports to support Finance data analysis and system integrations. Manage data pipelines and transformations using DBT and other tools to ensure data accuracy and integrity. Maintain and optimise Metabase dashboards … reports) Proficient in SQL for query writing, data manipulation, and reporting. Working knowledge of Metabase and Power BI. Experience with DBT for data transformation and pipeline management. Excellent troubleshooting, communication, and documentation skills. Desirable: Exposure to ERP or finance system integrations and data warehousing concepts. Experience supporting or developing APIs or data More ❯

Data & Insight Engineer Salary: £55,000-£60,000 + Share Options + Biannual Bonus Location: Central London (3 days in office) About the Company/Role Fast-growing food-tech scale-up founded by leaders from high-growth consumer brands. They work with and scale independent food brands using data to identify demand, optimise locations, and … support brand expansion through a proprietary tech platform. The Data & Insight Engineer will report to the Head of Analytics and work cross-functionally across data, engineering, and marketing teams to enhance data infrastructure and insight delivery. Role and Responsibilities Build and maintain reliable data pipelines using GCP and orchestration tools. Automate data processes and improve accessibility across the business. Collaborate with marketing and operations to translate data into actionable insight. Support analytics projects focused on brand performance, customer engagement, and operational efficiency. Contribute to ongoing platform development and performance tracking. Skills and Experience Required 2+ years’ experience in data or analytics engineering. Strong SQL and Python More ❯

Data & Insight Engineer Salary: £55,000-£60,000 + Share Options + Biannual Bonus Location: Central London (3 days in office) About the Company/Role Fast-growing food-tech scale-up founded by leaders from high-growth consumer brands. They work with and scale independent food brands using data to identify demand, optimise locations, and … support brand expansion through a proprietary tech platform. The Data & Insight Engineer will report to the Head of Analytics and work cross-functionally across data, engineering, and marketing teams to enhance data infrastructure and insight delivery. Role and Responsibilities Build and maintain reliable data pipelines using GCP and orchestration tools. Automate data processes and improve accessibility across the business. Collaborate with marketing and operations to translate data into actionable insight. Support analytics projects focused on brand performance, customer engagement, and operational efficiency. Contribute to ongoing platform development and performance tracking. Skills and Experience Required 2+ years’ experience in data or analytics engineering. Strong SQL and Python More ❯

Data & Insight Engineer Salary: £55,000-£60,000 + Share Options + Biannual Bonus Location: Central London (3 days in office) About the Company/Role Fast-growing food-tech scale-up founded by leaders from high-growth consumer brands. They work with and scale independent food brands using data to identify demand, optimise locations, and … support brand expansion through a proprietary tech platform. The Data & Insight Engineer will report to the Head of Analytics and work cross-functionally across data, engineering, and marketing teams to enhance data infrastructure and insight delivery. Role and Responsibilities Build and maintain reliable data pipelines using GCP and orchestration tools. Automate data processes and improve accessibility across the business. Collaborate with marketing and operations to translate data into actionable insight. Support analytics projects focused on brand performance, customer engagement, and operational efficiency. Contribute to ongoing platform development and performance tracking. Skills and Experience Required 2+ years’ experience in data or analytics engineering. Strong SQL and Python More ❯

Data & Insight Engineer Salary: £55,000-£60,000 + Share Options + Biannual Bonus Location: Central London (3 days in office) About the Company/Role Fast-growing food-tech scale-up founded by leaders from high-growth consumer brands. They work with and scale independent food brands using data to identify demand, optimise locations, and … support brand expansion through a proprietary tech platform. The Data & Insight Engineer will report to the Head of Analytics and work cross-functionally across data, engineering, and marketing teams to enhance data infrastructure and insight delivery. Role and Responsibilities Build and maintain reliable data pipelines using GCP and orchestration tools. Automate data processes and improve accessibility across the business. Collaborate with marketing and operations to translate data into actionable insight. Support analytics projects focused on brand performance, customer engagement, and operational efficiency. Contribute to ongoing platform development and performance tracking. Skills and Experience Required 2+ years’ experience in data or analytics engineering. Strong SQL and Python More ❯

Areti is currently seeking five Senior Data Scientists/Analysts to join one of the UK’s fastest-growing Series A-funded tech startups based in London . This is an exciting opportunity to be part of a dynamic, mission-driven company working on high-impact Defence and Government projects. Extensive training provided – including Palantir – making this a … career-defining role . 🌳🌳🌳 The Role: You will work within a tight-knit, agile team tackling real-world problems using cutting-edge data science and engineering techniques. Key Responsibilities: Develop and deploy machine learning models Solve complex data problems in a big data environment Build scalable data pipelines and APIs Ideal Candidate … Will Have: Previous experience as a Data Scientist or Data Engineer Strong command of Python (including libraries such as scikit-learn, NumPy, matplotlib) Experience in deep learning frameworks such as TensorFlow or PyTorch Knowledge of SQL and relational databases; experience with Big Data environments Familiarity with API development and NoSQL databases Understanding of CI More ❯

Areti is currently seeking five Senior Data Scientists/Analysts to join one of the UK’s fastest-growing Series A-funded tech startups based in London . This is an exciting opportunity to be part of a dynamic, mission-driven company working on high-impact Defence and Government projects. Extensive training provided – including Palantir – making this a … career-defining role . 🌳🌳🌳 The Role: You will work within a tight-knit, agile team tackling real-world problems using cutting-edge data science and engineering techniques. Key Responsibilities: Develop and deploy machine learning models Solve complex data problems in a big data environment Build scalable data pipelines and APIs Ideal Candidate … Will Have: Previous experience as a Data Scientist or Data Engineer Strong command of Python (including libraries such as scikit-learn, NumPy, matplotlib) Experience in deep learning frameworks such as TensorFlow or PyTorch Knowledge of SQL and relational databases; experience with Big Data environments Familiarity with API development and NoSQL databases Understanding of CI More ❯

Areti is currently seeking five Senior Data Scientists/Analysts to join one of the UK’s fastest-growing Series A-funded tech startups based in London . This is an exciting opportunity to be part of a dynamic, mission-driven company working on high-impact Defence and Government projects. Extensive training provided – including Palantir – making this a … career-defining role . 🌳🌳🌳 The Role: You will work within a tight-knit, agile team tackling real-world problems using cutting-edge data science and engineering techniques. Key Responsibilities: Develop and deploy machine learning models Solve complex data problems in a big data environment Build scalable data pipelines and APIs Ideal Candidate … Will Have: Previous experience as a Data Scientist or Data Engineer Strong command of Python (including libraries such as scikit-learn, NumPy, matplotlib) Experience in deep learning frameworks such as TensorFlow or PyTorch Knowledge of SQL and relational databases; experience with Big Data environments Familiarity with API development and NoSQL databases Understanding of CI More ❯

Areti is currently seeking five Senior Data Scientists/Analysts to join one of the UK’s fastest-growing Series A-funded tech startups based in London . This is an exciting opportunity to be part of a dynamic, mission-driven company working on high-impact Defence and Government projects. Extensive training provided – including Palantir – making this a … career-defining role . 🌳🌳🌳 The Role: You will work within a tight-knit, agile team tackling real-world problems using cutting-edge data science and engineering techniques. Key Responsibilities: Develop and deploy machine learning models Solve complex data problems in a big data environment Build scalable data pipelines and APIs Ideal Candidate … Will Have: Previous experience as a Data Scientist or Data Engineer Strong command of Python (including libraries such as scikit-learn, NumPy, matplotlib) Experience in deep learning frameworks such as TensorFlow or PyTorch Knowledge of SQL and relational databases; experience with Big Data environments Familiarity with API development and NoSQL databases Understanding of CI More ❯

/DevOps/MLOps capability to develop, productionise, and scale systematic investment models and sustainability analytics. You will own the end to end research to production lifecycle : automating data operations, building and validating quant models, and integrating them into scalable platforms, while providing timely responses to internal and external client queries. The role is a key contributor to …/robustness analysis; implement model risk controls , documentation, and reproducibility. Scale and commercialise proprietary metrics for investment use‐cases and new revenue lines (e.g., indices, APIs/subscriptions, data products). 2) Data Operations & Quality Control (Automation‐First) Work with systematic team and IT to automate ingestion, validation, and monitoring of 30+ multi‐vendor datasets (schema … evolution, mapping, entity resolution, referential integrity, SLA oversight). Run impact analysis of data changes on models and reporting; manage deployment pipelines and data lineage/audit trails ; support data procurement and budgeting. 3) Platform Development & Process Management Co-develop with systematic team and IT a scalable data/quant architecture (data More ❯

Azure Monitor, DataDog, or Dynatrace Preferred experience supporting Salesforce DevOps pipelines and working with Java, .NET, or Node.js application environments Exposure to AI/ML platforms, real-time data pipelines, and basic networking (TCP/IP, DNS, firewalls, load balancing) Relevant certifications such as Certified Kubernetes Administrator (CKA), Microsoft AZ-400, or HashiCorp Terraform Associate are advantageous Strong More ❯

Azure Monitor, DataDog, or Dynatrace Preferred experience supporting Salesforce DevOps pipelines and working with Java, .NET, or Node.js application environments Exposure to AI/ML platforms, real-time data pipelines, and basic networking (TCP/IP, DNS, firewalls, load balancing) Relevant certifications such as Certified Kubernetes Administrator (CKA), Microsoft AZ-400, or HashiCorp Terraform Associate are advantageous Strong More ❯

speedy, and of high quality. Architect, develop, and maintain core components of our SaaS platform: Backend: Python, PostgreSQL Frontend: TypeScript, NextJS/NodeJS Integrate AI tools, APIs, and data pipelines to enhance platform intelligence. Promote engineering best practices such as testing, CI/CD, and secure coding standards. Conduct code reviews and provide technical mentorship. Collaborate with the More ❯

in providing a seamless recruitment experience for clients and candidates, fostering innovation and professional growth. Our client is an established fintech scale-up transforming how digital platforms use data to support smarter financial decisions. They’ve grown rapidly across the UK, Europe, and North America, with backing from a respected investment group. Their culture is data … We’re looking for a Senior Analytics Engineer to help build and evolve a world-class analytics environment. You’ll take ownership of designing, developing, and maintaining scalable data pipelines and models that power decision-making across multiple business areas. This is a hands-on technical role where you’ll bridge data engineering and analytics, working … closely with teams in product, finance, and technology to translate complex business questions into accessible, trustworthy datasets and visualisations. What You’ll Do Build and optimise robust data models in SQL and dbt Develop automated data pipelines and ensure strong data governance standards Partner with analysts, product managers, and engineers to develop data More ❯