126 to 150 of 280 Data Pipeline Jobs in Central London

Senior Data Engineer - Azure, Healthcare A Global Healthcare Leader based in Burton Upon Trent is currently searching for a Senior Data Engineer to help support a greenfield implementation of Databricks and further support the advancement of their modern data platform. The successful applicant will work closely with the Director of Analytics and Strategic Data Manager and be responsible for implementing data pipelines in Azure Data Factory and Azyre Databricks, supporting Darewhaoure implementation and ETL process. Location: Hybrid in London Salary: £55,000 to £65,000 + Benefits To be considered: Minimum 3 years of experience working as a Data Engineer within an Azure Environment. Prior experience More ❯

Senior Data Engineer - Azure, Healthcare A Global Healthcare Leader based in Burton Upon Trent is currently searching for a Senior Data Engineer to help support a greenfield implementation of Databricks and further support the advancement of their modern data platform. The successful applicant will work closely with the Director of Analytics and Strategic Data Manager and be responsible for implementing data pipelines in Azure Data Factory and Azyre Databricks, supporting Darewhaoure implementation and ETL process. Location: Hybrid in London Salary: £55,000 to £65,000 + Benefits To be considered: Minimum 3 years of experience working as a Data Engineer within an Azure Environment. Prior experience More ❯

Senior Data Engineer (SQL BigQuery GCP) London/WFH to £110,000 Are you a data technologist with Media Streaming experience? You could be progressing your career in a senor, hands-on role at one of Europe's most successful streaming and social media platforms. What's in it for you: Salary to £110k Employee stock … time if desired (x1 month in London) A sociable office environment with free snacks, drinks and lunch if you are in the office Your role: As a Senior Data Engineer you'll design, build and maintain high-performance services for content modelling, serving and integration, develop data pipelines (both batch and streaming) using cloud native tools … and collaborate on rearchitecting the content model to support rich metadata. You'll also build and implement APIs and data services to expose the data to other teams across the business and work with IaC (Terraform) and CI/CD pipelines for deployment and automation. Location/WFH: You'll be able to work from home More ❯

Lead Data Engineer (Azure Stack) £95k + 10% bonus Hybrid – 1 day a week Central London I’m helping a growing fintech find their next Lead Data Engineer, they are looking for someone who loves building modern data platforms in Azure and wants to make a genuine impact. This role offers the best of … by allowing you to lead from the front while staying hands-on with the tech. You’ll shape the architecture, mentor the team, and help drive a modern, data-driven culture all within a collaborative environment that values innovation and ownership. Tech you’ll be working with: Azure Data Lake Azure Synapse Databricks Data Factory Python, SQL, PySpark Terraform, GitHub Actions, CI/CD pipelines You’ll thrive here if you: Have strong experience building and leading Azure-based data platforms Enjoy mentoring and guiding other engineers Love designing scalable, automated data pipelines Bring a hands-on approach and enjoy problem-solving Want to shape data More ❯

Lead Data Engineer (Azure Stack) £95k + 10% bonus Hybrid – 1 day a week Central London I’m helping a growing fintech find their next Lead Data Engineer, they are looking for someone who loves building modern data platforms in Azure and wants to make a genuine impact. This role offers the best of … by allowing you to lead from the front while staying hands-on with the tech. You’ll shape the architecture, mentor the team, and help drive a modern, data-driven culture all within a collaborative environment that values innovation and ownership. Tech you’ll be working with: Azure Data Lake Azure Synapse Databricks Data Factory Python, SQL, PySpark Terraform, GitHub Actions, CI/CD pipelines You’ll thrive here if you: Have strong experience building and leading Azure-based data platforms Enjoy mentoring and guiding other engineers Love designing scalable, automated data pipelines Bring a hands-on approach and enjoy problem-solving Want to shape data More ❯

Data Engineer – MGA (Greenfield Build) Location: London (Hybrid – typically 1–2 days per month in office) Package: £85k base + 15% bonus The Opportunity Our Client is building a brand-new data platform from the ground up for a fast-growing, tech-first insurer. You’ll be joining a small but ambitious team and will play … a pivotal role in shaping their entire data landscape, from infrastructure and pipelines to reporting and future data science initiatives. The … roadmap includes: Building sophisticated reporting solutions for the business Productionising algorithms into scalable reporting systems Laying the foundations for data science and ML initiatives already in the pipeline Key Responsibilities Design, test, and deploy robust data pipelines for ingestion, transformation, and integration Build out scalable lakehouse architecture with Databricks Partner with analytics and business teams More ❯

Senior Data Engineer | Systematic Trading A Top-tier quant fund is hiring a Senior Data Engineer to help architect and scale a global Data Lakehouse that feeds directly into live trading strategies. If you’ve already been building data infrastructure inside a hedge fund or HFT shop, you’ll know what this … role really means: low-latency, high-availability, globally distributed data pipelines that quant teams trust every day. This is your chance to level up from patching legacy pipelines to building the core platform used by quant researchers and traders across desks and regions. What You’ll Be Driving Architect and build a global Lakehouse platform (Data Lake + OLAP) in AWS Develop scalable data pipelines in Python , working with SDKs and data libs Own end-to-end data modeling , ingestion, validation, and optimization for high-concurrency access Tune performance of cross-region, multi-format data stores (columnar, real-time, etc.) Deliver tailored solutions directly to quants More ❯

TensorFlow, or similar). Interest in AI-driven automation, predictive analytics , and intelligent risk modelling . Experience with Rust , WebAssembly , or cross-runtime architectures . Solid grounding in data pipelines, APIs, and distributed messaging systems (Kafka, ZeroMQ, etc.). Why Apply This is a flagship product being rolled out across the bank’s global capital markets division — you More ❯

Senior Data Engineer - Python, SQL, Airflow, BigQuery, DBT, GCP I've partnered with a high growth Product led tech company based in Central London, who are expanding their Data function, and are looking for a highly skilled, Senior Data Engineer to join their team. In this role, you'll be reporting directly to the … Head of Engineering, where the Infrastructure and Data Platform will be the focus, building robust and highly scalable Data Pipelines, whilst working with stakeholders across the business, to help make data driven decisions. Senior Data Engineer - Python, SQL, Airflow, BigQuery, DBT, GCP Key skills and experience required: 4+ years of experience in … Data Engineering Python & SQL GCP BigQuery Airflow DBT Familiarity with Data Ingestion (ideally in a SaaS context) Product mindset This role is a hybrid role with 3-days a week required in Central London offices Base salary of £75k-£100k depending on skills and experience Bonus + excellent benefits package included Apply for more information! Senior More ❯

Forward Deployed Engineer – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions using Palantir Foundry? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you. Morela is proud to partner one of the fasted growing … consultancies in Europe, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled Forward Deployed Engineer to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects. You'll be part of a … operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a Forward Deployed Engineer, you'll play a crucial role in designing and implementing data solutions that empower clients to make informed decisions. Core Responsibilities More ❯

Forward Deployed Engineer – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions using Palantir Foundry? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you. Morela is proud to partner one of the fasted growing … consultancies in Europe, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled Forward Deployed Engineer to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects. You'll be part of a … operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a Forward Deployed Engineer, you'll play a crucial role in designing and implementing data solutions that empower clients to make informed decisions. Core Responsibilities More ❯

you will do 🚀 Build fundamental models for education - solving the ultimate learning task of predicting student knowledge and optimal ‘next task’ Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable to any context - right now it’s … the English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather … models based on these results Optimise and fine-tune machine learning models for performance, scalability, and accuracy Essential skills 🙏 Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Experience working with entire ML systems and data pipelines in large-scale production systems Experience building automated data More ❯

you will do 🚀 Build fundamental models for education - solving the ultimate learning task of predicting student knowledge and optimal ‘next task’ Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable to any context - right now it’s … the English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather … models based on these results Optimise and fine-tune machine learning models for performance, scalability, and accuracy Essential skills 🙏 Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Experience working with entire ML systems and data pipelines in large-scale production systems Experience building automated data More ❯

Data Engineer | 3-month Contract | Outside IR35 | £500 p/d | Python, SQL, AWS, Snowflake, BigQuery | Hybrid (London) OB are partnered with a leading technology-driven business who are looking for a Data Engineer to join their Data team. This is a great opportunity to work in a high-impact, data-focused … environment where you’ll contribute to the design, build, and optimisation of modern data pipelines supporting analytics and machine learning initiatives. Key Skills: Strong experience with Python (Pandas or Spark) and SQL. Experience with AWS/GCP, BigQuery, Airflow, Snowflake, Redshift. Must have strong data warehousing experience. Key Info: Outside IR35 £500 p/d Hybrid … in Central London ASAP start 3-month contract Data Engineer | 3-month Contract | Outside IR35 | £500 p/d | Python, SQL, AWS, Snowflake, BigQuery | Hybrid (London More ❯

setup, including nodes, networks, and security frameworks. Deep understanding of cryptography, hashing algorithms, digital signatures, and encryption techniques. Knowledge of integration with enterprise systems, APIs, cloud services, and data pipelines. Hands-on experience with DevOps, containerization, CI/CD pipelines, and cloud platforms (AWS, Azure, GCP) for blockchain deployment. Strong experience in solution architecture, technical leadership, and mentoring More ❯

setup, including nodes, networks, and security frameworks. Deep understanding of cryptography, hashing algorithms, digital signatures, and encryption techniques. Knowledge of integration with enterprise systems, APIs, cloud services, and data pipelines. Hands-on experience with DevOps, containerization, CI/CD pipelines, and cloud platforms (AWS, Azure, GCP) for blockchain deployment. Strong experience in solution architecture, technical leadership, and mentoring More ❯

setup, including nodes, networks, and security frameworks. Deep understanding of cryptography, hashing algorithms, digital signatures, and encryption techniques. Knowledge of integration with enterprise systems, APIs, cloud services, and data pipelines. Hands-on experience with DevOps, containerization, CI/CD pipelines, and cloud platforms (AWS, Azure, GCP) for blockchain deployment. Strong experience in solution architecture, technical leadership, and mentoring More ❯

you will do 🚀 Build fundamental models for education - solving the ultimate learning task of predicting student knowledge and optimal ‘next task’ Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable to any context - right now it’s … the English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather … meet-up in London, building a network of ML specialists Essential skills 🙏 Experience leading and mentoring other ML engineers Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Experience taking complete ownership of entire ML systems and data pipelines in large-scale production systems Experience building automated More ❯

you will do 🚀 Build fundamental models for education - solving the ultimate learning task of predicting student knowledge and optimal ‘next task’ Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable to any context - right now it’s … the English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather … meet-up in London, building a network of ML specialists Essential skills 🙏 Experience leading and mentoring other ML engineers Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Experience taking complete ownership of entire ML systems and data pipelines in large-scale production systems Experience building automated More ❯

Data Engineer Must be London-based, able to work from site in London with occasional travel to Croydon SC Clearance required/or eligible for clearance Contract duration: 2 years + Up To £41,000 per annum, depending on experience Job Purpose/The Role: We are seeking 3 experienced Data Engineers to support a high … Public Sector client. These roles will be part of a large project, contributing to the ongoing development and live support of critical systems within a secure, agile, and data-driven environment. Your Key Responsibilities: Work collaboratively in a multi-disciplinary Agile & DevOps team to deliver data solutions and maintain live systems. Apply best practices for data integration, transformation, and delivery in a secure and scalable environment. Support data pipelines and ETL processes across various technologies and cloud platforms Maintain, monitor, and troubleshoot systems using a wide array of tools and platforms. Contribute to automation and continuous integration/deployment (CI/CD) efforts. Engage directly with clients and stakeholders, demonstrating excellent problem More ❯

integrate easily into a collaborative, outspoken team culture. Key Responsibilities: Develop automation solutions using Python, PowerShell, or similar scripting languages Work with Kafka or similar streaming platforms for data pipelines and real-time processing Build and maintain CI/CD pipelines using Bamboo/Jenkins and BitBucket/GitLab Create Ansible Tower runbooks and playbooks for infrastructure automation More ❯

Microsoft Fabric Consultant | Data Engineering & DataOps 📍 Hybrid (2 days onsite in London) 💼 Permanent | Full-time 💰 £70,000 – £75,000 + 10% Bonus & 25 days holiday, pension & other benefits Are you a Fabric Consultant or Data Engineer looking to work with cutting-edge tech and make a real impact? We’re hiring for a hands-on role … where you’ll design and build scalable data pipelines using Microsoft Fabric and Databricks , drive DataOps best practices, and manage agile delivery through Jira . You’ll be part of a high-performing consultancy team delivering modern data platforms for enterprise clients. What You’ll Be Doing as a Fabric Consultant: Building end-to-end data pipelines with Microsoft Fabric & Databricks Driving DataOps workflows, CI/CD automation, and agile delivery via Jira Leading client workshops and collaborating with cross-functional teams Supporting data governance, compliance, and privacy initiatives Mentoring junior engineers and contributing to internal best practices What You’ll Bring: Strong experience in data engineering with Microsoft Fabric Solid More ❯

assistants Summarization tools Apply prompt engineering, Retrieval-Augmented Generation (RAG), and context-aware pipelines to enhance model accuracy and relevance. Integrate AI models with enterprise systems, APIs, and data stores using Python, Java, or Node.js. Collaborate with architects to define scalable, secure, and cost-efficient AI service architectures. Implement AI/ML pipelines for training, validation, and deployment … model compression, quantization, and API optimization. Ensure compliance with AI ethics, security, and governance standards. Prepare and curate training datasets (structured/unstructured text, images, code). Apply data preprocessing, tokenization, and embedding generation techniques. Work with vector databases (e.g., Pinecone, Weaviate, FAISS, Chroma) for semantic search and retrieval. Partner with business stakeholders to identify and shape impactful … with cloud platforms (AWS, GCP, Azure) and AI/ML services. Knowledge of MLOps tools and practices (e.g., MLflow, Kubeflow, Vertex AI, Azure ML). Strong understanding of data engineering, data pipelines, and ETL workflows. Excellent problem-solving, communication, and stakeholder engagement skills. Bachelor's or Master's degree in Computer Science, AI/ML, Data More ❯

assistants Summarization tools Apply prompt engineering, Retrieval-Augmented Generation (RAG), and context-aware pipelines to enhance model accuracy and relevance. Integrate AI models with enterprise systems, APIs, and data stores using Python, Java, or Node.js. Collaborate with architects to define scalable, secure, and cost-efficient AI service architectures. Implement AI/ML pipelines for training, validation, and deployment … model compression, quantization, and API optimization. Ensure compliance with AI ethics, security, and governance standards. Prepare and curate training datasets (structured/unstructured text, images, code). Apply data preprocessing, tokenization, and embedding generation techniques. Work with vector databases (e.g., Pinecone, Weaviate, FAISS, Chroma) for semantic search and retrieval. Partner with business stakeholders to identify and shape impactful … with cloud platforms (AWS, GCP, Azure) and AI/ML services. -Knowledge of MLOps tools and practices (e.g., MLflow, Kubeflow, Vertex AI, Azure ML). -Strong understanding of data engineering, data pipelines, and ETL workflows. -Excellent problem-solving, communication, and stakeholder engagement skills. -Bachelor's or Master's degree in Computer Science, AI/ML, Data More ❯

Overview : We are seeking a seasoned HR Data Solution Architect to design and build a scalable people data reporting and analytics platform. The ideal candidate will have strong experience in data architecture, integration, and reporting—preferably with Workday and Prism, though expertise in other People Data systems will also be considered. Key … Responsibilities : Architect and model data structures for HR analytics platforms, ensuring alignment with enterprise data lakes. Design and implement ETL pipelines and integrations across Workday, Prism, and external systems. Develop reporting datasets and dashboards using tools like Workday, Prism, Tableau, or Power BI. Establish data governance, privacy, and security controls. Monitor and optimize data pipelines and stay current with platform enhancements. Contribute to agile delivery practices and cross-functional collaboration. Preferred Skills : Deep understanding of Workday Objects and Prism Data Hub. Experience with cloud platforms, microservices, and modern data architectures. Strong analytical and stakeholder management skills. More ❯