1 to 25 of 85 Data Pipeline Jobs in Central London

Senior Data Engineer – Azure ** 5 days a week onsite - Central London ** £70,000 - £80,000 per annum About the Role One of the UK’s leading insurers are looking for a Senior Data Engineer with a primary focus on Azure to lead the design and implementation … call auditing. Collaborate with product managers, analysts, and data scientists to align data strategy with business objectives. Monitor and optimise pipeline performance, ensuring data quality, reliability, and consistency. Implement best practices for data governance, security, and compliance. Required Experience & Skills Proven ...

Data Engineer Python | AWS | Accounting Data | Insurance | London A leading insurance firm is seeking a Data Engineer to join a newly formed Data squad responsible for building a greenfield data platform. This Data Engineer will work closely with … internal Accounting and Finance stakeholders, supporting business-critical reporting and regulated financial processes. As a Data Engineer, you will take ownership of designing and building data pipelines from scratch, working primarily with Python and AWS. This is a true 01 initiative, where the Data ...

Data Scientist/Engineer - Outside IR35 Contract Location: London (Hybrid Working) Contract: Outside IR35 Clearance: Active SC Clearance required Email : henry.clay-davies@searchability.com Phone : 07719 065951 Overview We are seeking an experienced Data Science/Data Engineering Contractor to join a high-impact programme … based in London, working on advanced data-driven and LLM-enabled platforms. This is an outside IR35 contract offering hybrid working, ideal for contractors with strong experience building scalable data pipelines, analytics services, and AI-enabled systems in cloud environments. You will play a key role ...

Head of Data Engineering Location : London Contract Type : Permanent Working Pattern : Hybrid Sector : FMCG About the Role A leading FMCG organisation we are working with is seeking an experienced Head of Data Engineering to join their leadership team on a permanent basis. This is an exciting … opportunity to lead and shape the data engineering function within a fast-paced, consumer-focused environment. As the Head of Data Engineering, you will be responsible for building and leading a high-performing data engineering team, establishing robust data infrastructure, and driving ...

Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in London London location – hybrid working when possible Must hold active Enhanced DV Clearance Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data … delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework ...

Factory , Databricks , and related Azure services. Build ETL/ELT processes to transform raw data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data … Azure SQL Database, Synapse Analytics). Strong hands-on expertise in Databricks , Delta Lake , and cluster management . Proficiency in SQL and Python for pipeline development. Familiarity with Git/GitHub and CI/CD practices. Understanding of data modelling , data governance , and security principles. ...

Factory, Databricks, and related Azure services. Build ETL/ELT processes to transform raw data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data … ADLS, Azure SQL Database, Synapse Analytics). Strong hands-on expertise in Databricks, Delta Lake, and cluster management. Proficiency in SQL and Python for pipeline development. Familiarity with Git/GitHub and CI/CD practices. Understanding of data modelling, data governance, and security principles. ...

Azure Data Engineer - 3–6-month contract We are looking for a Data Engineer to join a growing digital and data function supporting a modern, cloud-based data platform. This role focuses on building reliable, secure, and scalable data solutions … that enable analytics, operational reporting, and data-driven decision making across the organisation. You will work closely with technical and non-technical stakeholders to deliver well-engineered data pipelines and models, contributing to the continuous improvement of data platforms and engineering standards. Azure data ...

Senior Data Engineer, Azure London (Hybrid) £90,000 + bonus + excellent benefits Azure Data Factory, Databricks, Python, SQL Senior Data Engineer is required to join a leading London-based insurance organisation with offices in the heart of the city. Working within a high … impact, specialist data team this role will see you building and evolving a modern Azure-based Data Lakehouse, supporting underwriting insight, analytics and decision-making at scale. You will work closely with senior business stakeholders, regional data teams and IT, combining hands-on engineering ...

Data Engineering Offering Lead Salary: £80,000 – £100,000 + benefits Location: UK-wide (client-site travel required) Clearance: SC or SC-clearable Type: Permanent We’re partnering with a growing consulting business that is expanding its Data & AI practice and looking for a Data Engineering Offering Lead to define, build and lead their modern data engineering capability. This is a strategic, hands-on consulting role focused on designing scalable data platforms, leading client engagements and shaping the firm’s go-to-market data engineering offering. What ...

Data Engineer is required to support the development and improvement of data pipelines within a Microsoft-based analytics environment. The role focuses on ingesting, transforming, and standardising data from multiple sources to enable reliable reporting and analytics. Key Technical Responsibilities Design, build, and maintain … data pipelines using SQL, Python, and R Ingest and transform structured and semi-structured data within Microsoft Fabric Improve data quality, performance, and reliability across existing pipelines Prepare analytics-ready datasets optimised for Power BI consumption Apply data modelling and transformation best ...

Data Engineer ( Snowflake and Matillion) - £425PD - Remote About the Role We are looking for a Data Engineer with strong experience in Snowflake and Matillion to design, build, and maintain scalable data pipelines and analytics-ready data models. You'll work closely with … analytics, product, and business teams to turn raw data into reliable, high-quality datasets that power reporting, dashboards, and advanced analytics. This role is ideal for someone who enjoys working in a modern cloud data stack and takes pride in building clean, performant, and well-documented ...

role you will be designing and developing complex data processing modules and reporting using Big Query and Tableau. In addition, you will also work closely with the Infrastructure/Platform Team who are responsible for architecting, and operating the core of the client's Data Analytics … and MLOps capability infrastructure Ensure data quality, governance, and compliance with internal and external standards. Monitor and troubleshoot data pipeline issues, ensuring reliability and accuracy. ...

Data Engineer with Palantir Foundry — Digital Products/Applications/Automation & Analytics Location: London, UK (Hybrid 2-3 days) Are you passionate about building scalable data platforms and driving digital transformation through analytics? A leading provider of digital and automation solutions in the technology and consulting … industry is seeking a Data Engineer to join its growing team in London. In this role, you’ll design, build, and maintain robust data pipelines across hybrid cloud environments (AWS & Azure) , supporting projects for a global enterprise with diverse business interests — spanning energy, infrastructure, automotive ...

client, a well-established energy business in London, is hiring a Senior Data Engineer to support the next phase of their growth. The role is based in Mayfair and operates on a hybrid basis, with three office days and two remote days per week. Senior Data Engineer Role Purpose: We are looking for an engineer who is responsible for building, maintaining, and evolving the data pipelines and models that underpin our supply business. This includes ingestion, transformation, validation, and exposure of data used by trading, optimisation, operations, and reporting. ...

Title: Data Engineer Location: London, Hybrid As a Data Engineer, you will design, build, and maintain a modern cloud-based data platform. You will develop robust, secure, and scalable data pipelines, ensure high-quality and compliant data, and collaborate with … analytics and architecture teams to support business insights. Key Responsibilities: Build and maintain industrial-grade ELT pipelines to ingest, transform, and harmonise data from multiple sources. Deploy and industrialise cloud-based data platforms across build and run phases. Implement layered data architectures to structure ...

seeking a high-impact Senior Full-Stack Engineer to join a growing technology team for a leading investment house supporting market data services within a regulated, enterprise environment. This role sits at the intersection of data engineering, full-stack development, and business engagement , working closely with … vendors to design and deliver robust, scalable technology solutions aligned to a strategic roadmap. What youll do Design, build, and maintain reliable, scalable data pipelines supporting complex analytical and sustainability data workloads. Ensure data quality, governance, and robustness through modern data engineering ...

Level Data Engineer (Contract) Start Date: ASAP Contract Duration: 6 Months Experience within the Financial Services Industry is a must. If you're a Data Engineer who enjoys building reliable, scalable data pipelines and wants your work to directly support front‐office decision‐making … this role offers exactly that. You'll join a data engineering function working closely with investment management and front‐office stakeholders , helping ensure critical financial data is delivered accurately, efficiently and at scale. This role sits at the intersection of technology, data ...

About the Role: Synechron UK is seeking an experienced Lead Data Engineer to spearhead the development and evolution of our data engineering platforms. This leadership role requires a hands-on professional proficient in designing, building, and optimising enterprise-grade data solutions, with a focus … innovation, resilience, and regulatory compliance. Key Responsibilities: Lead and develop robust data engineering platforms leveraging technologies such as Hadoop, Spark, and Splunk. Design, implement, and maintain scalable ETL/ELT data pipelines for diverse data types, including raw, structured, semi-structured, and unstructured data ...

DATA ENGINEER LONDON £50,000 - £60,000 THE COMPANY This pioneering AdTech organization is transforming how out-of-home advertising is measured and optimized across the UK. Backed by industry leaders, they deliver world-class audience insights using GPS data and advanced analytics to help brands … place ads in the most impactful locations. As a Data Engineer , you’ll play a key role in shaping the data infrastructure that powers these decisions, working in a mission-driven, collaborative environment. THE ROLE As a Data Engineer , you will build and maintain ...

Senior Data Engineer, SQL, RDBMS, Python, Celery, RabbitMQ, AWS, Part Central London, Mainly Remote Senior Data Engineer (SQL, RDBMS, Python, AWS) required to work for a fast growing and exciting business based in Central London. However, this role is mainly remote. We need an experienced Data … Collaborate with product managers and business stakeholders to understand complex business requirements to translate business needs into well-designed and maintainable solutions Ensure data quality and reliability by implementing robust data quality checks, monitoring, and alerting to ensure the accuracy and timeliness of all data ...

Python programming including object-oriented design, asynchronous programming, error handling, and writing clean, maintainable code. Experience with key libraries including Pandas, NumPy for data manipulation, requests and APIs for integrations, asyncio for concurrent processing, and building robust automation scripts with proper logging, testing (pytest), and documentation. AI & Machine … when RPA vs. API integration vs. AI solutions are most appropriate, and experience building hybrid automation solutions combining multiple technologies. Data Engineering & Pipeline Development - Strong skills in building data pipelines for AI/automation solutions including data extraction, transformation, and loading (ETL). ...

SENIOR PRODUCT DATA SCIENTIST SALARY UP TO £80,000 LONDON – HYBRID A fast-growing, product-led marketplace business is seeking a Senior Product Analyst (Data Scientist) to join its Insights function. This role sits at the centre of product decision-making and works closely with cross … experimentation workflows. Hands-on experience designing and interpreting A/B tests. Understanding of ETL processes and the ability to troubleshoot data pipeline issues. Proficiency with data visualisation tools such as Looker or Tableau. Excellent communication skills with the ability to simplify complex topics ...

Full Stack Engineer (Web & Data) Industry: Technology/Digital Products/Automation & Analytics Location: London, UK (Hybrid 1-2 days) Are you passionate about developing seamless, data-driven digital experiences? An established digital transformation and technology solutions provider is looking for a Full Stack Engineer … Data) to join its growing Automation & Analytics team in London. This hybrid role blends web development with data engineering, offering exposure to everything from dynamic front‐end interfaces and API development to cloud‐based data pipelines and analytics platforms. If you love combining creativity ...

Data Engineer — Hedge Fund (L/S Equity) | London A fundamentally driven long/short equity fund focused on the European Industrials sector is seeking a Data Engineer for a variety of greenfield development. Founded by a former Citadel portfolio manager, the team brings together expertise … frameworks Experience designing and maintaining cloud-based data pipelines (e.g. AWS, Airflow, Snowflake) Deep understanding of data modelling, validation, and pipeline resilience Familiarity with financial or alternative datasets preferred ...