1 to 25 of 65 Data Pipeline Jobs in Central London

Senior Data Engineer – Azure ** 5 days a week onsite - Central London ** £70,000 - £80,000 per annum About the Role One of the UK’s leading insurers are looking for a Senior Data Engineer with a primary focus on Azure to lead the design and implementation … call auditing. Collaborate with product managers, analysts, and data scientists to align data strategy with business objectives. Monitor and optimise pipeline performance, ensuring data quality, reliability, and consistency. Implement best practices for data governance, security, and compliance. Required Experience & Skills Proven ...

Data Engineer Python | AWS | Accounting Data | Insurance | London A leading insurance firm is seeking a Data Engineer to join a newly formed Data squad responsible for building a greenfield data platform. This Data Engineer will work closely with … internal Accounting and Finance stakeholders, supporting business-critical reporting and regulated financial processes. As a Data Engineer, you will take ownership of designing and building data pipelines from scratch, working primarily with Python and AWS. This is a true 01 initiative, where the Data ...

Head of Data Engineering Location : London Contract Type : Permanent Working Pattern : Hybrid Sector : FMCG About the Role A leading FMCG organisation we are working with is seeking an experienced Head of Data Engineering to join their leadership team on a permanent basis. This is an exciting … opportunity to lead and shape the data engineering function within a fast-paced, consumer-focused environment. As the Head of Data Engineering, you will be responsible for building and leading a high-performing data engineering team, establishing robust data infrastructure, and driving ...

Factory , Databricks , and related Azure services. Build ETL/ELT processes to transform raw data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data … Azure SQL Database, Synapse Analytics). Strong hands-on expertise in Databricks , Delta Lake , and cluster management . Proficiency in SQL and Python for pipeline development. Familiarity with Git/GitHub and CI/CD practices. Understanding of data modelling , data governance , and security principles. ...

Factory, Databricks, and related Azure services. Build ETL/ELT processes to transform raw data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data … ADLS, Azure SQL Database, Synapse Analytics). Strong hands-on expertise in Databricks, Delta Lake, and cluster management. Proficiency in SQL and Python for pipeline development. Familiarity with Git/GitHub and CI/CD practices. Understanding of data modelling, data governance, and security principles. ...

Azure Data Engineer - 3–6-month contract We are looking for a Data Engineer to join a growing digital and data function supporting a modern, cloud-based data platform. This role focuses on building reliable, secure, and scalable data solutions … that enable analytics, operational reporting, and data-driven decision making across the organisation. You will work closely with technical and non-technical stakeholders to deliver well-engineered data pipelines and models, contributing to the continuous improvement of data platforms and engineering standards. Azure data ...

Senior Data Engineer, Azure London (Hybrid) £90,000 + bonus + excellent benefits Azure Data Factory, Databricks, Python, SQL Senior Data Engineer is required to join a leading London-based insurance organisation with offices in the heart of the city. Working within a high … impact, specialist data team this role will see you building and evolving a modern Azure-based Data Lakehouse, supporting underwriting insight, analytics and decision-making at scale. You will work closely with senior business stakeholders, regional data teams and IT, combining hands-on engineering ...

Data Engineer | £80 ,000 - £100,000 | Central London (Hybrid - 3 days on-site) We're proud to partner with a high-growth fintech on the lookout for an AWS Data Engineer to join their fast-paced, data-driven organisation. This role is a great … someone who's eager to make an impact and get hands-on with modern tools. You'll design, build, and optimise scalable data pipelines and warehouse solutions while collaborating across teams to ensure reliable, secure, and efficient data infrastructure for the organisation. What ...

Data Engineer is required to support the development and improvement of data pipelines within a Microsoft-based analytics environment. The role focuses on ingesting, transforming, and standardising data from multiple sources to enable reliable reporting and analytics. Key Technical Responsibilities Design, build, and maintain … data pipelines using SQL, Python, and R Ingest and transform structured and semi-structured data within Microsoft Fabric Improve data quality, performance, and reliability across existing pipelines Prepare analytics-ready datasets optimised for Power BI consumption Apply data modelling and transformation best ...

Principal Data Engineer (GCP) Northwest – Hybrid Up to £100,000 VIQU are seeking a Principal Data Engineer to join a leading social enterprise that reinvests profits to create thriving, sustainable communities. Following a full transition to a 100% cloud-based data platform, this role … will play a key part in shaping and leading the organisation's data engineering capability, with a strong focus on technical leadership, platform design and mentoring engineers within a Google Cloud environment. Key Responsibilities of the Principal Data Engineer: Provide technical leadership, coaching and mentoring ...

Data Engineer ( Snowflake and Matillion) - 425PD - Remote About the Role We are looking for a Data Engineer with strong experience in Snowflake and Matillion to design, build, and maintain scalable data pipelines and analytics-ready data models. You'll work closely with … analytics, product, and business teams to turn raw data into reliable, high-quality datasets that power reporting, dashboards, and advanced analytics. This role is ideal for someone who enjoys working in a modern cloud data stack and takes pride in building clean, performant, and well-documented ...

role you will be designing and developing complex data processing modules and reporting using Big Query and Tableau. In addition, you will also work closely with the Infrastructure/Platform Team who are responsible for architecting, and operating the core of the client's Data Analytics … and MLOps capability infrastructure Ensure data quality, governance, and compliance with internal and external standards. Monitor and troubleshoot data pipeline issues, ensuring reliability and accuracy. ...

client, a well-established energy business in London, is hiring a Senior Data Engineer to support the next phase of their growth. The role is based in Mayfair and operates on a hybrid basis, with three office days and two remote days per week. Senior Data Engineer Role Purpose: We are looking for an engineer who is responsible for building, maintaining, and evolving the data pipelines and models that underpin our supply business. This includes ingestion, transformation, validation, and exposure of data used by trading, optimisation, operations, and reporting. ...

Title: Data Engineer Location: London, Hybrid As a Data Engineer, you will design, build, and maintain a modern cloud-based data platform. You will develop robust, secure, and scalable data pipelines, ensure high-quality and compliant data, and collaborate with … analytics and architecture teams to support business insights. Key Responsibilities: Build and maintain industrial-grade ELT pipelines to ingest, transform, and harmonise data from multiple sources. Deploy and industrialise cloud-based data platforms across build and run phases. Implement layered data architectures to structure ...

Data Scientist – Peer‐to‐Peer Renewable Energy Trading Platform Location: London (Hybrid) Employment Type: Full‐time, Permanent About the Company We are a rapidly scaling peer‐to‐peer Power Purchase Agreement (PPA) platform enabling businesses, generators, and communities to buy and sell renewable electricity directly. Our purpose … accelerate the shift to a decentralised, transparent, and data‐driven energy system. We build intelligent systems that optimise matching, pricing, and forecasting across distributed generation and consumption. As we expand across the UK and Europe, we are adding strong analytical and modelling capability to our team. Role Overview ...

seeking a high-impact Senior Full-Stack Engineer to join a growing technology team for a leading investment house supporting market data services within a regulated, enterprise environment. This role sits at the intersection of data engineering, full-stack development, and business engagement , working closely with … vendors to design and deliver robust, scalable technology solutions aligned to a strategic roadmap. What youll do Design, build, and maintain reliable, scalable data pipelines supporting complex analytical and sustainability data workloads. Ensure data quality, governance, and robustness through modern data engineering ...

Level Data Engineer (Contract) Start Date: ASAP Contract Duration: 6 Months Experience within the Financial Services Industry is a must. If you're a Data Engineer who enjoys building reliable, scalable data pipelines and wants your work to directly support front‐office decision‐making … this role offers exactly that. You'll join a data engineering function working closely with investment management and front‐office stakeholders , helping ensure critical financial data is delivered accurately, efficiently and at scale. This role sits at the intersection of technology, data ...

Westchester. The firm is operated with an entrepreneurial spirit and is continually seeking to improve and expand. Role We are seeking a talented Data Engineer to join the growing data team within our Quantitative Management Division This position is ideal for individuals who are passionate about … building scalable data solutions, eager to learn in a collaborative environment, and excited to work in small teams while taking advantage of opportunities to lead and enhance both themselves and their teammates. In this role, you will collaborate with experienced engineers to build and maintain our data ...

DATA ENGINEER LONDON £50,000 - £60,000 THE COMPANY This pioneering AdTech organization is transforming how out-of-home advertising is measured and optimized across the UK. Backed by industry leaders, they deliver world-class audience insights using GPS data and advanced analytics to help brands … place ads in the most impactful locations. As a Data Engineer , you’ll play a key role in shaping the data infrastructure that powers these decisions, working in a mission-driven, collaborative environment. THE ROLE As a Data Engineer , you will build and maintain ...

Senior Data Engineer, SQL, RDBMS, Python, Celery, RabbitMQ, AWS, Part Central London, Mainly Remote Senior Data Engineer (SQL, RDBMS, Python, AWS) required to work for a fast growing and exciting business based in Central London. However, this role is mainly remote. We need an experienced Data … Collaborate with product managers and business stakeholders to understand complex business requirements to translate business needs into well-designed and maintainable solutions Ensure data quality and reliability by implementing robust data quality checks, monitoring, and alerting to ensure the accuracy and timeliness of all data ...

Data Engineer Location: London – Hybrid | Permanent | £40,000 – £50,000 (DOE) VIQU are partnering with a leading organisation to recruit a Data Engineer to join their growing Data and Platform Engineering team. This is a fantastic opportunity for someone with around 2 years' experience … looking to develop their career in cloud-based data engineering. You'll work across the full lifecycle of data products, helping design, build, and maintain data pipelines and platforms using modern technologies. Key Responsibilities: Build and maintain ETL/ELT data pipelines ...

Python programming including object-oriented design, asynchronous programming, error handling, and writing clean, maintainable code. Experience with key libraries including Pandas, NumPy for data manipulation, requests and APIs for integrations, asyncio for concurrent processing, and building robust automation scripts with proper logging, testing (pytest), and documentation. AI & Machine … when RPA vs. API integration vs. AI solutions are most appropriate, and experience building hybrid automation solutions combining multiple technologies. Data Engineering & Pipeline Development - Strong skills in building data pipelines for AI/automation solutions including data extraction, transformation, and loading (ETL). ...

Full Stack Engineer (Web & Data) Industry: Technology/Digital Products/Automation & Analytics Location: London, UK (Hybrid 1-2 days) Are you passionate about developing seamless, data-driven digital experiences? An established digital transformation and technology solutions provider is looking for a Full Stack Engineer … Data) to join its growing Automation & Analytics team in London. This hybrid role blends web development with data engineering, offering exposure to everything from dynamic front‐end interfaces and API development to cloud‐based data pipelines and analytics platforms. If you love combining creativity ...

Full Stack Data Engineer £Up to £80,000 GBP Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Client: Join a high-growth technology and AI consultancy recognised for delivering exceptional outcomes across Defence, Healthcare, Finance, and Commercial sectors. Our client has built a reputation … solving some of the most complex data challenges in government and enterprise, earning industry recognition for innovation, engineering excellence, and strategic impact. Following a landmark acquisition by a global consulting powerhouse in 2025, the client now combines boutique technical expertise with global scale, creating an exceptional environment ...

experiences. As part of this innovative team, you’ll contribute to a platform that pushes the boundaries of digital advertising, combining creativity with data-driven precision to deliver unmatched results for top-tier clients. THE ROLE As the Engineering Manager , you’ll report directly to the CPTO … lead a team while being hands on through a pivotal phase of growth. Your mission: build data products , optimize data collection, and drive automation across the business. This role is 60% hands-on technical leadership and 40% mentorship , focusing on big data, efficiency ...