76 to 100 of 556 Data Pipeline Jobs in London

Title: Snowflake Data Architect Salary: Paying up to £90,000 per annum Location: Wembley London - 5 days on-site Our client, a well-established and diversified multinational organisation, is seeking a Snowflake/Data Architect to join their team. Skills Solid experience in Data … data connectivity. AI Readiness : Practical experience architecting data infrastructure for AI/ML consumption - vector databases, embedding stores, and RAG pipeline integration. Soft Skills: Strong interpersonal skills; ability to translate complex data architecture into clear language for Business Analysts and non-technical stakeholders. ...

platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Accepting applications until: 7 August 2026 Job Description Your role: Data Engineer A hands-on role building scalable data infrastructure … that powers AI-driven products and audience intelligence. As a Data Engineer at Global, you will: Key Responsibilities • Data Platform & Pipeline Engineering (60%) : Design, build and maintain scalable batch and near real-time pipelines across ingestion, transformation and serving layers. Develop reusable data ...

more liquid world. The more we share, the more we all gain. About the role Sharegain is looking for an experienced and driven Data Team Lead to join our R&D organization. In this role, you will lead a team of data engineers while taking hands … ownership of data infrastructure, pipelines, and quality standards. You will play a key role in shaping how data is built, used, and trusted across the company - from our core platform through to analytics and AI-native applications. This is both a technical leadership and people management ...

successful multinational technology business is looking for a Data Reliability Engineer to join its growing data team in Central London. This role is hybrid youll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. Youll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. Youll take ownership of data reliability end-to-end, designing and implementing ...

Staff Data Engineer | AWS | PySpark | Data Modernisation | London | Contract | Inside IR35 We're supporting a global, technology-led organisation undertaking a large-scale cloud data transformation programme. This isn't a traditional Data Engineering role. The organisation is modernising hundreds of complex … roles Python and expert-level PySpark AWS Glue Apache Spark Apache Airflow Cloud-native Data Engineering architectures Large-scale data pipeline modernisation Building reusable engineering patterns within enterprise environments Data testing, validation and observability AI-assisted software development using modern coding assistants Working ...

hiring a hands-on BI Architect to support the evolution of a cloud-based data platform, with a strong focus on data warehousing, analytics, and reporting. You'll work closely with BI Developers to design, build, and optimise end-to-end data solutions across … well-established UK-based international investment organisation with a global footprint, delivering impactful programmes across multiple regions. Description Design and enhance Enterprise Data Warehouse and data hub architectures Build and support end-to-end data pipelines (ingestion transformation reporting) using Azure services Work hands ...

Principal Data Engineer (14 Month FTC) As part of the Operations Delivery Intelligence (ODI) directorate, you will act as a technical leader for data engineering across the organisation, enabling secure, scalable and high‐performing data platforms that underpin data products and decision … making across the company. What you’ll do: Act as a technical leader for data engineering best practice across delivery teams Lead the design, build, test and deployment of secure and scalable data pipelines Maintain and operate data products, ensuring availability, performance and resilience ...

Data Analyst London (Hybrid, 4 days in office) | £45,000 + Bonus This is an excellent opportunity to play a key role in turning complex datasets into meaningful insights. You'll work across a range of high-profile communications and brand measurement projects, helping stakeholders understand performance, audience … engagement, and brand impact through data. The Company This specialist analytics consultancy supports clients with data-driven decision making across communications, marketing, and brand performance. They bring together data from multiple sources to deliver actionable insights and strategic recommendations. With a collaborative team environment ...

Title: Data Solution Architect Location: Paddington Duration: 6 months possible extension Our client is leveraging the power of data and AI to solve business problems, improve customer experience, and drive commercial value. This is an architecture-led role within the Data Architecture & Design team … helping shape how data solutions are designed, governed, and made supportable across multiple business areas. What you'll be doing: Provide architecture and design guidance across a portfolio of data projects, ensuring solutions align with platform strategy and future changes Guide functional design for data ...

Data & AI Consultant - London (Hybrid) - Up to £50,000 - Permanent We're currently partnering with an organisation who are investing heavily in their Data & AI function. With the demanding growth of data-driven transformation, they need a talented Data & AI professional … recognised organisations. This is an exciting opportunity to work on large-scale transformation programmes, helping clients to develop value through modern cloud and data platforms, advanced analytics and AI solutions. You'll join a cooperative team, working closely with business and technology stakeholders to solve complex challenges ...

advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers secure, scalable digital tools, software services, and infrastructure across all business units. Agile development teams align with … foster innovation, establish common technology standards, and develop reusable capabilities that accelerate delivery across Marex. Role Summary We are seeking a Senior Enterprise Data Engineer to lead the development of enterprise-scale data integration and data product capabilities across the organisation. This role will ...

life cycle using Azure ML Studio, including deployment, monitoring, retraining pipelines, and version control. Implement robust MLOps practices such as model drift detection, data quality monitoring, and automated retraining workflows. Data Engineering and Preprocessing Develop and maintain scalable data pipelines using Python … Python and SQL skills for data manipulation, modelling, and automation Experience with Azure Data Factory (ADF) for data pipeline development Strong understanding of CI/CD and MLOps practices, ideally within Azure environments Experience with data visualisation tools such as Power ...

Azure Data Engineer - SC Clearance - London/Hybrid - £550 - £600 per day - 6 months Key Responsibilities Design and develop robust data pipelines using Azure services (e.g., Azure Synapse, Data Factory) Build and maintain scalable data architectures to support analytics and reporting Integrate … data from multiple sources, ensuring quality, reliability, and performance Collaborate with data scientists and analysts to enable advanced analytics and Azure ML use cases Optimise data workflows and troubleshoot performance issues Azure Data Engineer - SC Clearance - London/Hybrid ...

experienced AWS Databricks Engineer with strong hands-on expertise in Databricks, AWS cloud services, PySpark, Spark SQL, Delta Lake, Python, SQL, and data engineering. The candidate will be responsible for designing, developing, optimizing, and supporting scalable data pipelines and lakehouse solutions for a banking client.The ideal … candidate should have strong experience in building enterprise-grade data platforms, processing large volumes of structured and semi-structured data, and implementing secure, reliable, and high-performance data pipelines in AWS-based environments. Hybrid working: The places that you work from ...

About the role. As part of the development of our Digital Services function, we are strengthening internal digital capability within the Data Team. These roles are central to building sustainable in-house expertise that supports the design, development, and delivery of digital solutions across the transport network. … focus of this campaign is creating new opportunities, and as a result, we are recruiting Lead Data Engineers. This is a pivotal role within the organisation. In this role, you will design, build, and support data pipelines within our Data as a Service (DaaS ...

think big and bring your ambition to work every day, which is why, at British Airways the sky is never the limit. Principal Data Engineer (14 Month FTC) You’ll be part of the Operations Delivery Intelligence (ODI) directorate, acting as a technical leader for data engineering across the organisation. This area plays a critical role in enabling secure, scalable and high‐performing data platforms that underpin data products and decision‐making across British Airways. What you’ll do: Act as a technical leader for data engineering best ...

bring your ambition to work every day, which is why, at British Airways the sky is never the limit. The role: Principal Data Engineer (14 Month FTC) You'll be part of the Operations Delivery Intelligence (ODI) directorate, acting as a technical leader for data engineering … across the organisation. This area plays a critical role in enabling secure, scalable and high performing data platforms that underpin data products and decision making across British Airways. What you'll do: Act as a technical leader for data engineering best practice across delivery ...

Senior Data Engineer Private Equity Real Estate Location: London Working: 5 days per week onsite (non-negotiable) Package: Up to £120k Total Compensation The Role An opportunity to join a highly successful private equity investment firm as they continue to invest in their data platform … engineering capabilities.You'll play a key role in building and evolving the firm's cloud-based data platform, developing scalable data pipelines, integrating internal and external data sources, and delivering high-quality data that directly supports investment decisions.This is a hands ...

DATA ANALYST LONDON/HYBRID UP TO £45,000 This is an opportunity to join a highly regarded analytics environment where you will play a key role in shaping how data is transformed and used to drive decision making. Sitting at the intersection of analytics … data engineering, this position offers hands on exposure to modern data tooling alongside the chance to influence how data is structured, accessed and interpreted. ROLES AND RESPONSIBILITIES: The Data Analyst will: Build, optimise and maintain SQL based data transformations within ...

Title: Senior Data Engineer (Informatica) Max pay rate: £530 per day Location: Remote ***Essential Clearance required: Active SC Cleared*** Location: London Work type: this role is virtual, however there may be an infrequent ask to attend a meeting in Newcastle or Leeds. Job Description: Role Overview … seeking an experienced Senior Data Engineer with strong expertise in Informatica PowerCentre, Oracle, and UNIX shell scripting to support critical data warehouse and ETL migration initiatives. The role will focus on migrating legacy SAS-based ETL processes to Informatica, ensuring efficient, scalable, and high-quality data ...

Data Engineer (Databricks) Rate: £550-£600pd (Inside IR35) Location: Hybrid - 2/3 days in London Victoria/Croydon Essential: Active SC clearance Role Definition We are seeking an experienced Databricks expert and professional to support the introduction and adoption of the Databricks platform across the organisation. This … role will play a key part in helping us to shape our approach to alpha phase of the project, our data platform transition strategy, supporting the migration of existing data products, and establishing best practices, governance, and operating models. The successful candidate will combine strong technical ...

impressive multinational firm is looking for an accomplished Data Engineer to join its team. Please note the role is hybrid – you will work from the office 3 days per week with 2 from home. In this role, you will be responsible for designing, developing, and maintaining scalable data solutions that provide clean, structured, and accessible data to internal teams, stakeholders, and external partners. Working closely with developers, analysts, and business teams, you will help deliver cloud-based data platforms that support reporting, analytics, and data-driven innovation. In order ...

Senior Data Adviser - Lawtech/AI & Data Our client, a leading UK law firm is seeking a Senior Data Adviser to join its innovative Lawtech function. This is a newly created role and the first dedicated data specialist within the team, offering … unique opportunity to shape data strategy, influence AI adoption, and drive transformation across the business. You will work at the forefront of data, AI and legal technology, helping deliver smarter, more efficient legal services and building scalable, data-driven solutions. Key Responsibilities: Data ...

looking for a hands‐on Senior/Lead Cloud Platform Engineer to shape and run the multi‐cloud foundation that our engineering, data and product teams build on everyday. This is a senior individual‐contributor/tech‐lead role at the heart of a modern hybrid‐cloud strategy. … platform work. Security is central, not an afterthought. You will help drive a zero‐trust approach across identity, network, workloads and data, ensuring the platform is secure by default for humans and machine/agent identities alike. You will also work closely with our data function ...

Title: QA Data Engineer - Aladdin Data Cloud Location: London (hybrid) Salary/Rate: £600 - 750 per day inside IR35 Start Date: July Job Type: Initial 6 month contract Company Introduction We have an exciting opportunity now available with one of our sector-leading consultancy clients! They … currently looking for a skilled Aladdin QA Data Engineer to join their asset management team. Job Responsibilities/Objectives You will be responsible for supporting the quality assurance of a large-scale data platform implementation. The successful candidate will work closely with engineering teams to identify ...