1 to 25 of 79 Data Pipeline Jobs in Central London

Radius is seeking a highly talented Data Architect and Governance lead for my client going through a digital transformation. Team Leadership Data Strategy Define and lead enterprise wide data strategy Design and maintain a scalable, secure data architecture Deep understanding of Data Governance, Modern data platforms: Cloud Data quality Management, metadata, lineage and data modelling Experience with Data integration, master data management (MDM) and designing scalable data pipelines Data Privacy, regulatory compliance, and security best practises BI Tools Power BI, Tableau, Looker proficient in data modelling, SQL, and cloud platforms - Azure, AWS, GCP and … their Data services Key Responsibilities Define and implement data architecture strategies in line with the Customer Journey programme Guide the data-driven decision-making process, ensuring that data is effectively utilised to inform business strategies and initiatives. Develop data plan to address data quality issues in line with More ❯

Radius is seeking a highly talented Data Architect and Governance lead for my client going through a digital transformation. Team Leadership Data Strategy Define and lead enterprise wide data strategy Design and maintain a scalable, secure data architecture Deep understanding of Data Governance, Modern data platforms: Cloud Data quality Management, metadata, lineage and data modelling Experience with Data integration, master data management (MDM) and designing scalable data pipelines Data Privacy, regulatory compliance, and security best practises BI Tools Power BI, Tableau, Looker proficient in data modelling, SQL, and cloud platforms - Azure, AWS, GCP and … their Data services Key Responsibilities Define and implement data architecture strategies in line with the Customer Journey programme Guide the data-driven decision-making process, ensuring that data is effectively utilised to inform business strategies and initiatives. Develop data plan to address data quality issues in line with More ❯

Main purpose of job: Responsible for facilitating the implementation of the data strategy, under the strategic direction of the Data Steering Group, through iterative technical delivery of a modern data platform solution that provides the business with the following: Improved data quality and consistency, More readily and reliably accessible MI, Enhanced data … driven business insights, Leveraging of digitalisation and automated solutions to achieve greater resource and process efficiencies. This will include contributing towards the design and building of a modern Data platform solution to handle large and complex data sets. Key tasks: Design Data Lake and Data Warehouse solutions Design Data Models … using Data Vault and Dimensional modelling methods Implement automated, reusable and efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation More ❯

Main purpose of job: Responsible for facilitating the implementation of the data strategy, under the strategic direction of the Data Steering Group, through iterative technical delivery of a modern data platform solution that provides the business with the following: Improved data quality and consistency, More readily and reliably accessible MI, Enhanced data … driven business insights, Leveraging of digitalisation and automated solutions to achieve greater resource and process efficiencies. This will include contributing towards the design and building of a modern Data platform solution to handle large and complex data sets. Key tasks: Design Data Lake and Data Warehouse solutions Design Data Models … using Data Vault and Dimensional modelling methods Implement automated, reusable and efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation More ❯

Data Analytics Engineer Location: Central London - hybrid working Rate: £500.00 per day inside IR35 Duration: 12 months We are working with a leading global player in the travel industry who are seeking a Data Analytics Engineer to join their data team. This role sits at the intersection of data analysis and data engineeringideal for someone who enjoys building scalable data solutions while staying close to business impact. The Role As a Data Analytics Engineer , youll design, build, and maintain reliable data pipelinesprimarily using PySpark, SQL, and Python to ensure business teams (analysts, product managers, finance, operations) have access to well-modeled, actionable data. Youll … Engineers, youll be closer to the business, shaping analytics-ready datasets. Unlike pure Data Analysts, youll spend more time coding, managing data infrastructure, and ensuring pipeline reliability. Who Were Looking For Data Analytics : Analysts who have strong experience building and maintaining data pipelines (particularly in PySpark/SQL ) and want to More ❯

Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Responsibilities: Design, develop, and maintain robust and scalable ETL/ELT pipelines using Snowflake as the data warehouse. Implement data transformations and build analytical data models using dbt (data build tool). Develop and optimize complex SQL queries for data extraction, transformation, and loading in Snowflake. Orchestrate and schedule data workflows using Apache Airflow, including developing custom Python operators and DAGs. Write efficient and maintainable Python scripts for data processing, automation, and integration with various data sources and APIs. Ensure data quality, integrity, and governance throughout the data lifecycle. Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver data solutions. Implement and maintain CI/CD pipelines for data engineering processes, including version control with Git. Monitor data pipelines, troubleshoot issues, and optimize performance for efficiency and cost-effectiveness. Qualifications: Strong More ❯

Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Responsibilities: Design, develop, and maintain robust and scalable ETL/ELT pipelines using Snowflake as the data warehouse. Implement data transformations and build analytical data models using dbt (data build tool). Develop and optimize complex SQL queries for data extraction, transformation, and loading in Snowflake. Orchestrate and schedule data workflows using Apache Airflow, including developing custom Python operators and DAGs. Write efficient and maintainable Python scripts for data processing, automation, and integration with various data sources and APIs. Ensure data quality, integrity, and governance throughout the data lifecycle. Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver data solutions. Implement and maintain CI/CD pipelines for data engineering processes, including version control with Git. Monitor data pipelines, troubleshoot issues, and optimize performance for efficiency and cost-effectiveness. Qualifications: Strong More ❯

Role Title: Pre-Sales & Data Solution Architect Business Unit/Segment: Data Management Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent Summary Our client, a leading global data and AI consultancy, is seeking a Pre-Sales & Data Solution Architect Lead - hybrid role to become one of their leaders in this … area in their Data Management practice with a focus on banking clients . This is a strategic, client-facing role where you will partner with senior stakeholders to modernise data platforms, accelerate cloud adoption, and drive measurable business value. The role combines technical leadership with consulting and pre-sales expertise . You will design enterprise data … as a trusted advisor, leading workshops and influencing senior stakeholders on strategy, roadmaps, and innovation. ETL/ELT & Data Engineering – Provide oversight on robust data pipeline and integration designs using SSIS, ADF, Informatica, or IBM DataStage. Data Governance & Quality – Define governance, metadata, and quality frameworks using tools such as Unity Catalog, Profisee, Alation More ❯

Role Title: Pre-Sales & Data Solution Architect Business Unit/Segment: Data Management Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent Summary Our client, a leading global data and AI consultancy, is seeking a Pre-Sales & Data Solution Architect Lead - hybrid role to become one of their leaders in this … area in their Data Management practice with a focus on banking clients . This is a strategic, client-facing role where you will partner with senior stakeholders to modernise data platforms, accelerate cloud adoption, and drive measurable business value. The role combines technical leadership with consulting and pre-sales expertise . You will design enterprise data … as a trusted advisor, leading workshops and influencing senior stakeholders on strategy, roadmaps, and innovation. ETL/ELT & Data Engineering – Provide oversight on robust data pipeline and integration designs using SSIS, ADF, Informatica, or IBM DataStage. Data Governance & Quality – Define governance, metadata, and quality frameworks using tools such as Unity Catalog, Profisee, Alation More ❯

Senior AWS Data Engineer I am working with a leading organisation that is embarking on a greenfield initiative to revolutionise how their data is accessed and utilised. As part of this transformation, they're looking for a highly skilled Senior AWS Data Engineer to join their team and help design and build a cutting … edge data platform. This is a rare opportunity to work on a … high-impact project, collaborating with multiple business units and leveraging modern technologies such as Databricks and Snowflake. You'll be at the forefront of solving complex data pipeline challenges while contributing to strategic data architecture decisions. As part of this role, you will be responsible for some of the following areas: Design and build scalable More ❯

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, youll not only be part of a creative and open work culture focused on innovation and … it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. … Integrate data management technologies and software tools into existing structures. Create data tools to support sport data modelling, prediction and analytics. Work with data and analytics experts to strive for greater functionality in our data systems. As the selected Data Engineer, your background will include: 3+ years industry More ❯

Senior Data Engineer | London hybrid | Insurance industry l Upto 100k The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client who is a prominent London Market insurer is looking for a skilled and motivated Senior Data Engineer to play a key role in the development of a … new data platform within the Azure ecosystem. This is an exciting opportunity to be at the forefront of data innovation, working for a long standing London Market Insurer. You’ll help shape the data engineering roadmap, improve data quality, and empower the business to make data-driven decisions. As a … Senior Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Azure. This platform will be built to scale, incorporating the latest advancements in data intelligence while supporting strategic business objectives. Key Responsibilities 🔹 Build & Develop – Design and More ❯

Senior Data Engineer | London hybrid | Insurance industry l Upto 100k The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client who is a prominent London Market insurer is looking for a skilled and motivated Senior Data Engineer to play a key role in the development of a … new data platform within the Azure ecosystem. This is an exciting opportunity to be at the forefront of data innovation, working for a long standing London Market Insurer. You’ll help shape the data engineering roadmap, improve data quality, and empower the business to make data-driven decisions. As a … Senior Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Azure. This platform will be built to scale, incorporating the latest advancements in data intelligence while supporting strategic business objectives. Key Responsibilities 🔹 Build & Develop – Design and More ❯

VCCP are looking for a Head of Data to build our data function from the ground up, architect our MS Fabric warehouse, stand up secure pipelines across our internal systems/TM1/Sage/ATS/HubSpot, lead a lean team, and deliver high-impact dashboards for senior leadership. Role Overview: We are seeking a … hands-on Head of Data to architect and lead the data function from the ground up. This is a newly created role in a fast-paced environment, where data is central to unlocking operational efficiency, commercial insight, and strategic decision-making. The successful candidate will be responsible for building the data warehouse … integrating strategic data sources, and delivering high-impact dashboards and analytics to senior leadership. They must be confident operating in a high-pressure, fast-evolving environment and capable of influencing senior stakeholders across the business. Key Responsibilities: Build and deploy a centralised data warehouse using Microsoft Fabric, integrating key systems including (some of these are internal More ❯

VCCP are looking for a Head of Data to build our data function from the ground up, architect our MS Fabric warehouse, stand up secure pipelines across our internal systems/TM1/Sage/ATS/HubSpot, lead a lean team, and deliver high-impact dashboards for senior leadership. Role Overview: We are seeking a … hands-on Head of Data to architect and lead the data function from the ground up. This is a newly created role in a fast-paced environment, where data is central to unlocking operational efficiency, commercial insight, and strategic decision-making. The successful candidate will be responsible for building the data warehouse … integrating strategic data sources, and delivering high-impact dashboards and analytics to senior leadership. They must be confident operating in a high-pressure, fast-evolving environment and capable of influencing senior stakeholders across the business. Key Responsibilities: Build and deploy a centralised data warehouse using Microsoft Fabric, integrating key systems including (some of these are internal More ❯

evolving Lloyds managing agent thats leading the way across multiple lines, including Property, Casualty, and Specialty. As part of a major transformation, theyre building a modern, business-driven data platform from the ground up and theyre looking for a Senior Data Engineer to help shape it. About the Business This Lloyds managing agent is authorised and … regulated by the PRA and FCA, managing a high-performing syndicate. They are known for underwriting excellence and are investing heavily in data and technology to support their long-term growth. Why this role? You'll play a key role in delivering a robust, scalable data platform that unlocks better MI, improves data quality … and drives automation across the business. Youll work closely with teams across Actuarial, Finance, and IT helping to bring their data needs to life. This is a genuinely exciting opportunity to influence the data direction of a Lloyds business, not just maintain it. Key responsibilities: Design and build Data Lake and Data More ❯

Sahaj Software is an artisanal software engineering firm built on the values of trust, respect, curiosity, and craftsmanship, and delivering purpose-built solutions to drive data-led transformation for organisations. Our emphasis is on craft as we create purpose-built solution, leveraging Data Engineering, Platform Engineering and Data Science with a razor-sharp focus … to solve complex business and technology challenges, and provide customers with a competitive edge. As a Senior Data Engineer, you’ll feel at home if you are hands on, grounded, opinionated and passionate about delivering comprehensive data solutions that align with modern data architecture approaches. Your work will range from building a full data platform to building data pipelines or helping with data architecture and strategy. This role is ideal for those looking to have a large impact and huge scope for growth, while still being hands on with technology. We aim to allow growth without becoming “post-technical”. Responsibilities: Collaborate with Data Scientists and More ❯

Sahaj Software is an artisanal software engineering firm built on the values of trust, respect, curiosity, and craftsmanship, and delivering purpose-built solutions to drive data-led transformation for organisations. Our emphasis is on craft as we create purpose-built solution, leveraging Data Engineering, Platform Engineering and Data Science with a razor-sharp focus … to solve complex business and technology challenges, and provide customers with a competitive edge. As a Senior Data Engineer, you’ll feel at home if you are hands on, grounded, opinionated and passionate about delivering comprehensive data solutions that align with modern data architecture approaches. Your work will range from building a full data platform to building data pipelines or helping with data architecture and strategy. This role is ideal for those looking to have a large impact and huge scope for growth, while still being hands on with technology. We aim to allow growth without becoming “post-technical”. Responsibilities: Collaborate with Data Scientists and More ❯

VP AWS Data Engineer - Strategic Data Leadership - London - Hybrid Are you a visionary data engineering leader ready to architect the future of market data infrastructure? A global financial institution is seeking a Vice President - AWS Data Engineering to spearhead the development of a next-generation Market Data Store … initiative offers a rare opportunity to shape the platform from the ground up, leveraging technologies like Databricks, Snowflake, and AWS Glue to solve one of the most complex data challenges in banking. What makes this role stand out? Strategic ownership of a high-impact data platform initiative. Influence cross-functional teams and senior stakeholders. Drive innovation … in data architecture, governance, and analytics. Collaborate with data scientists to deploy machine learning models. Gain visibility across multiple business units and sectors. Key responsibilities: Lead the design and implementation of scalable, secure data pipelines and architectures. Define and enforce best practices in data governance, quality, and security. Guide the development of More ❯

We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you. Role Title: Data Engineer Location: London (Hybrid) Duration: Until 31/12/2025 Rate: £358 per day Inside IR35 (Umbrella) Role Description: To build and maintain the systems that collect, store … process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities: Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Skillset Required: Experience in Python, PySpark and SQL Experience with AWS is a plus Strong proficiency in Core Java, including Collections, Concurrency, and Memory Management. Proficient in version control systems such as Git, GitLab, or More ❯

We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you. Role Title: Data Engineer Location: London (Hybrid) Duration: Until 31/12/2025 Rate: £358 per day Inside IR35 (Umbrella) Role Description: To build and maintain the systems that collect, store … process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities: Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Skillset Required: Experience in Python, PySpark and SQL Experience with AWS is a plus Strong proficiency in Core Java, including Collections, Concurrency, and Memory Management. Proficient in version control systems such as Git, GitLab, or More ❯

Lead AWS Data Engineer/Architect - Databricks - London I'm working with a globally renowned financial services client that are looking for a seasons Data professional. My client are seen as leaders and pioneers within their relative field but also, a very well known house hold name. They have operations in near enough every country and … best companies to work for along side many other outstanding accolades. This is a hands on technical role. The successful applicant will be building and maintaining AWS Data pipelines and infrastructure. This is while working with cross functional teams to design best in Class data solutions across the business. As a business, they are very mature … within their data services however, there is always room for improvements so we're looking for an expert to not look to be involved in new processes but equally, help to reverse engineer the existing platform to increase efficiency and performance. This is a salaried position paying up to £130k as a base salary. It's hybrid working More ❯

remote Benefits: Healthcare and great holidays The Role As a Machine Learning Operations Engineer, you will be instrumental in designing, deploying, and maintaining machine learning systems that drive data-driven decision-making in the pensions and financial services sector. Using Azure's cloud ecosystem, you will build scalable ML workflows that support actuarial modelling, risk prediction, and client … classification, regression, ensemble methods, survival models) to improve predictions and automate core processes. 2. MLOps & Model Lifecycle Management * Own the end-to-end ML lifecycle using Azure ML pipelines, Data Factory (ADF), and ML tracking tools. * Implement CI/CD pipelines with Azure DevOps, ensuring robust version control, testing, and seamless deployment. * Monitor production ML systems for performance … data drift, and anomalies using Azure Monitor or other observability tools. * Schedule and automate model retraining pipelines to maintain performance over time. 3. Data Engineering & Preprocessing * Develop and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Data Lake, and SQL. * Prepare and preprocess large datasets to ensure More ❯

Our Client has a requirement for a Data Engineer , who will be required to work on a contract basis Remote working . Role Purpose: We are … seeking an experienced Data Engineer to design, build, and optimize data solutions using the Microsoft technology stack. The role focuses on developing scalable ETL pipelines, data models, and cloud-based solutions leveraging Azure Data Factory, Azure Synapse, Azure SQL, and Azure Functions . The ideal candidate will have a proven background in … data engineering, cloud architecture, and enterprise data systems . Job Role Responsibilities: Design and implement robust ETL pipelines using Azure Data Factory . Develop and maintain data models and warehouses with Azure Synapse and Azure SQL . Build scalable data processing solutions using Azure Functions . Create interactive dashboards and More ❯

Head Of Data Position A fast-growing, digitally transformed business is seeking a founding member of their data team to build and implement the infrastructure that will support their continued growth and success. Over the past two years, this organisation has adopted a wide range of cloud-based systems across finance, operations, project management, and sales. … experienced candidate to architect the pipelines and reporting structures that bring this vision to life. Working directly with senior leadership, you’ll have the opportunity to shape the data function from the ground up, with a clear path to building and leading your own team in the future. Key Responsibilities Data Architecture & Integration (50%) Design and … implement scalable data pipelines across multiple platforms (ERP, CRM, project management tools, etc.) Develop and maintain ETL/ELT processes to unify cross-functional datasets. Build foundational datasets and collaborate with senior leadership to define data architecture. Design for future scalability and cloud warehouse implementation Data Visualisation & Storytelling (25%) Build dynamic dashboards and reports More ❯