26 to 50 of 477 Data Pipeline Jobs in London

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations, FinTech and market data, with expertise … our professional, supportive and entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not only lead the design and … implementation of the data infrastructure that powers advanced analytics and data science across our platforms, but also contribute to the strategic direction, roadmap, and execution of data products in collaboration with senior stakeholders. Architect & Build Scalable Data Solutions Collaborate closely with senior product stakeholders to understand data needs and architect More ❯

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Data Engineer with Insurance experience to play a … key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You’ll help shape the data strategy, improve data quality, and empower the business to make data-driven decisions. As a Lead Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built More ❯

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Data Engineer with Insurance experience to play a … key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You’ll help shape the data strategy, improve data quality, and empower the business to make data-driven decisions. As a Lead Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built More ❯

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Data Engineer with Insurance experience to play a … key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You’ll help shape the data strategy, improve data quality, and empower the business to make data-driven decisions. As a Lead Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built More ❯

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Data Engineer with Insurance experience to play a … key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You’ll help shape the data strategy, improve data quality, and empower the business to make data-driven decisions. As a Lead Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built More ❯

Data Developer (Microsoft Fabric/Azure) Location: Essex or Southampton (on-site, parking available) Salary: £45,000 - £56,000 per annum The Opportunity La Fosse is partnering with a leading global logistics organisation on an exciting data transformation project. We’re seeking an experienced Data Developer to join a new three-person data … Systems. This role will play a key part in the company’s migration from QlikView to Microsoft Fabric, helping to design and deliver the next generation of their data environment using Azure technologies. Key Responsibilities Lead and support the QlikView → Microsoft Fabric migration Build and maintain ETL processes and data pipelines Develop scalable solutions in Azure … analytics Collaborate across teams to enhance data quality and governance Key Requirements Proven Microsoft Fabric and Azure Data Factory experience Strong ETL, data pipeline, and SQL skills Expertise in Power BI and data visualisation Background as a Data Developer/Data Engineer Experience migrating from QlikView (essential More ❯

Data Developer (Microsoft Fabric/Azure) Location: Essex or Southampton (on-site, parking available) Salary: £45,000 - £56,000 per annum The Opportunity La Fosse is partnering with a leading global logistics organisation on an exciting data transformation project. We’re seeking an experienced Data Developer to join a new three-person data … Systems. This role will play a key part in the company’s migration from QlikView to Microsoft Fabric, helping to design and deliver the next generation of their data environment using Azure technologies. Key Responsibilities Lead and support the QlikView → Microsoft Fabric migration Build and maintain ETL processes and data pipelines Develop scalable solutions in Azure … analytics Collaborate across teams to enhance data quality and governance Key Requirements Proven Microsoft Fabric and Azure Data Factory experience Strong ETL, data pipeline, and SQL skills Expertise in Power BI and data visualisation Background as a Data Developer/Data Engineer Experience migrating from QlikView (essential More ❯

Data Developer (Microsoft Fabric/Azure) Location: Essex or Southampton (on-site, parking available) Salary: £45,000 - £56,000 per annum The Opportunity La Fosse is partnering with a leading global logistics organisation on an exciting data transformation project. We’re seeking an experienced Data Developer to join a new three-person data … Systems. This role will play a key part in the company’s migration from QlikView to Microsoft Fabric, helping to design and deliver the next generation of their data environment using Azure technologies. Key Responsibilities Lead and support the QlikView → Microsoft Fabric migration Build and maintain ETL processes and data pipelines Develop scalable solutions in Azure … analytics Collaborate across teams to enhance data quality and governance Key Requirements Proven Microsoft Fabric and Azure Data Factory experience Strong ETL, data pipeline, and SQL skills Expertise in Power BI and data visualisation Background as a Data Developer/Data Engineer Experience migrating from QlikView (essential More ❯

Data Developer (Microsoft Fabric/Azure) Location: Essex or Southampton (on-site, parking available) Salary: £45,000 - £56,000 per annum The Opportunity La Fosse is partnering with a leading global logistics organisation on an exciting data transformation project. We’re seeking an experienced Data Developer to join a new three-person data … Systems. This role will play a key part in the company’s migration from QlikView to Microsoft Fabric, helping to design and deliver the next generation of their data environment using Azure technologies. Key Responsibilities Lead and support the QlikView → Microsoft Fabric migration Build and maintain ETL processes and data pipelines Develop scalable solutions in Azure … analytics Collaborate across teams to enhance data quality and governance Key Requirements Proven Microsoft Fabric and Azure Data Factory experience Strong ETL, data pipeline, and SQL skills Expertise in Power BI and data visualisation Background as a Data Developer/Data Engineer Experience migrating from QlikView (essential More ❯

Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents … demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and More ❯

Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents … demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and More ❯

Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents … demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and More ❯

Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents … demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and More ❯

Senior Data Engineer ( SQL/BigQuery/Airflow/Terraform ) London/Hybrid 70-80k base plus super and equity A fast-growing, data-driven organisation is seeking a Senior Data Engineer to design, build, and maintain scalable data infrastructure and workflows that power analytics and decision-making across the business. … This role suits an engineer who’s passionate about data warehousing, data operations, and cloud infrastructure, with strong technical foundations and a focus on delivering robust, production-ready solutions. This will suit an experienced Data Engineer with a passion for the modern tech stack and an appetite for AI, ideally from a start-up … re proactive, ambitious and ready to join a rocketship that’s well and truly taking off, this one is for you! Day to day responsibilities for the Senior Data Engineer ( SQL/BigQuery/Airflow/Terraform ) include : Build and maintain data pipelines and warehouse solutions using BigQuery (or similar cloud platforms). Write high-performance More ❯

Senior Data Engineer ( SQL/BigQuery/Airflow/Terraform ) London/Hybrid 70-80k base plus super and equity A fast-growing, data-driven organisation is seeking a Senior Data Engineer to design, build, and maintain scalable data infrastructure and workflows that power analytics and decision-making across the business. … This role suits an engineer who’s passionate about data warehousing, data operations, and cloud infrastructure, with strong technical foundations and a focus on delivering robust, production-ready solutions. This will suit an experienced Data Engineer with a passion for the modern tech stack and an appetite for AI, ideally from a start-up … re proactive, ambitious and ready to join a rocketship that’s well and truly taking off, this one is for you! Day to day responsibilities for the Senior Data Engineer ( SQL/BigQuery/Airflow/Terraform ) include : Build and maintain data pipelines and warehouse solutions using BigQuery (or similar cloud platforms). Write high-performance More ❯

Senior Data Engineer ( SQL/BigQuery/Airflow/Terraform ) London/Hybrid 70-80k base plus super and equity A fast-growing, data-driven organisation is seeking a Senior Data Engineer to design, build, and maintain scalable data infrastructure and workflows that power analytics and decision-making across the business. … This role suits an engineer who’s passionate about data warehousing, data operations, and cloud infrastructure, with strong technical foundations and a focus on delivering robust, production-ready solutions. This will suit an experienced Data Engineer with a passion for the modern tech stack and an appetite for AI, ideally from a start-up … re proactive, ambitious and ready to join a rocketship that’s well and truly taking off, this one is for you! Day to day responsibilities for the Senior Data Engineer ( SQL/BigQuery/Airflow/Terraform ) include : Build and maintain data pipelines and warehouse solutions using BigQuery (or similar cloud platforms). Write high-performance More ❯

Senior Data Engineer ( SQL/BigQuery/Airflow/Terraform ) London/Hybrid 70-80k base plus super and equity A fast-growing, data-driven organisation is seeking a Senior Data Engineer to design, build, and maintain scalable data infrastructure and workflows that power analytics and decision-making across the business. … This role suits an engineer who’s passionate about data warehousing, data operations, and cloud infrastructure, with strong technical foundations and a focus on delivering robust, production-ready solutions. This will suit an experienced Data Engineer with a passion for the modern tech stack and an appetite for AI, ideally from a start-up … re proactive, ambitious and ready to join a rocketship that’s well and truly taking off, this one is for you! Day to day responsibilities for the Senior Data Engineer ( SQL/BigQuery/Airflow/Terraform ) include : Build and maintain data pipelines and warehouse solutions using BigQuery (or similar cloud platforms). Write high-performance More ❯

Role Title: Pre-Sales & Data Solution Architect Business Unit/Segment: Data Management Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent Summary Our client, a leading global data and AI consultancy, is seeking a Pre-Sales & Data Solution Architect Lead - hybrid role to become one of their leaders in this … area in their Data Management practice with a focus on banking clients . This is a strategic, client-facing role where you will partner with senior stakeholders to modernise data platforms, accelerate cloud adoption, and drive measurable business value. The role combines technical leadership with consulting and pre-sales expertise . You will design enterprise data … as a trusted advisor, leading workshops and influencing senior stakeholders on strategy, roadmaps, and innovation. ETL/ELT & Data Engineering – Provide oversight on robust data pipeline and integration designs using SSIS, ADF, Informatica, or IBM DataStage. Data Governance & Quality – Define governance, metadata, and quality frameworks using tools such as Unity Catalog, Profisee, Alation More ❯

Role Title: Pre-Sales & Data Solution Architect Business Unit/Segment: Data Management Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent Summary Our client, a leading global data and AI consultancy, is seeking a Pre-Sales & Data Solution Architect Lead - hybrid role to become one of their leaders in this … area in their Data Management practice with a focus on banking clients . This is a strategic, client-facing role where you will partner with senior stakeholders to modernise data platforms, accelerate cloud adoption, and drive measurable business value. The role combines technical leadership with consulting and pre-sales expertise . You will design enterprise data … as a trusted advisor, leading workshops and influencing senior stakeholders on strategy, roadmaps, and innovation. ETL/ELT & Data Engineering – Provide oversight on robust data pipeline and integration designs using SSIS, ADF, Informatica, or IBM DataStage. Data Governance & Quality – Define governance, metadata, and quality frameworks using tools such as Unity Catalog, Profisee, Alation More ❯

Role Title: Pre-Sales & Data Solution Architect Business Unit/Segment: Data Management Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent Summary Our client, a leading global data and AI consultancy, is seeking a Pre-Sales & Data Solution Architect Lead - hybrid role to become one of their leaders in this … area in their Data Management practice with a focus on banking clients . This is a strategic, client-facing role where you will partner with senior stakeholders to modernise data platforms, accelerate cloud adoption, and drive measurable business value. The role combines technical leadership with consulting and pre-sales expertise . You will design enterprise data … as a trusted advisor, leading workshops and influencing senior stakeholders on strategy, roadmaps, and innovation. ETL/ELT & Data Engineering – Provide oversight on robust data pipeline and integration designs using SSIS, ADF, Informatica, or IBM DataStage. Data Governance & Quality – Define governance, metadata, and quality frameworks using tools such as Unity Catalog, Profisee, Alation More ❯

Senior Data Engineer (Python/AWS) Full-time | London, UK Hybrid working: 2-3 days per week on-site Must be SC cleared, or eligible to obtain SC-level security clearance Job description We are looking for a developer with expertise in Python, AWS Glue, step function, EMR cluster and redshift, to join our AWS Development Team. You … be required as part of the interview process. Key responsibilities Hands-on experience in Python programming is essential Responsible for Build, Test and Maintain optimal AWS data pipeline architecture. Building AWS glue, step function, AWS Lambda functions and unit test Work with fellow developers, data architects, data analysts and data scientists … application infrastructure, suggesting changes to it Define and document best practices and strategies regarding application deployment and infrastructure maintenance Define service capacity planning strategies Implement the application's CICD pipeline using the AWS CICD stack Project tasks deliverables and management Deliver on project progress and ensure adherence to client expectation Communications, including deck writing Delivery of output Gathering of More ❯

Senior Data Engineer Would you like to ensure the successful delivery of the Data Platform and Software Innovations? Do you enjoy creating a collaborative and customer-focused working environment? About Team: LexisNexis Intellectual Property, which serves customers in more than 150 countries with 11,300 employees worldwide, is part of RELX, a global provider of information … based analytics and decision tools for professional and business customers. About Role: As a Senior Data Engineer at LexisNexis Intellectual Property (LNIP), you will play a key role in delivering high-quality, scalable data solutions that power our Strategic Data Platform - the backbone for products like PatentSight+ and other analytics offerings. In this role … you will not only design and implement robust data pipelines but also mentor junior team members, drive engineering best practices, and support the delivery of customer-facing datasets via Databricks , APIs , and event-driven systems . You'll take ownership of complex engineering tasks, contribute to architectural decisions, and collaborate with stakeholders across engineering, product, and domain teams. More ❯

complexity manageable and insight actionable - supporting everything from premium and ads growth to forecasting, experimentation, and global reporting. Location London Job type Permanent As engineers in the Financial Data Platform team, we turn messy, fragmented realities into clean, reusable foundations. We build core datasets that represent key financial domains like Premium, Ads, and Royalties. We create libraries and … tools that empower others to produce and trust financial data at scale. We collaborate deeply with Finance, Product, and Data teams to unlock clarity and drive Spotify's ambitions forward. We are looking for engineers who are excited to shape the future of financial data at Spotify. You will design and operate scalable pipelines … that process billions of records. You will apply product thinking to financial data - managing the full lifecycle from sourcing to documentation to exposure. You will define abstractions that simplify complexity and create intuitive paths for our consumers. Together, we advocate for standards, champion quality, and build systems that others can rely on with confidence. If you thrive on More ❯

Robert Half Technology are assisting a market leading financial services organisation to recruit a Data Engineer on a contract basis. Outside IR35. Hybrid working - London based. Role The Data Engineer will design, develop, and maintain data infrastructure to ensure reliability, scalability, and performance. Collaborate with data scientists and analysts to fulfil their … data requirements and support their work. Collect and process datasets from various sources, ensuring data quality and … integrity. Implement efficient data models and schemas for storage and retrieval. Optimise data processes for improved performance and efficiency. Troubleshoot and resolve data pipeline issues swiftly and effectively. Keep abreast of industry trends and emerging technologies in data engineering, and continuously improve your skills and knowledge. Profile The Data More ❯

Energy Domain is a must. Under 7 years of experience only. Permanent. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools Build and optimise ETL/ELT processes to handle small to … large-scale data processing requirements Develop data models and schemas that support analytics, business intelligence and product needs Monitor, troubleshoot, and optimise data pipeline performance and reliability Collaborate with stakeholders, analysts and product team to understand data requirements Implement data quality checks and validation processes to ensure data … Participate in architecture decisions and contribute to technical roadmap planning Technical Skills: Great SQL skills with experience in complex query optimization Strong Python programming skills with experience in data processing libraries (pandas, NumPy, Apache Spark) Hands-on experience building and maintaining data ingestion pipelines Proven track record of optimising queries, code, and system performance Experience with More ❯