101 to 125 of 1,579 Data Pipeline Jobs in London

Data Architect (Associate Data Architect I) Join to apply for the Data Architect (Associate Data Architect I) role at UST Data Architect (Associate Data Architect I) 2 days ago Be among the first 25 applicants Join to apply for the Data Architect (Associate Data … implement scalable data solutions. About The Role The ideal candidate will have a solid background in data engineering, cloud data architecture, and ETL pipeline development, with a focus on enabling data-driven decision-making across the organization. Key Responsibilities Design, build, and maintain scalable data pipelines and ETL processes … experience in Data Architecture/Data Engineering roles. Proven experience with Google Cloud Platform (GCP) data services. Strong hands-on skills in ETL pipeline development, data modeling, and performance tuning. Deep understanding of cloud-based data architecture, including data lakes and warehouses. Proficient in SQL, Python, or More ❯

Data Engineer, Japan Consumer Innovation (JCI), JP Science and Data Technologies Are you passionate about working with data and eager to make broad business impact in the rapidly evolving e-commerce business? Are you interested in building data and science solutions to drive strategic direction? Based in Tokyo, the Science and Data Technologies team designs, builds, operates, and scales the data infrastructure powering Amazon's retail business in Japan. Working with a diverse, global team serving customers and partners worldwide, you can make a significant impact while continuously learning and experimenting with cutting-edge technologies. The ideal data engineer thrives on working with large-scale data, excels in highly complex technical environments, and above all, has a passion for data. You will lead the development of data solutions to optimize Amazon's retail operations in Japan, turning business needs into robust data pipelines and architecture. Leveraging your deep experience in data infrastructure and passion for enabling data More ❯

and building platforms that handle the complexity of modern cruising — all while keeping things collaborative and fun. ⭐ Your Mission: Are you passionate about unlocking the power of customer data? We're looking for a talented Lead Data Engineer to spearhead the design, development, and optimisation of our critical CRM and customer data transformation. You … ll play a pivotal role in building the data foundations for advanced analytics, personalised customer experiences, and effective marketing activation. As a senior member of the team, you will lead data engineers and champion best practices within our data environment. 🎯 What You'll Do: Design & Build: Architect, build, test, and deploy robust, scalable, and … Guide: Provide technical leadership to data engineers, fostering their growth and ensuring high standards in coding, testing, and documentation. Optimise: Continuously monitor and improve data pipeline performance, reliability, and cost-efficiency. Document: Create and maintain clear, comprehensive documentation for data models, pipeline architecture, and processes. 🔧 What You'll Be Responsible For: The More ❯

and building platforms that handle the complexity of modern cruising - all while keeping things collaborative and fun. Your Mission: Are you passionate about unlocking the power of customer data? We're looking for a talented Lead Data Engineer to spearhead the design, development, and optimisation of our critical CRM and customer data transformation. You … ll play a pivotal role in building the data foundations for advanced analytics, personalised customer experiences, and effective marketing activation. As a senior member of the team, you will lead data engineers and champion best practices within our data environment. What You'll Do: Design & Build: Architect, build, test, and deploy robust, scalable, and … Guide: Provide technical leadership to data engineers, fostering their growth and ensuring high standards in coding, testing, and documentation. Optimise: Continuously monitor and improve data pipeline performance, reliability, and cost-efficiency. Document: Create and maintain clear, comprehensive documentation for data models, pipeline architecture, and processes. What You'll Be Responsible For: The More ❯

that drive innovation and transform businesses. From prototype to real-world impact - be part of a global shift by doing work that matters. Job Description Role Overview A Data Engineering Consultant designs, implements, and optimizes scalable data pipelines and architectures. This role bridges raw data and actionable insights … ensuring robustness, performance, and data governance. Collaboration with analysts and scientists is central to delivering high-quality solutions aligned with business objectives. Key Responsibilities Data Pipeline Development Architect, implement and maintain real-time and batch data pipelines to handle large datasets efficiently. Employ frameworks such as Apache Spark, Databricks, Snowflake or Airflow to …/ELT workflows, validation checks, and cleaning steps for data reliability. Automation & Process Optimization Automate data reconciliation, metadata management, and error-handling procedures. Continuously refine pipeline performance, scalability, and cost-efficiency. Collaboration & Leadership Coordinate with Data Scientists, Data Architects, and Analysts to ensure alignment with business goals. Mentor junior engineers and More ❯

who will work with Head of Data and Enterprise architecture to build data engineering process in AWS using modern tech stack. Responsibilities Data Pipeline Development : Design, build, and maintain scalable data pipelines to ingest, process, and store large sets of financial data from various internal and external sources. Cloud … security, and performance of data pipelines and integrations. Documentation & Best Practices : Maintain clear, well-organised documentation for all data engineering projects, including data pipeline processes, cloud infrastructure, and codebase. Data Governance & Security : Implement and enforce data governance policies and security practices, ensuring compliance with financial regulations and protecting sensitive … financial data. Troubleshooting & Optimisation : Monitor and troubleshoot data pipeline performance, addressing bottlenecks or issues promptly to ensure smooth data flow and operation. Requirements Several years of experience in data engineering, preferably in the financial services or similar regulated industries. Strong understanding of data engineering concepts, including data modelling, ETL More ❯

Job Description Job Title: QA Tester – ETL Testing (Informatica) & Azure Data Engineering Location: Westminster, London Type: Full-time Department: Quality Assurance/Data Engineering Reporting to: Data Engineering Lead Job Summary: We are looking for a skilled and detail-oriented QA Tester with hands-on experience in ETL testing (Informatica or Microsoft Fabric) and … a strong understanding of Azure Data Engineering tools such as Azure SQL Database , Azure Blob Storage , and Azure Data Factory . The ideal candidate will possess good hands-on knowledge of … writing and executing SQL queries to validate data across systems. Experience in Microsoft Fabric is considered a strong bonus. Key Responsibilities: Perform ETL/data pipeline testing using Informatica PowerCenter or IICS . Validate data ingestion , transformation , and loading processes across Azure services. Execute source-to-target data validation , data More ❯

quo. We’re fueled by positive energy, fostering a culture of openness and doing the right thing. Both for people and the planet. About the role As Senior Data Engineer at Beams, you will play a crucial role in designing, building, and optimising our data infrastructure to support transformative insights, machine learning, generative AI, and data-driven decisions across the organisation. You’ll lead the development of scalable, reliable data pipelines and warehousing solutions on AWS (or GCP), ensuring our data ecosystem can seamlessly adapt to the growing needs of the business. Your work will be essential in making data a central, accessible asset that empowers every team … Lambda, S3, Redshift, and Step Functions. Strong knowledge of data modelling, ETL/ELT frameworks, and data warehousing best practices. Experience with data pipeline orchestration and automation. Excellent problem-solving skills and a proactive approach to designing scalable solutions. Excellent communication skills, both written and verbal. Desirable things we like Experience with MLOps More ❯

you want to make a life-changing impact on Customers, there's nowhere better to develop your career. Main Purpose of Role The role is crucial in transforming data by bridging data warehousing and business analysis into robust data solutions for analytical consumption for key stakeholders. The role will be responsible for working to … build out and improve the company's data ingestion, transformation, transactional and data warehousing needs directly supporting the data science and analyst teams. This role is essential to building and scaling new and existing local data streams to support PML's growing data products and services. In addition to this … adhere to enterprise data analytics guidelines and utilize appropriate tooling. Skills, Experience and Competencies Required 8 years+ SME experience Strong skills in data architecture and pipeline development, with extensive experience in SQL and Python; PowerBI knowledge is a plus. Experience with ETL/ELT tools (e.g., Matillion, DBT). Strong understanding of data More ❯

Director , Data Governance Location: Global Reporting to: VP – Data Excellence WHO WE ARE Choreograph is WPP’s global data products and technology company. Our mission is to transform marketing by building the fastest, most connected data platform that bridges marketing strategy to scaled activation. We partner with agencies and clients to unlock … the full value of data by combining technology, data, and analytics expertise. This is delivered through the Open Media Studio, an AI-enabled media and data platform designed for the future of advertising. Our team of over 1,000 thinkers, builders, creators, and problem-solvers spans 20 markets worldwide, driving innovation and excellence in … Modelling , and visualization teams to ensure data governance principles are integrated into all aspects of the data platform development and operation. Data Pipeline Governance: Implement governance controls over data pipelines, ensuring data lineage, data quality, and security are maintained throughout the data flow. Data More ❯

Reporting to one of our Lead Data & Analytics Engineers , our Data Engineer will work as part of a multi-disciplinary, agile, data delivery team focused on the delivery of innovative, robust, and efficient data solutionsto complex business problems. You'll work alongside a team of passionate data professionals including other … data and analytics engineers, test engineers, data scientists and data visualisation specialists. Our priority is the delivery ofhigh-quality, well-modelled, clean, and trustworthy data assetsfor use across the business. Our data teams also work hard to support all our data assets and ensure the business realise maximum … solution irrespective of underlying technology. Experience using cloud data warehouse technology would also be beneficial - Snowflake (preferred), Google BigQuery, AWS Redshift or Azure Synapse. Data Pipeline(highly desirable): Demonstrable experience working with data from a wide variety of data sources including different database platforms, flat files, API’s and event-driven More ❯

My client is based in the London area are currently looking to recruit for an experienced Lead GCP Data Architect to join their team. They are one of the leaders within the consulting space and are currently going through a period of growth and are looking for an experienced Lead Data Architect to join their team.They … AI within their organisation are looking to utilise the newest technologies on the market. Your role will include: Enterprise Architecture & Delivery: Spearhead the design and implementation of scalable data ecosystems-spanning data lakes, lakehouses, and warehouses-leveraging platforms such as GCP, BigQuery Snowflake, Synapse, or Microsoft Fabric. Cloud Transformation Strategy: Lead cloud adoption and modernization initiatives … grade data modeling using tools like ERwin, PowerDesigner, or ER/Studio, ensuring models are optimized for performance, scalability, and long-term maintainability. Data Integration & Pipeline Engineering: Design and implement resilient ETL/ELT workflows using technologies such as BigQuery, Dataflow, Informatica, or IBM DataStage, supporting both real-time and batch data processing. More ❯

My client is based in the London area are currently looking to recruit for an experienced Lead GCP Data Architect to join their team. They are one of the leaders within the consulting space and are currently going through a period of growth and are looking for an experienced Lead Data Architect to join their team.They … AI within their organisation are looking to utilise the newest technologies on the market. Your role will include: Enterprise Architecture & Delivery: Spearhead the design and implementation of scalable data ecosystems-spanning data lakes, lakehouses, and warehouses-leveraging platforms such as GCP, BigQuery Snowflake, Synapse, or Microsoft Fabric. Cloud Transformation Strategy: Lead cloud adoption and modernization initiatives … grade data modeling using tools like ERwin, PowerDesigner, or ER/Studio, ensuring models are optimized for performance, scalability, and long-term maintainability. Data Integration & Pipeline Engineering: Design and implement resilient ETL/ELT workflows using technologies such as BigQuery, Dataflow, Informatica, or IBM DataStage, supporting both real-time and batch data processing. More ❯

Get AI-powered advice on this job and more exclusive features. Direct message the job poster from Glocomms AVP Recruitment Consultant - Hiring Data Science, Machine Learning, Data Engineering & Data Analytics experts across the EU Job title: Senior Data Solutions Architect Type: Contract Duration: 12 months Location: London, UK (Hybrid) Daily rate: DOE … Description: We're working with a large, established client in the Banking sector who are looking to welcome Senior Data Solutions Architects onto the team as they undergo a large transformation program. Key responsibilities: Take ownership of designing solution architectures, crafting strategic roadmaps for evolution, and overseeing the successful implementation of technology solutions that align with business objectives … designs , ensuring they meet functional requirements and align with long-term technology roadmaps . Oversee architecture management , driving continuous refinement and improvement of systems. Work with cutting-edge data technology stacks and cloud infrastructure, balancing foundational data solutions with emerging AI and ML capabilities . Collaborate with delivery teams and engineers to define project scopes and More ❯

Job Title: Contract Senior QA Engineer – Data Analysis Contract Length: 12 Months (with potential extension) Day Rate: Up to £500 per day (Inside IR35) Start Date: ASAP About The Role I'm seeking a highly skilled Senior QA Engineer with strong experience in data analysis, quality and validation to join an outstanding flagship digital team on … a contract basis. You’ll play a key role in ensuring the accuracy, reliability, and performance of their data pipelines and analytics products. This is an excellent opportunity to work with a cross-functional team of … engineers, analysts, and data scientists in a fast-paced environment where quality and precision are critical. Key Responsibilities Design, develop, and execute test plans for ETL pipelines, data transformations, and analytics products Develop automated tests and validation tools for data integrity, accuracy, completeness, and performance Identify, document, and track defects in large-scale data More ❯

Curve is a next-gen insights, analytics and technology consultancy that leverages digital consumer data and advanced technology to help businesses unlock consumer opportunities. Digital consumer data is powerful; it's big, it's real, and it's always updating. We use a combination of in-house technology and bespoke solutions, powered by AI, to transform … data from sources such as Social, Reviews, Search, and broader marketing and sales data. These reveal fresh insights for our clients; helping them to build better products and brands, to deliver effective marketing to consumers. Our software, machine learning and AI are key to how we deliver impact, centred on: Natural Language Processing, GPT & other LLMs : unearthing trends … themes and other patterns from large text-based data sets, and deploying state-of-the-art AI to automate and empower consumer facing businesses and their insights & analytics functions Marketing Data Science & Personalisation : using first party consumer data to understand each client's consumer base, building personalisation and other machine learning models to better More ❯

Management. Own business-wide initiatives including the implementation of Salesforce, to support initially the delivery of CRM capability across the UK Business. Therefore, we are looking for a Data Engineer to join a growing team to support Data Migration activity, ensuring seamless integration and data flow between new and legacy systems. Requirements: Must Have … 3+ years of experience) Strong experience with data integration and migration, particularly with Salesforce. Experience with programming languages such as Python, C#, or PowerShell. Strong experience in writing text cleansing routines in Databricks Python/SQL and the ability to measure data quality/execute data validation tests, ideally in Databricks. Proficiency in Azure … data services, including Azure Data Factory, Azure Data Lake Storage, and Azure Databricks. Proficiency in building pipelines and utilising python/SQL within Databricks. Experience with DevOps practices, including CI/CD, unit testing, and version control. Excellent written and verbal communication skills. A minimum of 2 years of experience in a data More ❯

Job Description My client, based in the London area, is currently looking to recruit an experienced Lead GCP Data Architect to join their team. They are a leader within the consulting space, experiencing growth and looking to enhance their team. Backed by a major multi-asset firm, they aim to strengthen their financial position and are adopting cutting … in enterprise-grade data modeling with tools like ERwin, PowerDesigner, or ER/Studio, ensuring models are optimized for performance, scalability, and maintainability. Data Integration & Pipeline Engineering: Design and implement resilient ETL/ELT workflows using technologies such as BigQuery, Dataflow, Informatica, or IBM DataStage, supporting real-time and batch processing. Governance & Data … Leadership & Talent Development: Mentor global, cross-functional teams of data professionals, fostering innovation, excellence, and continuous learning. The right candidate will have: Extensive coding, data pipeline building, digital transformation, and ingestion experience within GCP. Understanding of presales activities, workshops, budgets, proposals, etc. Strong knowledge of data modeling (physical, logical, conceptual). Understanding of More ❯

Job Title: Data Engineer (Fabric, Synapse & ADF) Location: Remote (UK-based candidates only) Contract: 3–6 Month Rolling Contract IR35 Status: Outside IR35 Day Rate: £500–£600 per day Overview: We’re looking for an experienced Data Engineer to join a dynamic team working across a variety of exciting data projects. This role involves … a blend of greenfield builds, brownfield enhancements, and support of existing solutions, giving you the chance to work across the full data engineering lifecycle. This is a remote-based position, open to UK-based candidates only, and is offered on an Outside IR35 basis. Key Responsibilities: Design, build, and maintain scalable data pipelines using Microsoft Fabric … Azure Synapse, and Azure Data Factory (ADF). Develop and optimise ETL/ELT processes to support business intelligence and analytics solutions. Collaborate with data architects, analysts, and stakeholders to understand business requirements and translate them into technical solutions. Contribute to the modernisation of legacy data platforms and assist in greenfield implementations. Ensure data More ❯

Job Title: Data Engineer (Fabric, Synapse & ADF) Location: Remote (UK-based candidates only) Contract: 3–6 Month Rolling Contract IR35 Status: Outside IR35 Day Rate: £500–£600 per day Overview: We’re looking for an experienced Data Engineer to join a dynamic team working across a variety of exciting data projects. This role involves … a blend of greenfield builds, brownfield enhancements, and support of existing solutions, giving you the chance to work across the full data engineering lifecycle. This is a remote-based position, open to UK-based candidates only, and is offered on an Outside IR35 basis. Key Responsibilities: Design, build, and maintain scalable data pipelines using Microsoft Fabric … Azure Synapse, and Azure Data Factory (ADF). Develop and optimise ETL/ELT processes to support business intelligence and analytics solutions. Collaborate with data architects, analysts, and stakeholders to understand business requirements and translate them into technical solutions. Contribute to the modernisation of legacy data platforms and assist in greenfield implementations. Ensure data More ❯

Join to apply for the Lead Data Engineer role at Supermercados Guanabara 5 days ago Be among the first 25 applicants Join to apply for the Lead Data Engineer role at Supermercados Guanabara Role – Lead Data Engineer Location – Hybrid, 2 days onsite in Telford Salary - £80,000 to £100,000 Start - ASAP The Opportunity … of the UK's leading defence systems integrators on a key recruitment drive to support a major UK Government programme. This is an exciting opportunity for a Lead Data Engineer to play a central role in the design, development, and leadership of high-impact data solutions across cutting-edge government and defence projects. The role offers … is anticipated as working patterns and stakeholder relationships mature. Working in a collaborative and agile environment, this role will see you leveraging your technical expertise to solve complex data challenges, influence architectural direction, and mentor teams, all while enjoying hybrid working arrangements and long-term career progression. The Role As the Lead Data Engineer, you will More ❯

savings market via deposit aggregators in August 2023, followed by the launch of its direct-to-customer retail banking proposition in December 2024. We are seeking a skilled Data Engineer with a strong focus on modern data warehousing , data product development , and data democratization . You will play a key role in … designing, building, and optimizing scalable data pipelines and clean data layers that empower teams across the organization to make informed, data-driven decisions. This is a hands-on role that blends engineering excellence with product thinking, metadata management, and a passion for enabling self-service analytics and data literacy across the business. … Key Responsibilities: Build & Maintain Scalable Data Warehousing Solutions: Design, build, and maintain robust ELT pipelines and transformation workflows Model and maintain curated data layers to support reporting, analytics, and decision-making Ensure high availability, scalability, and performance of data warehouse systems (cloud-based, e.g., Redshift) Develop & Manage Data Products: Collaborate with business More ❯

Join to apply for the Azure Data Engineer - SC Cleared role at ShareForce . This is an exciting contract opportunity for an SC Cleared Azure Data Engineer to join an experienced team in a new customer engagement working at the forefront of data analytics and Artificial Intelligence. Our client equips ambitious organisations with enduring … control of their data and AI evolution. This role is an opportunity to lead the build of bespoke data systems for our clients. Responsibilities Design and implement scalable data pipelines and ETL processes using Azure and Databricks technologies including Delta Live Tables. Lead technical discussions with clients and stakeholders to gather requirements and propose … solutions. Help clients realise the potential of data science, machine learning, and scaled data processing within Azure/Databricks ecosystem. Mentor junior team members and support their personal development. Take ownership for the delivery of core solution components. Support with planning, requirements refinement and work estimation. Skills and Experiences Design and develop end-to-end data More ❯

Our client specializes in the workplace science sector and is currently seeking a Data Engineer to help build scalable, high-performance applications that transform the modern workplace. We are looking for someone who is excited about solving complex problems, working with cutting-edge technology, and driving innovation in a fast-paced SaaS environment. What you will do: Design … build, and maintain scalable data pipelines and cloud-native infrastructure. Integrate structured and unstructured data from various sources into data lakes and warehouses. Ensure data quality, consistency, and compliance through strong governance and validation frameworks. Manage and optimize data warehouses, lakes, and databases to support analytics and business intelligence. Develop … automated dashboards and visualizations to deliver real-time insights to stakeholders. Identify and resolve data issues to improve accessibility, accuracy, and usability. Educate and support teams in leveraging data effectively, translating technical concepts into clear, actionable insights. Collaborate cross-functionally to align data strategy with business objectives. What we're looking for: 3+ years More ❯

Senior Data Platform Engineer - 12 month FTC Funding Circle London, United Kingdom Apply now Posted 2 days ago Hybrid Job Contract Competitive Senior Data Platform Engineer We are looking for a Senior Data Platform Engineer to join our Data Platform Engineering team which sits under Tech and Data. Data is … the finance they need to grow. With more than a decade of expertise under our belt, we've built a game-changer of a platform with cutting-edge data and technology that's reshaping the landscape of SME lending. Say goodbye to lengthy applications and hello to lightning-fast decisions! In just minutes, SMEs across the UK can … ourselves on providing meaningful, human support as well as fast, hassle free processes to deliver an unbeatable customer experience. The role Participate in design decisions and implementation of data platform tools and infrastructure Ensure systems follow the agreed principles and architecture defined at Funding Circle Actively contribute to initiatives to enhance data quality, data More ❯