76 to 100 of 276 Data Pipeline Jobs in London

an experienced and strategic SAP Professional to lead the design, implementation, and optimization of solutions using SAP Datasphere. This role will be responsible for managing and implementing cloud data integration, analytics strategy, and ensuring business insights are delivered effectively across the organization. It is also expected the candidate should have fair knowledge of SAP S4/HANNA Professional … Services processes. This position reports to a TCS Engagement Manager, working in strong collaboration with all other client stakeholders but especially with the Product Owners, Data CoE and other Architects. As such, the role provides broad exposure to business stakeholders, and requires strong business process knowledge on Professional Services. Key Responsibilities: * Architect, manage maintain the enterprise data landscape within SAP Datasphere, ensuring scalable, secure, and high-performance data environments. * Design and implement complex data models that support both operational and analytical use cases, leveraging advanced features such as spaces, views, and semantic modelling. * Lead data integration initiatives, orchestrating seamless ingestion and harmonization of data from SAP (e.g. More ❯

We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you. Role Title: Data Engineer Location: London (Hybrid) Duration: Until 31/12/2025 Rate: £358 per day Inside IR35 (Umbrella) Role Description: To build and maintain the systems that collect, store … process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities: Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Skillset Required: Experience in Python, PySpark and SQL Experience with AWS is a plus Strong proficiency in Core Java, including Collections, Concurrency, and Memory Management. Proficient in version control systems such as Git, GitLab, or More ❯

We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you. Role Title: Data Engineer Location: London (Hybrid) Duration: Until 31/12/2025 Rate: £358 per day Inside IR35 (Umbrella) Role Description: To build and maintain the systems that collect, store … process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities: Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Skillset Required: Experience in Python, PySpark and SQL Experience with AWS is a plus Strong proficiency in Core Java, including Collections, Concurrency, and Memory Management. Proficient in version control systems such as Git, GitLab, or More ❯

We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you. Role Title: Data Engineer Location: London (Hybrid) Duration: Until 31/12/2025 Rate: £358 per day Inside IR35 (Umbrella) Role Description: To build and maintain the systems that collect, store … process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities: Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Skillset Required: Experience in Python, PySpark and SQL Experience with AWS is a plus Strong proficiency in Core Java, including Collections, Concurrency, and Memory Management. Proficient in version control systems such as Git, GitLab, or More ❯

We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you. Role Title: Data Engineer Location: London (Hybrid) Duration: Until 31/12/2025 Rate: £358 per day Inside IR35 (Umbrella) Role Description: To build and maintain the systems that collect, store … process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities: Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Skillset Required: Experience in Python, PySpark and SQL Experience with AWS is a plus Strong proficiency in Core Java, including Collections, Concurrency, and Memory Management. Proficient in version control systems such as Git, GitLab, or More ❯

Lead AWS Data Engineer/Architect - Databricks - LondonI'm working with a globally renowned financial services client that are looking for a seasons Data professional. My client are seen as leaders and pioneers within their relative field but also, a very well known house hold name. They have operations in near enough every country and despite … best companies to work for along side many other outstanding accolades. This is a hands on technical role. The successful applicant will be building and maintaining AWS Data pipelines and infrastructure. This is while working with cross functional teams to design best in Class data solutions across the business. As a business, they are very mature … within their data services however, there is always room for improvements so we're looking for an expert to not look to be involved in new processes but equally, help to reverse engineer the existing platform to increase efficiency and performance.This is a salaried position paying up to £130k as a base salary. It's hybrid working with More ❯

Lead AWS Data Engineer/Architect - Databricks - London I'm working with a globally renowned financial services client that are looking for a seasons Data professional. My client are seen as leaders and pioneers within their relative field but also, a very well known house hold name. They have operations in near enough every country and … best companies to work for along side many other outstanding accolades. This is a hands on technical role. The successful applicant will be building and maintaining AWS Data pipelines and infrastructure. This is while working with cross functional teams to design best in Class data solutions across the business. As a business, they are very mature … within their data services however, there is always room for improvements so we're looking for an expert to not look to be involved in new processes but equally, help to reverse engineer the existing platform to increase efficiency and performance. This is a salaried position paying up to £130k as a base salary. It's hybrid working More ❯

My client is based in the London area are currently looking to recruit for an experienced Data Engineer to join their team. They are one of the leaders within their space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by … will allow them to implement and utilise the most in demand and cutting edge technology on the market right now. Your role will include: Building and maintaining scalable data workflows that connect various internal platforms, including customer management, HR, and financial systems.Automate data ingestion and transformation processes using contemporary cloud-based technologies.Apply rigorous data quality checks and cleansing procedures to maintain integrity across datasets.Data Structuring & Enrichment Work closely with architecture teams to define unified data representations across business areas.Develop comprehensive datasets tailored for reporting and advanced analytics.Harmonise performance indicators to enable consistent insights across departments.Infrastructure & Workflow Automation Ensure data workflows are modular, version-controlled, and integrated with automated More ❯

An exciting digital agency in London is looking for a Data Engineer to support their growing data and analytics function on a part-time contract basis. Location: London Office policy: 1 day per week in London, remote otherwise Contract length: 3 months initially Start date: ASAP, first round interviews this week Day rate: £390pd Outside IR35 … Working pattern: 3 days per week The Job Build and maintain scalable data pipelines and a centralised Data Warehouse Develop and optimise Looker dashboards for client reporting Leverage Supermetrics Intelligence Cloud for data blending and integrations Work with Google APIs and other connectors to streamline data flows Partner closely with clients to … members in south Africa You Strong experience as a Data Engineer or Data Analyst, ideally from an agency background Hands-on with data pipeline design, warehousing, and dashboarding tools Skilled with Looker, Supermetrics, and Google APIs Confident managing clients and balancing multiple accounts Comfortable working part-time, but committed to contributing fully to More ❯

to achieve this for a 7th time across the coming period. Due to these increasing levels of high activity, they are generating more and more customer and performance data than ever before and are embarking on a key project to best manage & utilise this. An agile and robust data management and utilisation plan will be key … e.g., star/snowflake schemas) Administer Microsoft Fabric Lakehouse and Azure services Optimise performance across queries, datasets, and pipelines Apply data validation, cleansing, and standardisation rules Document pipeline logic and contribute to business-wide metadata catalogues Collaborate with BI, Change, and Product teams to align data outputs to needs Support groundwork for future data … requirements clearly across business teams will be key to success in this role. You’ll be a technically strong data professional with hands-on experience in pipeline development, cloud-based data infrastructure, and performance optimisation. You will be at your best when working collaboratively in fast-paced environments and when translating complex business needs More ❯

remote Benefits: Healthcare and great holidays The Role As a Machine Learning Operations Engineer, you will be instrumental in designing, deploying, and maintaining machine learning systems that drive data-driven decision-making in the pensions and financial services sector. Using Azure's cloud ecosystem, you will build scalable ML workflows that support actuarial modelling, risk prediction, and client … classification, regression, ensemble methods, survival models) to improve predictions and automate core processes. 2. MLOps & Model Lifecycle Management * Own the end-to-end ML lifecycle using Azure ML pipelines, Data Factory (ADF), and ML tracking tools. * Implement CI/CD pipelines with Azure DevOps, ensuring robust version control, testing, and seamless deployment. * Monitor production ML systems for performance … data drift, and anomalies using Azure Monitor or other observability tools. * Schedule and automate model retraining pipelines to maintain performance over time. 3. Data Engineering & Preprocessing * Develop and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Data Lake, and SQL. * Prepare and preprocess large datasets to ensure More ❯

Our Client has a requirement for a Data Engineer , who will be required to work on a contract basis Remote working . Role Purpose: We are … seeking an experienced Data Engineer to design, build, and optimize data solutions using the Microsoft technology stack. The role focuses on developing scalable ETL pipelines, data models, and cloud-based solutions leveraging Azure Data Factory, Azure Synapse, Azure SQL, and Azure Functions . The ideal candidate will have a proven background in … data engineering, cloud architecture, and enterprise data systems . Job Role Responsibilities: Design and implement robust ETL pipelines using Azure Data Factory . Develop and maintain data models and warehouses with Azure Synapse and Azure SQL . Build scalable data processing solutions using Azure Functions . Create interactive dashboards and More ❯

Head Of Data Position A fast-growing, digitally transformed business is seeking a founding member of their data team to build and implement the infrastructure that will support their continued growth and success. Over the past two years, this organisation has adopted a wide range of cloud-based systems across finance, operations, project management, and sales. … experienced candidate to architect the pipelines and reporting structures that bring this vision to life. Working directly with senior leadership, you’ll have the opportunity to shape the data function from the ground up, with a clear path to building and leading your own team in the future. Key Responsibilities Data Architecture & Integration (50%) Design and … implement scalable data pipelines across multiple platforms (ERP, CRM, project management tools, etc.) Develop and maintain ETL/ELT processes to unify cross-functional datasets. Build foundational datasets and collaborate with senior leadership to define data architecture. Design for future scalability and cloud warehouse implementation Data Visualisation & Storytelling (25%) Build dynamic dashboards and reports More ❯

Head Of Data Position A fast-growing, digitally transformed business is seeking a founding member of their data team to build and implement the infrastructure that will support their continued growth and success. Over the past two years, this organisation has adopted a wide range of cloud-based systems across finance, operations, project management, and sales. … experienced candidate to architect the pipelines and reporting structures that bring this vision to life. Working directly with senior leadership, you’ll have the opportunity to shape the data function from the ground up, with a clear path to building and leading your own team in the future. Key Responsibilities Data Architecture & Integration (50%) Design and … implement scalable data pipelines across multiple platforms (ERP, CRM, project management tools, etc.) Develop and maintain ETL/ELT processes to unify cross-functional datasets. Build foundational datasets and collaborate with senior leadership to define data architecture. Design for future scalability and cloud warehouse implementation Data Visualisation & Storytelling (25%) Build dynamic dashboards and reports More ❯

Head Of Data Position A fast-growing, digitally transformed business is seeking a founding member of their data team to build and implement the infrastructure that will support their continued growth and success. Over the past two years, this organisation has adopted a wide range of cloud-based systems across finance, operations, project management, and sales. … experienced candidate to architect the pipelines and reporting structures that bring this vision to life. Working directly with senior leadership, you’ll have the opportunity to shape the data function from the ground up, with a clear path to building and leading your own team in the future. Key Responsibilities Data Architecture & Integration (50%) Design and … implement scalable data pipelines across multiple platforms (ERP, CRM, project management tools, etc.) Develop and maintain ETL/ELT processes to unify cross-functional datasets. Build foundational datasets and collaborate with senior leadership to define data architecture. Design for future scalability and cloud warehouse implementation Data Visualisation & Storytelling (25%) Build dynamic dashboards and reports More ❯

Head Of Data Position A fast-growing, digitally transformed business is seeking a founding member of their data team to build and implement the infrastructure that will support their continued growth and success. Over the past two years, this organisation has adopted a wide range of cloud-based systems across finance, operations, project management, and sales. … experienced candidate to architect the pipelines and reporting structures that bring this vision to life. Working directly with senior leadership, you’ll have the opportunity to shape the data function from the ground up, with a clear path to building and leading your own team in the future. Key Responsibilities Data Architecture & Integration (50%) Design and … implement scalable data pipelines across multiple platforms (ERP, CRM, project management tools, etc.) Develop and maintain ETL/ELT processes to unify cross-functional datasets. Build foundational datasets and collaborate with senior leadership to define data architecture. Design for future scalability and cloud warehouse implementation Data Visualisation & Storytelling (25%) Build dynamic dashboards and reports More ❯

Senior Data Engineer - AWS Location: London (Hybrid) | Practice Area : Technology & Engineering Type: Permanent Engineer future-ready data platforms that power financial transformation. The Role We're looking for a Senior Data Engineer with AWS to join our growing team of engineering experts driving next-gen transformation for Tier 1 financial services clients. You'll … play a pivotal role in designing, building, and deploying cloud-based data pipelines. Working across greenfield projects and enterprise-scale platforms, your work will directly impact the way data is ingested, transformed, and served at scale across the financial services industry. What You'll Do Design and build end-to-end data pipelines leveraging … AWS-native tools and modern data architectures. Collaborate with clients to gather requirements, define solutions, and deliver production-grade systems. Apply AWS Well-Architected Principles to ensure scalability, security, and resilience. Lead in the development of robust, tested, and fault-tolerant data engineering solutions. Support and mentor junior engineers, contributing to knowledge sharing across the team. More ❯

About The Role FDM is a global business and technology consultancy seeking a Lead Data Engineer to work for our client within the public sector. This is initially a 6-month contract with the potential to extend and will be a hybrid role based in either London, Birmingham, Cardiff, Darlington, Edinburgh or Salford. Our client is seeking Lead … Data Engineer to take a key role in the delivery of a secure, scalable Analytical Platform for internal analyst teams. Operating within the Analysis & Corporate Services function, this role is integral to driving the department's analytical capabilities by improving access to high … quality data and modernising analytical infrastructure. This is a delivery-focused role requiring a hands-on engineer with strong technical capabilities in cloud infrastructure, data pipeline development, and secure data environments. The platform will enable departmental analysts to work entirely within a secure Python-based environment without reliance on local data More ❯

Data Scientist - Property London – Hybrid Up to £65,000 About the Role A leading London-based data and technology company in the property space is looking for a Data Scientist to join their growing product-focused team. This is an exciting opportunity to work as a full stack/end to end Data Scientist, driving real business impact. You’ll collaborate closely with stakeholders to build and deploy ML models and data-driven tools that are core to the company’s commercial offerings. Key Responsibilities Identify and scope opportunities where machine learning and data science can enhance product offerings. Design and run experiments to test hypotheses and … support product development. Develop robust data pipelines to support science experimentation and production. Deploy, maintain, and monitor predictive models in live environments. Communicate findings and technical concepts clearly to both technical and non-technical audiences. Contribute to agile delivery workflows and cross-functional collaboration. What We’re Looking For Solid understanding of core data science techniques More ❯

Data Scientist - Property London – Hybrid Up to £65,000 About the Role A leading London-based data and technology company in the property space is looking for a Data Scientist to join their growing product-focused team. This is an exciting opportunity to work as a full stack/end to end Data Scientist, driving real business impact. You’ll collaborate closely with stakeholders to build and deploy ML models and data-driven tools that are core to the company’s commercial offerings. Key Responsibilities Identify and scope opportunities where machine learning and data science can enhance product offerings. Design and run experiments to test hypotheses and … support product development. Develop robust data pipelines to support science experimentation and production. Deploy, maintain, and monitor predictive models in live environments. Communicate findings and technical concepts clearly to both technical and non-technical audiences. Contribute to agile delivery workflows and cross-functional collaboration. What We’re Looking For Solid understanding of core data science techniques More ❯

Senior Data Engineer Opportunity to work on an AI-powered platform Salary up to £110k + Private Medical Insurance + Share Options Hybrid working from our London HQ (Paddington) Tech stack: Python, Scala, SQL, AWS, Spark If you'd prefer to keep your CV and personal data private, feel free to WhatsApp your details or CV … the way our industry operates. WHAT YOU WILL BE DOING As a key member of our tech team, you will take ownership of building Fornax - our AI-powered data migration platform. This system is designed to seamlessly transfer data from outdated legacy systems into our own … platform, enabling rapid onboarding of new clients and driving our continued growth. ESSENTIAL SKILLS Strong SQL querying skills Proven experience in data migrations and data pipeline development Proficiency in writing clean, maintainable code and collaborating effectively within a team environment TO BE CONSIDERED Please apply online or email me directly at .For further information, call More ❯

you would like to help us prevent crime and protect the world's biggest online businesses. The Team You will be joining the Detection team, a team of data scientists and machine learning engineers. The Detection team is responsible for keeping fraud rates low - and clients happy - by continuously training and deploying machine learning models. We aim to … free as code deployments. Google's Best Practices for ML Engineering is our bible. Our models are trained to spot multiple types of fraud, using a variety of data sources and techniques in real time. The prediction pipelines are under strict SLAs; every prediction must be returned in under 300ms. When models are not performing as expected, it … Rust). Experience with deep learning frameworks like PyTorch or TensorFlow. Experience with large-scale data processing engines like Spark and Dataproc. Familiarity with data pipeline tools like dbt. Benefits Flexible Working Hours & Remote-First Environment - Work when and where you're most productive, with flexibility and support. Comprehensive BUPA Health Insurance - Stay covered with More ❯

Senior Analytics Data Engineer - Snowflake & DBT (Contract) Location: London/Hybrid (2 days a week in the office) Contract Length: 6 Months (with possible extension) Rate: Negotiable Ref: J12991 Are you a seasoned Data Engineer with a passion for designing scalable solutions and transforming how businesses harness the power of data? This is an … exciting opportunity to play a pivotal role in building a modern, enterprise-wide data platform for a global insurance leader undergoing a major back-office transformation. Following years of global growth and an ambitious digital transformation programme, a Data Team is being created, tasked with delivering an enterprise data platform, instilling best in class … data governance, and enabling smarter, faster decision making through high quality data solutions. This contract role is central to the initiative. As a Senior Analytics Data Engineer, you will support the definition, delivery, and optimisation of robust, cloud based data engineering pipelines and models. You'll be a trusted technical advisor, collaborating More ❯

you would like to help us prevent crime and protect the world's biggest online businesses. The Team You will be joining the Detection team, a team of data scientists and machine learning engineers. The Detection team is responsible for keeping fraud rates low - and clients happy - by continuously training and deploying machine learning models. We aim to … free as code deployments. Google's Best Practices for ML Engineering is our bible. Our models are trained to spot multiple types of fraud, using a variety of data sources and techniques in real time. The prediction pipelines are under strict SLAs; every prediction must be returned in under 300ms. When models are not performing as expected, it … Rust). Experience with deep learning frameworks like PyTorch or TensorFlow. Experience with large-scale data processing engines like Spark and Dataproc. Familiarity with data pipeline tools like dbt. Benefits Flexible Working Hours & Remote-First Environment - Work when and where you're most productive, with flexibility and support. Comprehensive BUPA Health Insurance - Stay covered with More ❯

Role: Senior Data Engineer Rate : £700 per day inside IR35 Duration : 4 months + Ext Location : National - London travel required (hybrid) Clearance : Active SC clearance requiredAre you a Senior Data Engineer with experience in modern, cloud-native data platforms and a drive to shape performance-led digital delivery? We are hiring on behalf of … a central government programme undergoing a transformative journey to enhance data-driven decision-making at scale. The Opportunity - Senior Data Engineer The Senior Data Engineer will join a multi-disciplinary team working to redefine how performance is measured and managed across a large, national directorate. The team has already delivered an MVP dashboard using … fully automated, code-first approach. This is more than a dashboard project - it's a strategic initiative to improve organisational health, leadership alignment, and delivery effectiveness through better data foundations. The Senior Data Engineer play a key role in transforming manual pipelines into scalable, automated solutions within a modern analytics platform, while embedding AI-native tools More ❯