51 to 75 of 360 Data Pipeline Jobs in Central London

Senior Data Scientist Paying up to £85,000 + bonus Hybrid in London AI/ML-Driven PropTech I am currently working with start/scale up within the PropTech sector looking to hire a Data Scientist to work on high-impact predictive modelling projects in a fast-growing company. This role offers the opportunity to … work end-to-end on ML models, helping to revolutionise the property industry by leveraging data-driven insights. As a Data Scientist, you’ll be building and optimising predictive models to understand trends in the property market, such as likelihood of sale and customer retention. You’ll work closely with Data Engineers and Product … predictive models to forecast property trends and customer behavior. Leveraging MLOps best practices to ensure efficient model deployment and monitoring. Working end-to-end across the data pipeline – from data extraction to model evaluation. Collaborating with cross-functional teams to turn insights into actionable business decisions. Tech Stack & requirements: Python | SQL | Snowflake | DBT | Tableau | Dataiku More ❯

an AI Data Engineer to turn 3D assets and visuals into high-quality datasets for next-gen AI in digital play. Own the full data pipeline and help build scalable, creative systems at the crossroads of AI, data, and fun RESPONSIBILITIES Design and operate data ingestion pipelines for 3D assets, geometry … vendors, and automate quality checks to ensure scalable, reliable datasets. Define schemas and metadata for digital assets, maintaining catalogues, lineage, and versioning to ensure reproducibility and governance. Enforce data quality, drift detection, and compliance (GDPR/COPPA), including watermarking and traceability to safeguard IP and user privacy. Collaborate with AI infrastructure engineers to optimize data storage … and compute performance for large-scale processing. Work with AI engineers to define data specifications, support experimentation, and integrate active learning loops that improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). More ❯

an AI Data Engineer to turn 3D assets and visuals into high-quality datasets for next-gen AI in digital play. Own the full data pipeline and help build scalable, creative systems at the crossroads of AI, data, and fun RESPONSIBILITIES Design and operate data ingestion pipelines for 3D assets, geometry … vendors, and automate quality checks to ensure scalable, reliable datasets. Define schemas and metadata for digital assets, maintaining catalogues, lineage, and versioning to ensure reproducibility and governance. Enforce data quality, drift detection, and compliance (GDPR/COPPA), including watermarking and traceability to safeguard IP and user privacy. Collaborate with AI infrastructure engineers to optimize data storage … and compute performance for large-scale processing. Work with AI engineers to define data specifications, support experimentation, and integrate active learning loops that improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). More ❯

Data Engineer x4 days a week in their London office Join a fast-scaling, product-led tech company on a mission to transform how their sector performs in real time. With a strong focus on data-led decision-making and seamless mobile experiences, this team is building out their next-generation data infrastructure, and … they’re looking for another Data Engineer to help drive that forward. This is an exciting opportunity to shape the way data flows through a live product used by thousands, while working closely with analytics, engineering, and commercial teams. You’ll be joining a small, high-impact team, reporting to a technical leader with a strong … background in applied data architecture. What You’ll Be Doing Designing, building, and maintaining scalable data pipelines to power both internal analytics and customer-facing mobile/web applications Developing robust ETL processes for ingesting and transforming data from a variety of sources, particularly APIs Creating and optimising data architectures to ensure More ❯

Data Engineer x4 days a week in their London office Join a fast-scaling, product-led tech company on a mission to transform how their sector performs in real time. With a strong focus on data-led decision-making and seamless mobile experiences, this team is building out their next-generation data infrastructure, and … they’re looking for another Data Engineer to help drive that forward. This is an exciting opportunity to shape the way data flows through a live product used by thousands, while working closely with analytics, engineering, and commercial teams. You’ll be joining a small, high-impact team, reporting to a technical leader with a strong … background in applied data architecture. What You’ll Be Doing Designing, building, and maintaining scalable data pipelines to power both internal analytics and customer-facing mobile/web applications Developing robust ETL processes for ingesting and transforming data from a variety of sources, particularly APIs Creating and optimising data architectures to ensure More ❯

of the leading organizations in the UAE specializing in healthcare and advanced technology solutions . PLEASE NOTE THAT THE ROLE IS BASED IN DUBAI! As the Director – Healthcare Data and AI Solution Architect , you will play a key leadership role in defining and driving the company’s data and AI architecture strategy , shaping the foundation for … innovation, scalability, and excellence in healthcare technology. You will design and implement a robust, secure, and future-ready data and AI ecosystem , ensuring deep integration with enterprise-wide strategies and governance frameworks. Reporting to the Executive Director of AI & Data , you’ll lead a team of architects and collaborate closely with cross-functional teams to bring … the company’s AI vision to life. Key Responsibilities Architectural Leadership Define and maintain a comprehensive and scalable data and AI architecture aligned with enterprise-wide technology strategy. Establish and enforce best practices for data storage, integration, governance, and compliance with regulatory standards. Provide strategic technical direction to architecture and engineering teams. Evaluate and enhance systems More ❯

of the leading organizations in the UAE specializing in healthcare and advanced technology solutions . PLEASE NOTE THAT THE ROLE IS BASED IN DUBAI! As the Director – Healthcare Data and AI Solution Architect , you will play a key leadership role in defining and driving the company’s data and AI architecture strategy , shaping the foundation for … innovation, scalability, and excellence in healthcare technology. You will design and implement a robust, secure, and future-ready data and AI ecosystem , ensuring deep integration with enterprise-wide strategies and governance frameworks. Reporting to the Executive Director of AI & Data , you’ll lead a team of architects and collaborate closely with cross-functional teams to bring … the company’s AI vision to life. Key Responsibilities Architectural Leadership Define and maintain a comprehensive and scalable data and AI architecture aligned with enterprise-wide technology strategy. Establish and enforce best practices for data storage, integration, governance, and compliance with regulatory standards. Provide strategic technical direction to architecture and engineering teams. Evaluate and enhance systems More ❯

About the Role Join the team as a Data Engineering Tech Lead , driving the design and delivery of scalable, cloud-based data platforms on Azure or AWS . You’ll lead by example — architecting modern ELT pipelines, optimizing data models, and guiding a high-performing engineering team. Key Responsibilities Lead the architecture and development … of end-to-end data pipelines and platforms. Build and optimize ELT processes , data integration , and data modeling frameworks. Establish best practices for data quality, automation, and governance. Mentor engineers, perform code reviews , and drive continuous improvement. Collaborate with stakeholders to align solutions with business goals. Implement DevOps/CI-CD pipelines … using GitHub Actions and Azure DevOps. Core Skills Cloud Expertise: Azure, AWS, SAP Data Engineering: ELT/ETL, Data Modeling, Data Warehousing Tools & Tech: Azure Data Factory, Databricks, Synapse, Stream Analytics, AWS Glue, Airflow, Kinesis, Redshift, SQL, GitHub, Azure DevOps, SonarQube, PyTest Preferred Experience Leading agile or scrum-based technical teams. Working More ❯

Exp: 10 + yrs Job Summary The Senior Test Specialist/Architect in Cloud Automation Testing focuses on automating testing processes in ETL (Extract, Transform, Load) and Data Warehousing environments to ensure the quality and reliability of data pipelines. The role involves designing, developing, and implementing automation scripts for testing data transformations, data loading processes, and data quality verification. Key Responsibilities 1. Develop and execute automated test scripts for etl processes and data pipelines. 2. Collaborate with cross functional teams to design and implement automated testing frameworks. 3. Create test plans and test cases for etl and data warehouse testing. 4. Identify and troubleshoot issues … in data transformations and data loading processes. 5. Conduct performance testing and ensure scalability of data pipelines. 6. Implement best practices for data quality assurance in etl environments. Skill Requirements 1. Proficiency in cloud-based automation testing tools like selenium, appium, or similar. 2. Experience in automation testing of etl (extract, transform More ❯

Exp: 10 + yrs Job Summary The Senior Test Specialist/Architect in Cloud Automation Testing focuses on automating testing processes in ETL (Extract, Transform, Load) and Data Warehousing environments to ensure the quality and reliability of data pipelines. The role involves designing, developing, and implementing automation scripts for testing data transformations, data loading processes, and data quality verification. Key Responsibilities 1. Develop and execute automated test scripts for etl processes and data pipelines. 2. Collaborate with cross functional teams to design and implement automated testing frameworks. 3. Create test plans and test cases for etl and data warehouse testing. 4. Identify and troubleshoot issues … in data transformations and data loading processes. 5. Conduct performance testing and ensure scalability of data pipelines. 6. Implement best practices for data quality assurance in etl environments. Skill Requirements 1. Proficiency in cloud-based automation testing tools like selenium, appium, or similar. 2. Experience in automation testing of etl (extract, transform More ❯

Job Title: Senior Data Engineer Base Location: London OR Glasgow based (Hybrid – 2 days per week in office) www.kpmgcareers.co.uk/experienced-professional/#LeBlender.OfficeLocations The KPMG Tax & Legal Technical Engineering function is a cornerstone of our business. We do work that matters to our local business and communities – supporting technical innovation and adoption of cutting edge solutions across … upheaval. We've proudly stood beside the institutions and businesses which make the UK what it is. Why Join the KPMG Tax & Legal Technology Engineering team as Senior Data Engineer We might be world leaders in Tax & Legal, but in many ways the engineering department feels like a start-up, with a twist. There’s the buzz of … high-profile projects of a major corporate entity. Crucially, we also offer the benefit of clear career progression. What will you be doing? We are seeking a Senior Data Engineer with strong experience in Cloud data platforms, API integration, and modern data engineering tools to help deliver our Tax & Legal data and More ❯

Job Title: Senior Data Engineer Base Location: London OR Glasgow based (Hybrid – 2 days per week in office) www.kpmgcareers.co.uk/experienced-professional/#LeBlender.OfficeLocations The KPMG Tax & Legal Technical Engineering function is a cornerstone of our business. We do work that matters to our local business and communities – supporting technical innovation and adoption of cutting edge solutions across … upheaval. We've proudly stood beside the institutions and businesses which make the UK what it is. Why Join the KPMG Tax & Legal Technology Engineering team as Senior Data Engineer We might be world leaders in Tax & Legal, but in many ways the engineering department feels like a start-up, with a twist. There’s the buzz of … high-profile projects of a major corporate entity. Crucially, we also offer the benefit of clear career progression. What will you be doing? We are seeking a Senior Data Engineer with strong experience in Cloud data platforms, API integration, and modern data engineering tools to help deliver our Tax & Legal data and More ❯

Data Analyst - Python, SQL, ETL, Data Pipelines I've had a new Data Analyst contract role come live for an InsureTech Client of OB's, who are looking for a highly skilled Data Analyst to join the team on a 6-month contract. You'll be working closely with the Data Architect, setting up a Data & AI roadmap and helping to analyse how they use Data that comes through their platform. Data Analyst - Python, SQL, ETL, Data Pipelines Key skills and experience: 3+ years of experience as a Data Analyst - ideally you'll have contracted before SQL, Python, ETL … Data Pipelines Finance or Insurance experience a big bonus Pays £500-£550 Outside IR35 6-month initial engagement 3 days a week in Central London offices Data Analyst - Python, SQL, ETL, Data Pipelines More ❯

A leading London Market Underwriter is looking for a Senior Data Business Analyst to lead the discovery, definition, and delivery of data-focused projects across a well established Change and Transformation function. This role offers the opportunity to take ownership of data processes, reporting, and business intelligence initiatives, while influencing the evolution of the … organisation’s Business Analysis framework. Key Responsibilities: Lead the initiation, discovery, and delivery of multiple data and BI projects, ensuring scope, budget, and timelines are controlled. Play a key role in developing the data business analysis function , with future opportunities to take on leadership and line management responsibilities as the team grows. Collaborate with technical and … business stakeholders to capture clear and actionable requirements using techniques such as data models, data flows, report specifications, and wireframes. Partner with the Data Engineering and BI teams to define and implement robust data pipelines, reporting solutions, and analytical models that support strategic decision-making and operational efficiency. Analyse data More ❯

A leading London Market Underwriter is looking for a Senior Data Business Analyst to lead the discovery, definition, and delivery of data-focused projects across a well established Change and Transformation function. This role offers the opportunity to take ownership of data processes, reporting, and business intelligence initiatives, while influencing the evolution of the … organisation’s Business Analysis framework. Key Responsibilities: Lead the initiation, discovery, and delivery of multiple data and BI projects, ensuring scope, budget, and timelines are controlled. Play a key role in developing the data business analysis function , with future opportunities to take on leadership and line management responsibilities as the team grows. Collaborate with technical and … business stakeholders to capture clear and actionable requirements using techniques such as data models, data flows, report specifications, and wireframes. Partner with the Data Engineering and BI teams to define and implement robust data pipelines, reporting solutions, and analytical models that support strategic decision-making and operational efficiency. Analyse data More ❯

Senior Data Scientists/Analysts – SC/DV Cleared – (Military/Veteran-Friendly) — Multiple Openings 🌳 Location: London (Remote & Hybrid options) 🌳 Employment: Permanent 🌳 Clearance: Current SC or DV required 🌳 Make sense of mission-critical data that actually drives decisions. 🌳 Areti Group is partnering with one of the UK’s fastest-growing Series A-funded tech start-ups … to hire multiple Senior Data Scientists & Data Analysts . You’ll help deliver secure, high-impact analytics platforms for Defence, National Security, and Government projects. 🌳 Perfect for ex-Forces engineers (RAF, Army, Navy) or civilians who’ve worked in high-trust, high-stakes environments and want to use data science at scale . 🌳 What … you’ll do 🌳 Build and deploy machine learning models to solve real-world problems. Design data pipelines, analytics APIs, and decision dashboards used by senior stakeholders. Apply modern data science, AI, and big data techniques to defence and security missions. Deliver secure-by-design, production-grade analytics platforms for sensitive environments. Collaborate across engineering More ❯

Senior Data Scientists/Analysts – SC/DV Cleared – (Military/Veteran-Friendly) — Multiple Openings 🌳 Location: London (Remote & Hybrid options) 🌳 Employment: Permanent 🌳 Clearance: Current SC or DV required 🌳 Make sense of mission-critical data that actually drives decisions. 🌳 Areti Group is partnering with one of the UK’s fastest-growing Series A-funded tech start-ups … to hire multiple Senior Data Scientists & Data Analysts . You’ll help deliver secure, high-impact analytics platforms for Defence, National Security, and Government projects. 🌳 Perfect for ex-Forces engineers (RAF, Army, Navy) or civilians who’ve worked in high-trust, high-stakes environments and want to use data science at scale . 🌳 What … you’ll do 🌳 Build and deploy machine learning models to solve real-world problems. Design data pipelines, analytics APIs, and decision dashboards used by senior stakeholders. Apply modern data science, AI, and big data techniques to defence and security missions. Deliver secure-by-design, production-grade analytics platforms for sensitive environments. Collaborate across engineering More ❯

Senior Data Engineer | Modern Data Platforms | AWS | Generative AI Location: Flexible London-based | Hybrid No sponsorship Are you passionate about shaping the future of data infrastructure and driving digital transformation? We’re partnering with a leading organisation at the forefront of innovation, leveraging cutting-edge technologies to modernise their data landscape and … build next-generation data platforms. They’re now looking for an experienced Senior Data Engineer to join a forward-thinking team and play a key role in advancing their cloud and analytics capabilities across multiple business domains, including Finance, Regulatory, Legal and Sustainability. What You’ll Be Doing Design, develop, test and support robust data … technical solutions, working closely with architects and cross-functional teams. Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and insights More ❯

Senior Data Engineer | Modern Data Platforms | AWS | Generative AI Location: Flexible London-based | Hybrid No sponsorship Are you passionate about shaping the future of data infrastructure and driving digital transformation? We’re partnering with a leading organisation at the forefront of innovation, leveraging cutting-edge technologies to modernise their data landscape and … build next-generation data platforms. They’re now looking for an experienced Senior Data Engineer to join a forward-thinking team and play a key role in advancing their cloud and analytics capabilities across multiple business domains, including Finance, Regulatory, Legal and Sustainability. What You’ll Be Doing Design, develop, test and support robust data … technical solutions, working closely with architects and cross-functional teams. Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and insights More ❯

Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. … As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You … ll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you More ❯

Data Engineer – Sports Betting Location: London - Hybrid Salary: £100,000 + Bonus + Benefits A leading name in the sports betting industry is looking for a talented Data Engineer to help design, build, and scale data solutions that power trading, risk, and customer insight models. You’ll play a central role in transforming raw … data into actionable intelligence, working closely with data scientists, quants, and business stakeholders to shape cutting-edge betting products. Key Responsibilities Build and optimise data pipelines and ETL workflows in AWS using Python and SQL. Partner with analysts and quants to deliver reliable datasets for predictive modelling and pricing. Design and maintain data models supporting trading, risk, and customer behaviour analytics. Develop Power BI dashboards to provide insights across trading and product teams. Ensure high standards of data governance, quality, and scalability. Collaborate with product, trading, and technology teams to support innovation in the betting platform. What you’ll bring Proven experience as a Data Engineer in More ❯

Contract Role Remote Working £600 - £700, Inside IR35 We're partnering with a Global IT Partner who are looking for a Databricks Solution Architect to provide guidance on data architecture and design and optimise Databricks solutions. As a Databricks Solution Architect, you will be responsible for: Lead end-to-end architecture of data lakes to Azure … Databricks Design and implement data pipelines in Azure Databricks, optimizing for performance, cost, and scalability Advise of data lake migration, data modelling and pipeline optimisation Refactor and modernize existing data models to integrate with Power BI Coordinate phased migrations to ensure zero disruption to live operations Replace legacy tools by consolidating … experience with Azure Data Lake Storage Gen2, Azure Data Factory, and Azure Synapse Analytics Proficiency in SQL and Python for data transformation and pipeline logic Please note: you will be working in a US time zone. Please contract/01676545407 to discuss in more detail. ECS Recruitment Group Ltd is acting as an More ❯

Lead Data Analyst – Data & Analysis Join us on our journey At Nando’s, our purpose is simple: to Create Lasting Happiness – for our people, our customers, and the communities we’re part of. Born in Johannesburg and growing worldwide, we’ve always been about more than flame-grilled PERi-PERi chicken. We’re about warmth, belonging … and creating experiences that matter – for our teams, for our guests, and for you. Now, we’re building exciting new digital and data capabilities. Our tech team has expanded rapidly over the last five years, and we’re bringing fresh ideas and innovation to the restaurant industry. This is your chance to help shape that journey. The role … We’re looking for a Lead Data Analyst to join our Data & Analysis team. This role isn’t just about crunching numbers – it’s about using data to tell stories, spark ideas, and make real impact. You’ll guide how we use data to make decisions, help shape our data More ❯

Lead Data Analyst – Data & Analysis Join us on our journey At Nando’s, our purpose is simple: to Create Lasting Happiness – for our people, our customers, and the communities we’re part of. Born in Johannesburg and growing worldwide, we’ve always been about more than flame-grilled PERi-PERi chicken. We’re about warmth, belonging … and creating experiences that matter – for our teams, for our guests, and for you. Now, we’re building exciting new digital and data capabilities. Our tech team has expanded rapidly over the last five years, and we’re bringing fresh ideas and innovation to the restaurant industry. This is your chance to help shape that journey. The role … We’re looking for a Lead Data Analyst to join our Data & Analysis team. This role isn’t just about crunching numbers – it’s about using data to tell stories, spark ideas, and make real impact. You’ll guide how we use data to make decisions, help shape our data More ❯

Data Engineer Location: Paddington, London (Onsite) Salary: Up to £100,000 Job Type: Full Time We’re partnered with a well-funded early-stage tech company that’s using data and AI to bring greater financial intelligence to complex, data-heavy industries. Having recently secured significant investment from top-tier VCs, they’re now … entering a rapid growth phase and expanding their engineering team in London. They’re looking for a Data Engineer to help design and scale the core systems that power their platform - turning fragmented data into meaningful insights. You’ll work closely with technical leadership to build robust, modern data pipelines and play a key … Engineer or similar. Strong background with the modern data stack (e.g. Airbyte, dbt, BigQuery, Dagster, or equivalents). Skilled in SQL, data modelling, and pipeline orchestration. Analytical, pragmatic, and product-minded — focused on delivering impact. Comfortable in a fast-paced, collaborative, and evolving environment. A genuine interest in building technology that makes real-world More ❯