76 to 100 of 360 Data Pipeline Jobs in Central London

Data Engineer Location: Paddington, London (Onsite) Salary: Up to £100,000 Job Type: Full Time We’re partnered with a well-funded early-stage tech company that’s using data and AI to bring greater financial intelligence to complex, data-heavy industries. Having recently secured significant investment from top-tier VCs, they’re now … entering a rapid growth phase and expanding their engineering team in London. They’re looking for a Data Engineer to help design and scale the core systems that power their platform - turning fragmented data into meaningful insights. You’ll work closely with technical leadership to build robust, modern data pipelines and play a key … Engineer or similar. Strong background with the modern data stack (e.g. Airbyte, dbt, BigQuery, Dagster, or equivalents). Skilled in SQL, data modelling, and pipeline orchestration. Analytical, pragmatic, and product-minded — focused on delivering impact. Comfortable in a fast-paced, collaborative, and evolving environment. A genuine interest in building technology that makes real-world More ❯

the best talent to strengthen our reputation as both a design practice and an employer of choice. We are seeking a motivated Junior BI Analyst to join our data analytics team. This role is perfect for an entry-level professional looking to build expertise in business intelligence, data management, and emerging AI technologies. The successful candidate … will support data-driven decision making across the organization while developing technical skills in data analysis and visualization. Key Responsibilities: Data Management & Quality Perform data cleansing, validation, and quality assurance processes Identify and resolve data inconsistencies and anomalies Document data sources, transformations, and cleansing procedures Monitor data pipelines and ensure timely data updates Business Intelligence & Reporting Develop and maintain standard business reports and dashboards Create ad-hoc reports based on stakeholder requirements Support the creation of KPIs and performance metrics Assist in data visualization best practices implementation AI Integration & Prompt Engineering Create and optimize AI prompts for various business applications Collaborate More ❯

the best talent to strengthen our reputation as both a design practice and an employer of choice. We are seeking a motivated Junior BI Analyst to join our data analytics team. This role is perfect for an entry-level professional looking to build expertise in business intelligence, data management, and emerging AI technologies. The successful candidate … will support data-driven decision making across the organization while developing technical skills in data analysis and visualization. Key Responsibilities: Data Management & Quality Perform data cleansing, validation, and quality assurance processes Identify and resolve data inconsistencies and anomalies Document data sources, transformations, and cleansing procedures Monitor data pipelines and ensure timely data updates Business Intelligence & Reporting Develop and maintain standard business reports and dashboards Create ad-hoc reports based on stakeholder requirements Support the creation of KPIs and performance metrics Assist in data visualization best practices implementation AI Integration & Prompt Engineering Create and optimize AI prompts for various business applications Collaborate More ❯

Senior Data Engineer – HealthTech/AI-Driven Data Platform Paddington, London £75,000 – £100,000 + Equity + Benefits We’re partnered with a fast-growing HealthTech company using data and AI to transform how healthcare organisations manage clinical and operational insights. Their platform integrates complex datasets from multiple health systems, enabling better decision … making, faster diagnosis, and measurable patient impact. As they scale their data capability, they’re hiring a Data Engineer to play a key role in designing and delivering the next generation of their data platform. What you’ll be doing Designing, developing, and optimising scalable data pipelines that power advanced analytics and … machine learning. Building and maintaining robust ETL/ELT workflows using Python, SQL, dbt, and cloud-native tools . Implementing data quality, observability, and governance frameworks to ensure reliability and compliance. Collaborating with data scientists, analysts, and clinicians to enable actionable insights through clean, well-modelled data. Driving technical decisions across Azure Databricks , GCP BigQuery , and More ❯

Senior Data Engineer – HealthTech/AI-Driven Data Platform Paddington, London £75,000 – £100,000 + Equity + Benefits We’re partnered with a fast-growing HealthTech company using data and AI to transform how healthcare organisations manage clinical and operational insights. Their platform integrates complex datasets from multiple health systems, enabling better decision … making, faster diagnosis, and measurable patient impact. As they scale their data capability, they’re hiring a Data Engineer to play a key role in designing and delivering the next generation of their data platform. What you’ll be doing Designing, developing, and optimising scalable data pipelines that power advanced analytics and … machine learning. Building and maintaining robust ETL/ELT workflows using Python, SQL, dbt, and cloud-native tools . Implementing data quality, observability, and governance frameworks to ensure reliability and compliance. Collaborating with data scientists, analysts, and clinicians to enable actionable insights through clean, well-modelled data. Driving technical decisions across Azure Databricks , GCP BigQuery , and More ❯

/Engineer Location: 3 Days p/w Central London Rate: £450 Outside IR35 Duration: 6 Months + Extensions This role is responsible for migrating and developing modern data and analytics solutions using Microsoft Fabric and Azure technologies. The position supports enterprise-wide BI initiatives, delivering data models, pipelines, dashboards and reporting assets that enable data-driven decision-making. Key Responsibilities Lead and implement data migration into Microsoft Fabric for analytics and reporting use cases Design and build data models from multiple sources to generate actionable insights Maintain and optimise data warehouse platforms; identify and resolve issues Develop data pipelines using Fabric Pipelines, Azure Data … Lakehouse and Warehouse environments Implement CI/CD processes using Azure DevOps for secure, reliable deployment Technical Skills: Strong expertise in: Power BI and paginated reporting SQL and data architecture Dimensional modelling (star schema, snowflake, denormalised structures, SCD handling) DAX, Visual Studio and data transformation logic Azure Fabric, Azure Data Factory, Synapse, Data More ❯

/Engineer Location: 3 Days p/w Central London Rate: £450 Outside IR35 Duration: 6 Months + Extensions This role is responsible for migrating and developing modern data and analytics solutions using Microsoft Fabric and Azure technologies. The position supports enterprise-wide BI initiatives, delivering data models, pipelines, dashboards and reporting assets that enable data-driven decision-making. Key Responsibilities Lead and implement data migration into Microsoft Fabric for analytics and reporting use cases Design and build data models from multiple sources to generate actionable insights Maintain and optimise data warehouse platforms; identify and resolve issues Develop data pipelines using Fabric Pipelines, Azure Data … Lakehouse and Warehouse environments Implement CI/CD processes using Azure DevOps for secure, reliable deployment Technical Skills: Strong expertise in: Power BI and paginated reporting SQL and data architecture Dimensional modelling (star schema, snowflake, denormalised structures, SCD handling) DAX, Visual Studio and data transformation logic Azure Fabric, Azure Data Factory, Synapse, Data More ❯

Contract Role: Snowflake Data Architect/Consultant Location: London or Manchester (Hybrid – 2/3 days onsite pw) Duration: 6 months initial (poss extensions) Engagement: Outside IR35 Overview We’re seeking a highly capable Snowflake Data Architect/Consultant to help design, optimise, and embed modern cloud data architectures. The role will blend strategic … input, hands-on delivery, and technical leadership across data modelling, integration, and platform enablement. Key Responsibilities Platform Architecture Design and implement scalable data environments on Snowflake , ensuring performance, security, and reusability. Establish integration patterns between Snowflake and wider ecosystems including ETL/ELT tools , BI platforms, and cloud services (AWS, Azure, GCP). Delivery & Optimisation Lead … and analytics teams to embed Snowflake best practices. Create documentation and reusable assets that support long-term client self-sufficiency. Strategic Advisory Contribute to the definition of enterprise data roadmaps, covering topics such as data mesh , data sharing , and AI/ML enablement . Collaborate with platform partners and stakeholders to align delivery with More ❯

Contract Role: Snowflake Data Architect/Consultant Location: London or Manchester (Hybrid – 2/3 days onsite pw) Duration: 6 months initial (poss extensions) Engagement: Outside IR35 Overview We’re seeking a highly capable Snowflake Data Architect/Consultant to help design, optimise, and embed modern cloud data architectures. The role will blend strategic … input, hands-on delivery, and technical leadership across data modelling, integration, and platform enablement. Key Responsibilities Platform Architecture Design and implement scalable data environments on Snowflake , ensuring performance, security, and reusability. Establish integration patterns between Snowflake and wider ecosystems including ETL/ELT tools , BI platforms, and cloud services (AWS, Azure, GCP). Delivery & Optimisation Lead … and analytics teams to embed Snowflake best practices. Create documentation and reusable assets that support long-term client self-sufficiency. Strategic Advisory Contribute to the definition of enterprise data roadmaps, covering topics such as data mesh , data sharing , and AI/ML enablement . Collaborate with platform partners and stakeholders to align delivery with More ❯

Data Delivery and Integration Manager - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML … and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning of More ❯

The Role This is a fantastic opportunity to join one of the largest integrated energy and commodity trading companies in the world. We are looking for a Senior Data Engineer with strong technical expertise in Databricks , data engineering , and cloud-native analytics platforms . You will contribute to the development and expansion of our global analytics … platform —supporting Front Office Trading across commodities—by building scalable, secure, and efficient data solutions. You will work alongside data scientists, ML engineers, and business stakeholders to understand requirements, design and build robust data pipelines, and deliver end-to-end analytics and ML/AI capabilities. Key Responsibilities Design, build, and maintain scalable data … Apache Spark, PySpark, and Databricks—including experience with Delta Lake, Unity Catalog, MLflow, and Databricks Workflows. Deep proficiency in Python and SQL, with proven experience building modular, testable, reusable pipeline components. Strong experience with AWS cloud services including S3, Lambda, Glue, API Gateway, IAM, EC2, EKS, and integration of AWS-native components with Databricks. Advanced skills in Infrastructure as More ❯

The Role This is a fantastic opportunity to join one of the largest integrated energy and commodity trading companies in the world. We are looking for a Senior Data Engineer with strong technical expertise in Databricks , data engineering , and cloud-native analytics platforms . You will contribute to the development and expansion of our global analytics … platform —supporting Front Office Trading across commodities—by building scalable, secure, and efficient data solutions. You will work alongside data scientists, ML engineers, and business stakeholders to understand requirements, design and build robust data pipelines, and deliver end-to-end analytics and ML/AI capabilities. Key Responsibilities Design, build, and maintain scalable data … Apache Spark, PySpark, and Databricks—including experience with Delta Lake, Unity Catalog, MLflow, and Databricks Workflows. Deep proficiency in Python and SQL, with proven experience building modular, testable, reusable pipeline components. Strong experience with AWS cloud services including S3, Lambda, Glue, API Gateway, IAM, EC2, EKS, and integration of AWS-native components with Databricks. Advanced skills in Infrastructure as More ❯

Data Engineer/PostgreSQL/SQL/Data Pipelines/Apache Superset/PowerBI/Tableau/Terraform Data Engineer (Outside IR35 Contract role) Determination: Outside IR35 Day Rate: Up to £575 per day Location: Hybrid Zone 1 Duration: 3 months (initial) Job Title: Data Engineer About the role: We're on … the lookout for an experience Data Engineer for a SaaS Scale-up in the tech for good space. You'll be involved in the full end-to-end process, building data pipelines and dashboards. Data Engineer/PostgreSQL/SQL/Data Pipelines/Apache Superset/PowerBI/Tableau/Terraform … Requirements: 5+years' experience with PostgresSQL, SQL & Terrform Demonstrable experience with building data pipelines from scratch 3+ years' Dashboarding/Building Dashboards, (Apache Superset/PowerBI/Tableau) Experience with building report templates. If you are an experienced data engineer with experience building data pipelines please apply, or send your CV directly to callum@acquiredtalent.co.uk More ❯

Data Engineer/PostgreSQL/SQL/Data Pipelines/Apache Superset/PowerBI/Tableau/Terraform Data Engineer (Outside IR35 Contract role) Determination: Outside IR35 Day Rate: Up to £575 per day Location: Hybrid Zone 1 Duration: 3 months (initial) Job Title: Data Engineer About the role: We're on … the lookout for an experience Data Engineer for a SaaS Scale-up in the tech for good space. You'll be involved in the full end-to-end process, building data pipelines and dashboards. Data Engineer/PostgreSQL/SQL/Data Pipelines/Apache Superset/PowerBI/Tableau/Terraform … Requirements: 5+years' experience with PostgresSQL, SQL & Terrform Demonstrable experience with building data pipelines from scratch 3+ years' Dashboarding/Building Dashboards, (Apache Superset/PowerBI/Tableau) Experience with building report templates. If you are an experienced data engineer with experience building data pipelines please apply, or send your CV directly to callum@acquiredtalent.co.uk More ❯

About the Role As a Data Engineer at Futuria, you’ll play a central role in designing, building, and maintaining the scalable data infrastructure that powers our AI models and intelligent applications. You’ll collaborate with AI engineers, data scientists, and product teams to ensure the seamless flow of high-quality, reliable data that drives performance and insight across the platform. Key Responsibilities Design and implement scalable, secure, and reliable data pipelines to support procedural workflow orchestration and AI agent workflows Develop and manage robust data ingestion processes (batch and streaming) from diverse sources Collaborate with AI engineers and product teams to define data requirements … and integrate pipelines seamlessly with models and applications. Build and maintain ETL/ELT processes that ensure data integrity, consistency, and accuracy across systems. Optimize data infrastructure for performance, cost efficiency, and scalability in cloud environments. Develop and manage graph-based data systems (e.g. Kuzu, Neo4j, Apache AGE) to model and query complex relationships More ❯

About the Role As a Data Engineer at Futuria, you’ll play a central role in designing, building, and maintaining the scalable data infrastructure that powers our AI models and intelligent applications. You’ll collaborate with AI engineers, data scientists, and product teams to ensure the seamless flow of high-quality, reliable data that drives performance and insight across the platform. Key Responsibilities Design and implement scalable, secure, and reliable data pipelines to support procedural workflow orchestration and AI agent workflows Develop and manage robust data ingestion processes (batch and streaming) from diverse sources Collaborate with AI engineers and product teams to define data requirements … and integrate pipelines seamlessly with models and applications. Build and maintain ETL/ELT processes that ensure data integrity, consistency, and accuracy across systems. Optimize data infrastructure for performance, cost efficiency, and scalability in cloud environments. Develop and manage graph-based data systems (e.g. Kuzu, Neo4j, Apache AGE) to model and query complex relationships More ❯

Senior Data Engineer – Insurance Sector Location: Hybrid (London-based with flexible working) Salary: £85K -£100K – this is dependent on skills and experience Join a growing data team that’s transforming how the insurance industry uses data to make smarter, faster decisions. As a Senior Data Engineer , you’ll design and deliver scalable … high-performing data solutions that power analytics, reporting, and risk insights across the business. You’ll work closely with analysts, actuaries, and underwriters to build pipelines, models, and architectures that bring structure, speed, and accuracy to complex insurance data. This is a fantastic opportunity to make a real impact while shaping the future of data engineering … within a forward-thinking organisation. What You’ll Be Doing Partnering with analysts and product owners to turn business needs into scalable data solutions. Designing and maintaining robust data pipelines and models for analytics and reporting. Applying best practices in data architecture, security, and performance. Working with modern tools including Azure, Databricks, Python, Azure More ❯

Senior Data Engineer – Insurance Sector Location: Hybrid (London-based with flexible working) Salary: £85K -£100K – this is dependent on skills and experience Join a growing data team that’s transforming how the insurance industry uses data to make smarter, faster decisions. As a Senior Data Engineer , you’ll design and deliver scalable … high-performing data solutions that power analytics, reporting, and risk insights across the business. You’ll work closely with analysts, actuaries, and underwriters to build pipelines, models, and architectures that bring structure, speed, and accuracy to complex insurance data. This is a fantastic opportunity to make a real impact while shaping the future of data engineering … within a forward-thinking organisation. What You’ll Be Doing Partnering with analysts and product owners to turn business needs into scalable data solutions. Designing and maintaining robust data pipelines and models for analytics and reporting. Applying best practices in data architecture, security, and performance. Working with modern tools including Azure, Databricks, Python, Azure More ❯

has big plans for its team and the wider business. I am seeking an exceptional Engineering Manager within Analytics to lead high-performing teams at the crossroads of data engineering, analytics, and real-world business impact. This role offers the chance to shape the architecture, culture, and strategy of a modern analytics ecosystem , driving innovation, scalability, and measurable … different types of projects at one time and adaptable in leading teams and upskilling those around you. In this role, you will: Lead, mentor, and inspire analytics and data engineering teams, fostering technical excellence and a culture of innovation. Architect and optimise ELT pipelines and workflows using dbt, Airflow, SQL, and Python. Oversee the design and evolution of … are able to bring: Bring 5+ years of experience in analytics and data engineering, including proven leadership within technical teams. Demonstrate deep expertise in data pipeline architecture, schema design, and transformation frameworks. Have strong proficiency across cloud-based data platforms and scalable infrastructure. Excel at developing teams, driving process optimisation, and championing collaboration More ❯

has big plans for its team and the wider business. I am seeking an exceptional Engineering Manager within Analytics to lead high-performing teams at the crossroads of data engineering, analytics, and real-world business impact. This role offers the chance to shape the architecture, culture, and strategy of a modern analytics ecosystem , driving innovation, scalability, and measurable … different types of projects at one time and adaptable in leading teams and upskilling those around you. In this role, you will: Lead, mentor, and inspire analytics and data engineering teams, fostering technical excellence and a culture of innovation. Architect and optimise ELT pipelines and workflows using dbt, Airflow, SQL, and Python. Oversee the design and evolution of … are able to bring: Bring 5+ years of experience in analytics and data engineering, including proven leadership within technical teams. Demonstrate deep expertise in data pipeline architecture, schema design, and transformation frameworks. Have strong proficiency across cloud-based data platforms and scalable infrastructure. Excel at developing teams, driving process optimisation, and championing collaboration More ❯

Data QA Engineer We are seeking a QA Engineer with a strong background in data and analytics to help ensure the accuracy and reliability of both data pipelines and machine learning models . This role combines hands-on testing, automation, and close collaboration with engineering and data teams. About the Role You … ll take ownership of quality assurance for data pipelines; you’ll have a strong understanding of SQL to verify data consistency and accuracy. You’ll support with automated QA solutions for data pipelines and testing the outputs of ML models. Responsibilities Design, develop, and execute comprehensive test plans and test cases for data pipelines and ML models. Implement and maintain automated testing frameworks for data and ML quality assurance Perform thorough manual testing during initial development and complex feature releases Collaborate closely with Data Engineers, Data Scientists, and Product Managers Proactively identify, document, and track bugs and quality issues. Participate in code reviews and provide More ❯

Data QA Engineer We are seeking a QA Engineer with a strong background in data and analytics to help ensure the accuracy and reliability of both data pipelines and machine learning models . This role combines hands-on testing, automation, and close collaboration with engineering and data teams. About the Role You … ll take ownership of quality assurance for data pipelines; you’ll have a strong understanding of SQL to verify data consistency and accuracy. You’ll support with automated QA solutions for data pipelines and testing the outputs of ML models. Responsibilities Design, develop, and execute comprehensive test plans and test cases for data pipelines and ML models. Implement and maintain automated testing frameworks for data and ML quality assurance Perform thorough manual testing during initial development and complex feature releases Collaborate closely with Data Engineers, Data Scientists, and Product Managers Proactively identify, document, and track bugs and quality issues. Participate in code reviews and provide More ❯

Data Engineer | AI Startup | Real-Time Data & ML Pipelines I’m currently partnered with a next-generation AI startup that’s building real-time intelligence systems capable of understanding and adapting to the world as it happens. They’re at the forefront of streaming data, continuous learning, and large-scale inference - and they’re … now looking for a Data Engineer to help power that mission. This isn’t a maintenance role. It’s a build-it-from-the-ground-up opportunity in a company that’s solving genuinely hard, technical problems around real-time data pipelines and ML infrastructure . ⚙️ The Opportunity The team is looking for a Data Engineer who can design and scale real-time data architectures and machine learning pipelines that drive continuous model training and experimentation. You’ll be working in close collaboration with ML engineers, product leads, and platform teams to make sure the company’s AI models are learning, and improving, in production. 🧠 What You’ll Be Doing Architect More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

MI & Data Integration Analyst (Azure/Databricks) 📍 Hybrid – Central London | 💰 £43,000 pro rata | ⏳ up to 6-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is … a great opportunity for someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. 🔍 The Opportunity You’ll be supporting a small, forward-thinking team to improve how they use data — helping them access accurate and … timely MI, streamline processes, and migrate to a new Azure-based data environment. You’ll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. 💼 Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business More ❯