1 to 25 of 71 Remote Data Pipeline Jobs in Central London

We have a current opportunity for a Data Engineer on a permanent basis. The position will be based in London. For further information about this position please apply. The team: You'll be working in a wider Data Management team alongside data engineers, data analysts & data governance specialists and facing … to stakeholders in the front office including product teams, analysts and traders. Your responsibilities: - Design and develop data catalogue and metadata management processes from data pipeline - Engineering data solutions - Implement data quality standards - Establish data governance and ensure data is fit for purpose - Understanding of data security, data architecture - Working alongside end users, stakeholders and data product teams Technology skillset: - Experience in data engineering, data modelling and data analytics [programming languages: Python, SQL, Alteryx] - Data Visualisation experience [tools: PowerBI, Tableau or similar] - MetaData management and data cataloguing [tools: Collibra, Alation More ❯

IR35) Databricks Engineer needed with active SC Security Clearance for 6 Month Contract based in Central London (Hybrid). Developing a cutting-edge Azure Databricks platform for economic data modelling, analysis, and forecasting. Start asap ideally in October 2025. Hybrid Working - 2 days/week remote (WFH), and 3 days/week working on-site from the Central … London office. A chance to work with a leading global IT and Digital transformation business specialising in Government projects: In-depth Data Engineering + strong hands-on Azure Databricks expertise. Azure Data Services, Azure Data Factory, Azure Blob Storage + Azure SQL Database. Designing, developing, building + optimising data pipelines, implementing data … including data modelling techniques + data integration patterns. Experience of working with complex data pipelines, large data sets, data pipeline optimization + data architecture design. Implementing complex data transformations using Spark, PySpark or Scala + working with SQL/MySQL databases. Experience with data More ❯

Engineer Location: London (hybrid 3 times a week) Department: IT Type: 3 months rolling contract Outside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. … Key Responsibilities Design and build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high experience within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and More ❯

Data Analytics Engineer Location: Central London - hybrid working Rate: £500.00 per day inside IR35 Duration: 12 months We are working with a leading global player in the travel industry who are seeking a Data Analytics Engineer to join their data team. This role sits at the intersection of data analysis and data engineeringideal for someone who enjoys building scalable data solutions while staying close to business impact. The Role As a Data Analytics Engineer , youll design, build, and maintain reliable data pipelinesprimarily using PySpark, SQL, and Python to ensure business teams (analysts, product managers, finance, operations) have access to well-modeled, actionable data. Youll … Engineers, youll be closer to the business, shaping analytics-ready datasets. Unlike pure Data Analysts, youll spend more time coding, managing data infrastructure, and ensuring pipeline reliability. Who Were Looking For Data Analytics : Analysts who have strong experience building and maintaining data pipelines (particularly in PySpark/SQL ) and want to More ❯

Remote Data Architect sought by a well-established company in their industry; our client is seeking an adept professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. This unique opportunity is offered on a … remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: - Leading the design and implementation of innovative cloud data platforms. - Setting standards … using Azure, AWS, or exceptional on-premise design expertise. - At least 5 years in data engineering or business intelligence roles. - Proficiency in ETL and data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and demonstrable data modelling More ❯

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Data Engineer with Insurance experience to play a … key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You’ll help shape the data strategy, improve data quality, and empower the business to make data-driven decisions. As a Lead Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built More ❯

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Data Engineer with Insurance experience to play a … key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You’ll help shape the data strategy, improve data quality, and empower the business to make data-driven decisions. As a Lead Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built More ❯

Role Title: Pre-Sales & Data Solution Architect Business Unit/Segment: Data Management Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent Summary Our client, a leading global data and AI consultancy, is seeking a Pre-Sales & Data Solution Architect Lead - hybrid role to become one of their leaders in this … area in their Data Management practice with a focus on banking clients . This is a strategic, client-facing role where you will partner with senior stakeholders to modernise data platforms, accelerate cloud adoption, and drive measurable business value. The role combines technical leadership with consulting and pre-sales expertise . You will design enterprise data … as a trusted advisor, leading workshops and influencing senior stakeholders on strategy, roadmaps, and innovation. ETL/ELT & Data Engineering – Provide oversight on robust data pipeline and integration designs using SSIS, ADF, Informatica, or IBM DataStage. Data Governance & Quality – Define governance, metadata, and quality frameworks using tools such as Unity Catalog, Profisee, Alation More ❯

more than just a media agency; we are people people . At our core lies a commitment to understanding, trust, integrity, and delivering results. With a focus on data-driven decision-making, we have built a reputation for driving tangible outcomes for our clients. As an employee-owned organisation, we value our team members' contributions and provide them … s future. Join us, and let's create meaningful change together. The Role As an AI Engineer, you will head up the design, build, and optimisation of our data infrastructure, automation solutions, and AI-driven tools. Leading Data Architecture, MarTech, AI & Automation, you will ensure that data flows seamlessly across the business and is … harnessed effectively to drive client performance. This role requires a mix of technical expertise, leadership, and client-facing skills. You will manage and develop team members, oversee data engineering projects, and take ownership of the agency's core data pipelines and platforms using Artificial Intelligence. You will also play a key role in exploring and embedding More ❯

are more than just a media agency; we are people people. At our core lies a commitment to understanding, trust, integrity, and delivering results. With a focus on data-driven decision-making, we have built a reputation for driving tangible outcomes for our clients. As an employee-owned organisation, we value our team members' contributions and provide them … s future. Join us, and let’s create meaningful change together. The Role As an AI Engineer, you will head up the design, build, and optimisation of our data infrastructure, automation solutions, and AI-driven tools. Leading Data Architecture, MarTech, AI & Automation, you will ensure that data flows seamlessly across the business and is … harnessed effectively to drive client performance. This role requires a mix of technical expertise, leadership, and client-facing skills. You will manage and develop team members, oversee data engineering projects, and take ownership of the agency’s core data pipelines and platforms using Artificial Intelligence. You will also play a key role in exploring and embedding More ❯

About the Opportunity This is a unique opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role, you’ll play a key part in designing and developing scalable data … football world—including performance insights for some of the most well-known footballers in the industry . This is the perfect environment for those passionate about leveraging advanced data engineering to drive real-world results in sports analytics. Key Responsibilities Architect, design, build, test, and maintain scalable and high-performance data pipelines Ensure all systems adhere … to best practices for data quality, integrity, and security Integrate modern data engineering tools and technologies into cloud-native infrastructure Develop tools and solutions to support sports data modeling, analytics, and predictive insights Collaborate with data scientists to enable end-to-end data workflows Own the architecture and maintenance of More ❯

About the Opportunity This is a unique opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role, you’ll play a key part in designing and developing scalable data … football world—including performance insights for some of the most well-known footballers in the industry . This is the perfect environment for those passionate about leveraging advanced data engineering to drive real-world results in sports analytics. Key Responsibilities Architect, design, build, test, and maintain scalable and high-performance data pipelines Ensure all systems adhere … to best practices for data quality, integrity, and security Integrate modern data engineering tools and technologies into cloud-native infrastructure Develop tools and solutions to support sports data modeling, analytics, and predictive insights Collaborate with data scientists to enable end-to-end data workflows Own the architecture and maintenance of More ❯

an AI Data Engineer to turn 3D assets and visuals into high-quality datasets for next-gen AI in digital play. Own the full data pipeline and help build scalable, creative systems at the crossroads of AI, data, and fun RESPONSIBILITIES Design and operate data ingestion pipelines for 3D assets, geometry … vendors, and automate quality checks to ensure scalable, reliable datasets. Define schemas and metadata for digital assets, maintaining catalogues, lineage, and versioning to ensure reproducibility and governance. Enforce data quality, drift detection, and compliance (GDPR/COPPA), including watermarking and traceability to safeguard IP and user privacy. Collaborate with AI infrastructure engineers to optimize data storage … and compute performance for large-scale processing. Work with AI engineers to define data specifications, support experimentation, and integrate active learning loops that improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). More ❯

an AI Data Engineer to turn 3D assets and visuals into high-quality datasets for next-gen AI in digital play. Own the full data pipeline and help build scalable, creative systems at the crossroads of AI, data, and fun RESPONSIBILITIES Design and operate data ingestion pipelines for 3D assets, geometry … vendors, and automate quality checks to ensure scalable, reliable datasets. Define schemas and metadata for digital assets, maintaining catalogues, lineage, and versioning to ensure reproducibility and governance. Enforce data quality, drift detection, and compliance (GDPR/COPPA), including watermarking and traceability to safeguard IP and user privacy. Collaborate with AI infrastructure engineers to optimize data storage … and compute performance for large-scale processing. Work with AI engineers to define data specifications, support experimentation, and integrate active learning loops that improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). More ❯

A leading London Market Underwriter is looking for a Senior Data Business Analyst to lead the discovery, definition, and delivery of data-focused projects across a well established Change and Transformation function. This role offers the opportunity to take ownership of data processes, reporting, and business intelligence initiatives, while influencing the evolution of the … organisation’s Business Analysis framework. Key Responsibilities: Lead the initiation, discovery, and delivery of multiple data and BI projects, ensuring scope, budget, and timelines are controlled. Play a key role in developing the data business analysis function , with future opportunities to take on leadership and line management responsibilities as the team grows. Collaborate with technical and … business stakeholders to capture clear and actionable requirements using techniques such as data models, data flows, report specifications, and wireframes. Partner with the Data Engineering and BI teams to define and implement robust data pipelines, reporting solutions, and analytical models that support strategic decision-making and operational efficiency. Analyse data More ❯

A leading London Market Underwriter is looking for a Senior Data Business Analyst to lead the discovery, definition, and delivery of data-focused projects across a well established Change and Transformation function. This role offers the opportunity to take ownership of data processes, reporting, and business intelligence initiatives, while influencing the evolution of the … organisation’s Business Analysis framework. Key Responsibilities: Lead the initiation, discovery, and delivery of multiple data and BI projects, ensuring scope, budget, and timelines are controlled. Play a key role in developing the data business analysis function , with future opportunities to take on leadership and line management responsibilities as the team grows. Collaborate with technical and … business stakeholders to capture clear and actionable requirements using techniques such as data models, data flows, report specifications, and wireframes. Partner with the Data Engineering and BI teams to define and implement robust data pipelines, reporting solutions, and analytical models that support strategic decision-making and operational efficiency. Analyse data More ❯

Senior Data Engineer | Modern Data Platforms | AWS | Generative AI Location: Flexible London-based | Hybrid No sponsorship Are you passionate about shaping the future of data infrastructure and driving digital transformation? We’re partnering with a leading organisation at the forefront of innovation, leveraging cutting-edge technologies to modernise their data landscape and … build next-generation data platforms. They’re now looking for an experienced Senior Data Engineer to join a forward-thinking team and play a key role in advancing their cloud and analytics capabilities across multiple business domains, including Finance, Regulatory, Legal and Sustainability. What You’ll Be Doing Design, develop, test and support robust data … technical solutions, working closely with architects and cross-functional teams. Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and insights More ❯

Senior Data Engineer | Modern Data Platforms | AWS | Generative AI Location: Flexible London-based | Hybrid No sponsorship Are you passionate about shaping the future of data infrastructure and driving digital transformation? We’re partnering with a leading organisation at the forefront of innovation, leveraging cutting-edge technologies to modernise their data landscape and … build next-generation data platforms. They’re now looking for an experienced Senior Data Engineer to join a forward-thinking team and play a key role in advancing their cloud and analytics capabilities across multiple business domains, including Finance, Regulatory, Legal and Sustainability. What You’ll Be Doing Design, develop, test and support robust data … technical solutions, working closely with architects and cross-functional teams. Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and insights More ❯

Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. … As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You … ll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you More ❯

Contract Role Remote Working £600 - £700, Inside IR35 We're partnering with a Global IT Partner who are looking for a Databricks Solution Architect to provide guidance on data architecture and design and optimise Databricks solutions. As a Databricks Solution Architect, you will be responsible for: Lead end-to-end architecture of data lakes to Azure … Databricks Design and implement data pipelines in Azure Databricks, optimizing for performance, cost, and scalability Advise of data lake migration, data modelling and pipeline optimisation Refactor and modernize existing data models to integrate with Power BI Coordinate phased migrations to ensure zero disruption to live operations Replace legacy tools by consolidating … experience with Azure Data Lake Storage Gen2, Azure Data Factory, and Azure Synapse Analytics Proficiency in SQL and Python for data transformation and pipeline logic Please note: you will be working in a US time zone. Please contract/01676545407 to discuss in more detail. ECS Recruitment Group Ltd is acting as an More ❯

the best talent to strengthen our reputation as both a design practice and an employer of choice. We are seeking a motivated Junior BI Analyst to join our data analytics team. This role is perfect for an entry-level professional looking to build expertise in business intelligence, data management, and emerging AI technologies. The successful candidate … will support data-driven decision making across the organization while developing technical skills in data analysis and visualization. Key Responsibilities: Data Management & Quality Perform data cleansing, validation, and quality assurance processes Identify and resolve data inconsistencies and anomalies Document data sources, transformations, and cleansing procedures Monitor data pipelines and ensure timely data updates Business Intelligence & Reporting Develop and maintain standard business reports and dashboards Create ad-hoc reports based on stakeholder requirements Support the creation of KPIs and performance metrics Assist in data visualization best practices implementation AI Integration & Prompt Engineering Create and optimize AI prompts for various business applications Collaborate More ❯

the best talent to strengthen our reputation as both a design practice and an employer of choice. We are seeking a motivated Junior BI Analyst to join our data analytics team. This role is perfect for an entry-level professional looking to build expertise in business intelligence, data management, and emerging AI technologies. The successful candidate … will support data-driven decision making across the organization while developing technical skills in data analysis and visualization. Key Responsibilities: Data Management & Quality Perform data cleansing, validation, and quality assurance processes Identify and resolve data inconsistencies and anomalies Document data sources, transformations, and cleansing procedures Monitor data pipelines and ensure timely data updates Business Intelligence & Reporting Develop and maintain standard business reports and dashboards Create ad-hoc reports based on stakeholder requirements Support the creation of KPIs and performance metrics Assist in data visualization best practices implementation AI Integration & Prompt Engineering Create and optimize AI prompts for various business applications Collaborate More ❯

Data Delivery and Integration Manager - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML … and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning of More ❯

Senior Data Engineer – Insurance Sector Location: Hybrid (London-based with flexible working) Salary: £85K -£100K – this is dependent on skills and experience Join a growing data team that’s transforming how the insurance industry uses data to make smarter, faster decisions. As a Senior Data Engineer , you’ll design and deliver scalable … high-performing data solutions that power analytics, reporting, and risk insights across the business. You’ll work closely with analysts, actuaries, and underwriters to build pipelines, models, and architectures that bring structure, speed, and accuracy to complex insurance data. This is a fantastic opportunity to make a real impact while shaping the future of data engineering … within a forward-thinking organisation. What You’ll Be Doing Partnering with analysts and product owners to turn business needs into scalable data solutions. Designing and maintaining robust data pipelines and models for analytics and reporting. Applying best practices in data architecture, security, and performance. Working with modern tools including Azure, Databricks, Python, Azure More ❯

Senior Data Engineer – Insurance Sector Location: Hybrid (London-based with flexible working) Salary: £85K -£100K – this is dependent on skills and experience Join a growing data team that’s transforming how the insurance industry uses data to make smarter, faster decisions. As a Senior Data Engineer , you’ll design and deliver scalable … high-performing data solutions that power analytics, reporting, and risk insights across the business. You’ll work closely with analysts, actuaries, and underwriters to build pipelines, models, and architectures that bring structure, speed, and accuracy to complex insurance data. This is a fantastic opportunity to make a real impact while shaping the future of data engineering … within a forward-thinking organisation. What You’ll Be Doing Partnering with analysts and product owners to turn business needs into scalable data solutions. Designing and maintaining robust data pipelines and models for analytics and reporting. Applying best practices in data architecture, security, and performance. Working with modern tools including Azure, Databricks, Python, Azure More ❯