1 to 25 of 197 Remote Data Pipeline Jobs in London

We have a current opportunity for a Data Engineer on a permanent basis. The position will be based in London. For further information about this position please apply. The team: You'll be working in a wider Data Management team alongside data engineers, data analysts & data governance specialists and facing … to stakeholders in the front office including product teams, analysts and traders. Your responsibilities: - Design and develop data catalogue and metadata management processes from data pipeline - Engineering data solutions - Implement data quality standards - Establish data governance and ensure data is fit for purpose - Understanding of data security, data architecture - Working alongside end users, stakeholders and data product teams Technology skillset: - Experience in data engineering, data modelling and data analytics [programming languages: Python, SQL, Alteryx] - Data Visualisation experience [tools: PowerBI, Tableau or similar] - MetaData management and data cataloguing [tools: Collibra, Alation More ❯

IR35) Databricks Engineer needed with active SC Security Clearance for 6 Month Contract based in Central London (Hybrid). Developing a cutting-edge Azure Databricks platform for economic data modelling, analysis, and forecasting. Start asap ideally in October 2025. Hybrid Working - 2 days/week remote (WFH), and 3 days/week working on-site from the Central … London office. A chance to work with a leading global IT and Digital transformation business specialising in Government projects: In-depth Data Engineering + strong hands-on Azure Databricks expertise. Azure Data Services, Azure Data Factory, Azure Blob Storage + Azure SQL Database. Designing, developing, building + optimising data pipelines, implementing data … including data modelling techniques + data integration patterns. Experience of working with complex data pipelines, large data sets, data pipeline optimization + data architecture design. Implementing complex data transformations using Spark, PySpark or Scala + working with SQL/MySQL databases. Experience with data More ❯

IR35) Databricks Engineer needed with active SC Security Clearance for 6 Month Contract based in Central London (Hybrid). Developing a cutting-edge Azure Databricks platform for economic data modelling, analysis, and forecasting. Start ASAP in Nov/Dec 2025. Hybrid Working - 2 days/week remote (WFH), and 3 days/week working on-site from the … Central London office. A chance to work with a leading global IT and Digital transformation business specialising in Government projects: In-depth Data Engineering + strong hands-on Azure Databricks expertise. Azure Data Services, Azure Data Factory, Azure Blob Storage + Azure SQL Database. Designing, developing, building + optimising data pipelines, implementing … including data modelling techniques + data integration patterns. Experience of working with complex data pipelines, large data sets, data pipeline optimization + data architecture design. Implementing complex data transformations using Spark, PySpark or Scala + working with SQL/MySQL databases. Experience with data More ❯

Position: Analytics Engineer Location: London (hybrid 3 times a week)Department: ITType: 3 months rolling contractOutside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. … Key Responsibilities Design and build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high experience within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and More ❯

Engineer Location: London (hybrid 3 times a week) Department: IT Type: 3 months rolling contract Outside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. … Key Responsibilities Design and build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high experience within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and More ❯

Job Title: Manager - Cloud Data Architect (AWS & Snowflake) Protiviti's UK ED&A practice offers a comprehensive range of data use cases delivered through various delivery and commercial routes. We work on the full data lifecycle with highly skilled and experienced data professionals. Our solutions range from data strategy and … governance through the development, design and implementation of advanced analytics and digitisation. About the Role We are seeking a Manager-level Cloud Data Architect with deep expertise in AWS cloud services , Snowflake , and AWS-native data platforms to lead the design and implementation of scalable, secure, and high-performance data solutions. You will play … a pivotal role in shaping our cloud data strategy, driving innovation, and mentoring teams to deliver enterprise-grade data architectures that enable advanced analytics and business intelligence for our clients. Key Responsibilities Architecture & Design Design end-to-end cloud data architectures using AWS and Snowflake, ensuring scalability, security, and performance. Define and promote best More ❯

energy and utilities, financial services, government and public services, health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the business at a period of huge growth. WE … growth area for the business with a diverse and growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such … requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data More ❯

you, this means working on challenging projects that demand innovation, collaboration, and thought leadership . Role – We are looking for a talented Analytics Engineer to join our growing data and analytics team. You will play a pivotal role in shaping the organisation’s data-driven strategy, working across data engineering, analytics, and business domains … to design scalable, high-quality data models and pipelines. This is a fantastic opportunity to work on cutting-edge projects using technologies such as Snowflake, dbt, Data Vault, and Azure/AWS , while collaborating with data architects, data scientists, and business stakeholders to deliver insights that drive measurable impact. Key Responsibilities: Act … as the bridge between engineering teams and business stakeholders , translating requirements into data solutions. Design, build, and maintain data pipelines and transformations that turn raw data into structured, analysis-ready datasets. Develop and optimise data models (including Data Vault and dimensional modelling) to support large-scale analytics. Implement and enforce More ❯

you, this means working on challenging projects that demand innovation, collaboration, and thought leadership . Role – We are looking for a talented Analytics Engineer to join our growing data and analytics team. You will play a pivotal role in shaping the organisation’s data-driven strategy, working across data engineering, analytics, and business domains … to design scalable, high-quality data models and pipelines. This is a fantastic opportunity to work on cutting-edge projects using technologies such as Snowflake, dbt, Data Vault, and Azure/AWS , while collaborating with data architects, data scientists, and business stakeholders to deliver insights that drive measurable impact. Key Responsibilities: Act … as the bridge between engineering teams and business stakeholders , translating requirements into data solutions. Design, build, and maintain data pipelines and transformations that turn raw data into structured, analysis-ready datasets. Develop and optimise data models (including Data Vault and dimensional modelling) to support large-scale analytics. Implement and enforce More ❯

Remote Data Architect sought by a well-established company in their industry; our client is seeking an adept professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. This unique opportunity is offered on a … remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: - Leading the design and implementation of innovative cloud data platforms. - Setting standards … using Azure, AWS, or exceptional on-premise design expertise. - At least 5 years in data engineering or business intelligence roles. - Proficiency in ETL and data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and demonstrable data modelling More ❯

Remote Data Architect sought by a well-established company in their industry; our client is seeking an adept professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. This unique opportunity is offered on a … remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: - Leading the design and implementation of innovative cloud data platforms. - Setting standards … using Azure, AWS, or exceptional on-premise design expertise. - At least 5 years in data engineering or business intelligence roles. - Proficiency in ETL and data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and demonstrable data modelling More ❯

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Data Engineer with Insurance experience to play a … key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You’ll help shape the data strategy, improve data quality, and empower the business to make data-driven decisions. As a Lead Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built More ❯

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Data Engineer with Insurance experience to play a … key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You’ll help shape the data strategy, improve data quality, and empower the business to make data-driven decisions. As a Lead Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built More ❯

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Data Engineer with Insurance experience to play a … key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You’ll help shape the data strategy, improve data quality, and empower the business to make data-driven decisions. As a Lead Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built More ❯

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Data Engineer with Insurance experience to play a … key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You’ll help shape the data strategy, improve data quality, and empower the business to make data-driven decisions. As a Lead Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built More ❯

Role Title: Pre-Sales & Data Solution Architect Business Unit/Segment: Data Management Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent Summary Our client, a leading global data and AI consultancy, is seeking a Pre-Sales & Data Solution Architect Lead - hybrid role to become one of their leaders in this … area in their Data Management practice with a focus on banking clients . This is a strategic, client-facing role where you will partner with senior stakeholders to modernise data platforms, accelerate cloud adoption, and drive measurable business value. The role combines technical leadership with consulting and pre-sales expertise . You will design enterprise data … as a trusted advisor, leading workshops and influencing senior stakeholders on strategy, roadmaps, and innovation. ETL/ELT & Data Engineering – Provide oversight on robust data pipeline and integration designs using SSIS, ADF, Informatica, or IBM DataStage. Data Governance & Quality – Define governance, metadata, and quality frameworks using tools such as Unity Catalog, Profisee, Alation More ❯

Role Title: Pre-Sales & Data Solution Architect Business Unit/Segment: Data Management Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent Summary Our client, a leading global data and AI consultancy, is seeking a Pre-Sales & Data Solution Architect Lead - hybrid role to become one of their leaders in this … area in their Data Management practice with a focus on banking clients . This is a strategic, client-facing role where you will partner with senior stakeholders to modernise data platforms, accelerate cloud adoption, and drive measurable business value. The role combines technical leadership with consulting and pre-sales expertise . You will design enterprise data … as a trusted advisor, leading workshops and influencing senior stakeholders on strategy, roadmaps, and innovation. ETL/ELT & Data Engineering – Provide oversight on robust data pipeline and integration designs using SSIS, ADF, Informatica, or IBM DataStage. Data Governance & Quality – Define governance, metadata, and quality frameworks using tools such as Unity Catalog, Profisee, Alation More ❯

Role Title: Pre-Sales & Data Solution Architect Business Unit/Segment: Data Management Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent Summary Our client, a leading global data and AI consultancy, is seeking a Pre-Sales & Data Solution Architect Lead - hybrid role to become one of their leaders in this … area in their Data Management practice with a focus on banking clients . This is a strategic, client-facing role where you will partner with senior stakeholders to modernise data platforms, accelerate cloud adoption, and drive measurable business value. The role combines technical leadership with consulting and pre-sales expertise . You will design enterprise data … as a trusted advisor, leading workshops and influencing senior stakeholders on strategy, roadmaps, and innovation. ETL/ELT & Data Engineering – Provide oversight on robust data pipeline and integration designs using SSIS, ADF, Informatica, or IBM DataStage. Data Governance & Quality – Define governance, metadata, and quality frameworks using tools such as Unity Catalog, Profisee, Alation More ❯

Data Engineer (Azure, Snowflake, DBT) | Insurance | London (Hybrid) Robert Half International (an S&P 500 global staffing provider) is supporting a global consulting firm in sourcing an experienced Data Engineer to join a major insurance client engagement.The role focuses on building out a Snowflake Data Warehouse established last year and scaling it to support … multiple new data use cases across the business. Assignment Details Initial Duration: 6-12 months (until March 2026, likely extension given scope) Location: Hybrid - minimum of 2 days per week in London Day Rate: £450 PAYE (plus 12.07% holiday pay - PAYE with employer's NI & Tax deducted at source, unlike umbrella companies and no umbrella company admin fees … modular data modelling, testing, documentation, and CI/CD integration. Skilled in Azure Data Factory, Synapse, and Databricks for end-to-end data pipeline orchestration. Excellent SQL engineering capability; experience designing data models for analytics and operational reporting. Proven track record in the insurance or wider financial services sector , ideally with More ❯

Senior Data Engineer (Python/AWS) Full-time | London, UK Hybrid working: 2-3 days per week on-site Must be SC cleared, or eligible to obtain SC-level security clearance Job description We are looking for a developer with expertise in Python, AWS Glue, step function, EMR cluster and redshift, to join our AWS Development Team. You … be required as part of the interview process. Key responsibilities Hands-on experience in Python programming is essential Responsible for Build, Test and Maintain optimal AWS data pipeline architecture. Building AWS glue, step function, AWS Lambda functions and unit test Work with fellow developers, data architects, data analysts and data scientists … application infrastructure, suggesting changes to it Define and document best practices and strategies regarding application deployment and infrastructure maintenance Define service capacity planning strategies Implement the application's CICD pipeline using the AWS CICD stack Project tasks deliverables and management Deliver on project progress and ensure adherence to client expectation Communications, including deck writing Delivery of output Gathering of More ❯

complexity manageable and insight actionable - supporting everything from premium and ads growth to forecasting, experimentation, and global reporting. Location London Job type Permanent As engineers in the Financial Data Platform team, we turn messy, fragmented realities into clean, reusable foundations. We build core datasets that represent key financial domains like Premium, Ads, and Royalties. We create libraries and … tools that empower others to produce and trust financial data at scale. We collaborate deeply with Finance, Product, and Data teams to unlock clarity and drive Spotify's ambitions forward. We are looking for engineers who are excited to shape the future of financial data at Spotify. You will design and operate scalable pipelines … that process billions of records. You will apply product thinking to financial data - managing the full lifecycle from sourcing to documentation to exposure. You will define abstractions that simplify complexity and create intuitive paths for our consumers. Together, we advocate for standards, champion quality, and build systems that others can rely on with confidence. If you thrive on More ❯

Robert Half Technology are assisting a market leading financial services organisation to recruit a Data Engineer on a contract basis. Outside IR35. Hybrid working - London based. Role The Data Engineer will design, develop, and maintain data infrastructure to ensure reliability, scalability, and performance. Collaborate with data scientists and analysts to fulfil their … data requirements and support their work. Collect and process datasets from various sources, ensuring data quality and … integrity. Implement efficient data models and schemas for storage and retrieval. Optimise data processes for improved performance and efficiency. Troubleshoot and resolve data pipeline issues swiftly and effectively. Keep abreast of industry trends and emerging technologies in data engineering, and continuously improve your skills and knowledge. Profile The Data More ❯

more than just a media agency; we are people people . At our core lies a commitment to understanding, trust, integrity, and delivering results. With a focus on data-driven decision-making, we have built a reputation for driving tangible outcomes for our clients. As an employee-owned organisation, we value our team members' contributions and provide them … s future. Join us, and let's create meaningful change together. The Role As an AI Engineer, you will head up the design, build, and optimisation of our data infrastructure, automation solutions, and AI-driven tools. Leading Data Architecture, MarTech, AI & Automation, you will ensure that data flows seamlessly across the business and is … harnessed effectively to drive client performance. This role requires a mix of technical expertise, leadership, and client-facing skills. You will manage and develop team members, oversee data engineering projects, and take ownership of the agency's core data pipelines and platforms using Artificial Intelligence. You will also play a key role in exploring and embedding More ❯

more than just a media agency; we are people people . At our core lies a commitment to understanding, trust, integrity, and delivering results. With a focus on data-driven decision-making, we have built a reputation for driving tangible outcomes for our clients. As an employee-owned organisation, we value our team members' contributions and provide them … s future. Join us, and let's create meaningful change together. The Role As an AI Engineer, you will head up the design, build, and optimisation of our data infrastructure, automation solutions, and AI-driven tools. Leading Data Architecture, MarTech, AI & Automation, you will ensure that data flows seamlessly across the business and is … harnessed effectively to drive client performance. This role requires a mix of technical expertise, leadership, and client-facing skills. You will manage and develop team members, oversee data engineering projects, and take ownership of the agency's core data pipelines and platforms using Artificial Intelligence. You will also play a key role in exploring and embedding More ❯

more than just a media agency; we are people people . At our core lies a commitment to understanding, trust, integrity, and delivering results. With a focus on data-driven decision-making, we have built a reputation for driving tangible outcomes for our clients. As an employee-owned organisation, we value our team members' contributions and provide them … s future. Join us, and let’s create meaningful change together. The Role As an AI Engineer, you will head up the design, build, and optimisation of our data infrastructure, automation solutions, and AI-driven tools. Leading Data Architecture, MarTech, AI & Automation, you will ensure that data flows seamlessly across the business and is … harnessed effectively to drive client performance. This role requires a mix of technical expertise, leadership, and client-facing skills. You will manage and develop team members, oversee data engineering projects, and take ownership of the agency’s core data pipelines and platforms using Artificial Intelligence. You will also play a key role in exploring and embedding More ❯