26 to 50 of 297 Data Pipeline Jobs in London

Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in London London location – hybrid working when possible Must hold active Enhanced DV Clearance Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data … delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework ...

Overview We’re looking for a mid-level Data Engineer to design, build, and deploy high-quality data solutions across Chambers’ products, platforms, and applications, ensuring they meet data engineering best practices and quality standards. In this role, you will champion engineering excellence … cloud-based data platforms (e.g., Azure, AWS, GCP) and integration with modern data pipelines. Ability to monitor, troubleshoot, and optimize pipeline performance , ensuring data quality and reliability. Experience collaborating with data scientists, analysts, and product teams to deliver robust data ...

Databricks (including Delta Live Tables). Develop robust ETL/ELT workflows ingesting data from operational, telemetry, and third-party systems. Optimise pipeline performance, reliability, and cost efficiency in cloud environments. Ensure data quality, lineage, governance, and documentation across production systems. Collaborate cross-functionally with … analytics, product, and platform teams. Support CI/CD automation for data pipeline deployment. Contribute to reusable frameworks and engineering best practices within the team. Essential experience Candidates must have prior, hands-on experience working with at least one of the following APM platforms : Power Factors Bazefield ...

week on site) £65-75k (dependent on experience) The Highlights This global logistics business, based in central London, is undergoing an exciting data transformation programme as it invests in a new team charged with building and implementing a new Azure Databricks platform. Working five days a week … central London office, you'll join this growing team and play a key role in building and deploying robust data infrastructure and analytics solutions using modern data stack The business is evolving and maturing its approach to data, creating an opportunity to build data ...

Factory , Databricks , and related Azure services. Build ETL/ELT processes to transform raw data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data … Azure SQL Database, Synapse Analytics). Strong hands-on expertise in Databricks , Delta Lake , and cluster management . Proficiency in SQL and Python for pipeline development. Familiarity with Git/GitHub and CI/CD practices. Understanding of data modelling , data governance , and security principles. ...

Factory, Databricks, and related Azure services. Build ETL/ELT processes to transform raw data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data … ADLS, Azure SQL Database, Synapse Analytics). Strong hands-on expertise in Databricks, Delta Lake, and cluster management. Proficiency in SQL and Python for pipeline development. Familiarity with Git/GitHub and CI/CD practices. Understanding of data modelling, data governance, and security principles. ...

Senior Data Engineer Fully Remote 6 Months Contract £600 Inside IR35 (PAYE Rate) + Holiday Overview We’re looking for a talented and motivated Data Engineer to join a growing Data Engineering team delivering high-quality, enterprise-scale data solutions. This … great opportunity to work in a collaborative, technically strong environment using Microsoft technologies to build robust data platforms that enable data-driven decision-making across the business.You’ll work closely with Architects, Senior Engineers, and a wide range of stakeholders to design, develop, and deliver scalable ...

Senior Azure Data Engineer Hybrid - Work From Home and West London Circ £70,000 - £80,000 + Range of benefits A well-known and prestigious business is looking to add a Senior Azure Data Engineer to their data team. This is an exciting opportunity … Data Engineer that's not just technical, but also enjoys directly engaging and collaborating with stakeholders from across business functions. Having nearly completed the process of migrating data from their existing on-prem databases to an Azure Cloud based platform, the Senior Data Engineer ...

Azure Data Engineer - 3–6-month contract We are looking for a Data Engineer to join a growing digital and data function supporting a modern, cloud-based data platform. This role focuses on building reliable, secure, and scalable data solutions … that enable analytics, operational reporting, and data-driven decision making across the organisation. You will work closely with technical and non-technical stakeholders to deliver well-engineered data pipelines and models, contributing to the continuous improvement of data platforms and engineering standards. Azure data ...

Senior Data Engineer, Azure London (Hybrid) £90,000 + bonus + excellent benefits Azure Data Factory, Databricks, Python, SQL Senior Data Engineer is required to join a leading London-based insurance organisation with offices in the heart of the city. Working within a high … impact, specialist data team this role will see you building and evolving a modern Azure-based Data Lakehouse, supporting underwriting insight, analytics and decision-making at scale. You will work closely with senior business stakeholders, regional data teams and IT, combining hands-on engineering ...

Cleared Data Consultants and Analysts – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity … you. Morela is proud to partner with one of the UK's leading data consultancies, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled SC Cleared Data Consultant and Analysts to join their ...

Cleared Data Consultants and Analysts – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity … you. Morela is proud to partner with one of the UK's leading data consultancies, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled DV Cleared Data Consultant and Analysts to join their ...

Data Engineering Offering Lead Salary: £80,000 – £100,000 + benefits Location: UK-wide (client-site travel required) Clearance: SC or SC-clearable Type: Permanent We’re partnering with a growing consulting business that is expanding its Data & AI practice and looking for a Data Engineering Offering Lead to define, build and lead their modern data engineering capability. This is a strategic, hands-on consulting role focused on designing scalable data platforms, leading client engagements and shaping the firm’s go-to-market data engineering offering. What ...

Cleared Data Consultants and Analysts – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity … you. Morela is proud to partner with one of the UK's leading data consultancies, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled DV and SC Cleared Data Consultant and Analysts ...

Title: Data Domain Governance Lead Location: Bromley, UK Job Type: Hybrid(3Days/Onsite) The Data Domain Governance Lead is responsible for embedding robust data governance practices across Agile delivery teams within banking domain. Operating within a SAFe Agile framework, this role ensures that … data standards, models, lineage, privacy, and controls are consistently applied across delivery pipelines. The successful candidate will bring deep expertise in data architecture, metadata management, privacy compliance, and data quality, enabling scalable and audit-ready data ecosystems. Key Responsibilities: Portfolio & Program Alignment ...

Title: Data Domain Governance Lead Location: Bromley, UK Job Type: Hybrid(3Days/Onsite) The Data Domain Governance Lead is responsible for embedding robust data governance practices across Agile delivery teams within banking domain. Operating within a SAFe Agile framework, this role ensures that … data standards, models, lineage, privacy, and controls are consistently applied across delivery pipelines. The successful candidate will bring deep expertise in data architecture, metadata management, privacy compliance, and data quality, enabling scalable and audit-ready data ecosystems. Key Responsibilities: Portfolio & Program Alignment ...

Lead Data Engineer (Azure & Terraform) Salary: Up to £90,000 + benefits Location: UK (Hybrid - 3 Days Per Week in London Office) I'm currently working with an established organisation that is entering an exciting phase of technical transformation and is now looking to appoint a Lead Data Engineer to take ownership of its data engineering capability. This role has evolved as the business scales its cloud and data platforms, and they are now seeking someone who can provide technical leadership, set best practice, and play a hands-on role in building ...

Overview Chambers and Partners is seeking a Data Product Manager with deep expertise in data and analytics to drive the vision, strategy, and delivery of our data products. This is a high-impact role, working closely with our Data Engineering teams … advice on expected interview topics/questions. Main Duties and Responsibilities Product Direction & Roadmaps Develop and communicate a clear direction for our data products, aligned with our strategic and commercial goals. Translate strategy into actionable product roadmaps that provide clarity and focus for delivery teams. Product Development Lead ...

Robert Half Technology are assisting a market leading financial services organisation to recruit a Data Engineer on a contract basis. Hybrid working - London based Role The Data Engineer will design, develop, and maintain data infrastructure to ensure reliability, scalability, and performance. Collaborate with data … models and schemas for storage and retrieval. Optimise data processes for improved performance and efficiency. Troubleshoot and resolve data pipeline issues swiftly and effectively. Keep abreast of industry trends and emerging technologies in data engineering, and continuously improve your skills and knowledge. ...

Databricks Engineer - £400PD - Remote About the Role We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures … pipelines. Collaborate with data scientists, analysts, and cross-functional teams to deliver reliable, production-grade data models. Monitor and tune pipeline performance to ensure efficiency, reliability, and cost optimisation. Participate in CI/CD processes and infrastructure-as-code solutions using tools like Terraform, GitHub ...

Senior Data Engineer/Data Scientist sought by leading investment bank based in the city of London.**Inside IR35 - 4 days a week on site** Overview Data Engineer/Data Scientist role supporting Front Office operations with expertise in data engineering, and stakeholder management in investment banking environment. Key Responsibilities Build data pipelines for real-time and batch processing of financial data Partner with traders, portfolio managers, and risk teams to deliver analytics solutions Ensure compliance with regulatory reporting requirements Optimize data ...

Data Engineer Rate: Up to £325 per day (Outside IR35) Contract Length: 6 Months (with strong potential for extension) Location: Hybrid - 1 day per week onsite in Central London A leading organisation is seeking an experienced AWS Data Engineer to join their data and analytics team, contributing to the design, development and optimisation of large-scale data solutions within a modern cloud environment. This contract offers the opportunity to work on high-impact projects, delivering data platforms and pipelines that drive real-time insights and strategic business ...

Robert Half Technology are assisting a growing AI platform to recruit a Data Engineer (Snowflake & GenAI) on a permanent basis. Hybrid working - UK based. Role * Design, build, and maintain scalable data pipelines and models on Snowflake to support analytics and GenAI workloads.* Develop and support GenAI … observability, and monitoring across the data platform.* Contribute to platform automation, CI/CD, and DataOps best practices.* Troubleshoot data pipeline and platform issues to ensure high availability and reliability. Profile * Strong experience as a Data Engineer working with Snowflake in a production ...

Head of Data Engineering (12 Month FTC) London - 2 Days in London Up to £115,000 + 15% Bonus We're partnering with an exciting start-up, created by two fortune 100 companies, on a Head of Data Engineering hire based in London. This … senior leadership role owning the data engineering function for a business operating at the heart of the US generic pharmaceuticals supply chain , where data quality, governance, and scale are mission-critical. This role suits an experienced data engineering leader who enjoys operating in complex ...

Role: Data Engineer Location: City of London Salary: £70k Flexible working: 2 days a week in the office I am working with a leading insurance company who are looking for an experience Data Engineer to join their team. This will … great opportunity to work on exciting transformational projects and take your career to the next level. Skills and experience Experience using Data pipeline tools Strong experience with SQL and Python Azure Data stack & Azure SQL Hands on experience with Databricks Experienced with data ...