1 to 25 of 30 Permanent Data Pipeline Jobs in Central London

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in … a dynamic, fast-growing category? If so, you might be the ideal candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting … technical proficiency in data modelin g , SQL, NoSQL databases, and data warehousing . Hands-on experience with data pipeline development, ETL processes, and big data technolo g ies (e. g ., Hadoop, Spark, Kafka). Proficiency in cloud platforms such as More ❯

Head of Data Engineering – Databricks, Azure, Data Strategy, Data Governance, Leadership, Management, Azure, Python, ETL, Data Pipelines, Private Markets A global Private Equity firm are seeking an experienced Head of Data Engineering as part of a critical data transformation and modernisation programme, moving towards a data-first approach. They are currently in the process of replacing a legacy data-warehouse setup with a platform as a service model using Databricks hosted on Azure, which this role will be responsible for leading, taking … line management responsibilities for their Data Engineering team. You will take ownership for progressing their Databricks setup, from its current PoC/incubator phase through to production, ensuring a high level of optimisation and scalability to operate at a global scale. This will also involve implementing a semantic More ❯

Head of Data Engineering – Databricks, Azure, Data Strategy, Data Governance, Leadership, Management, Azure, Python, ETL, Data Pipelines, Private Markets A global Private Equity firm are seeking an experienced Head of Data Engineering as part of a critical data transformation and modernisation programme, moving towards a data-first approach. They are currently in the process of replacing a legacy data-warehouse setup with a platform as a service model using Databricks hosted on Azure, which this role will be responsible for leading, taking … line management responsibilities for their Data Engineering team. You will take ownership for progressing their Databricks setup, from its current PoC/incubator phase through to production, ensuring a high level of optimisation and scalability to operate at a global scale. This will also involve implementing a semantic More ❯

Head of Data Engineering – Databricks, Azure, Data Strategy, Data Governance, Leadership, Management, Azure, Python, ETL, Data Pipelines, Private Markets A global Private Equity firm are seeking an experienced Head of Data Engineering as part of a critical data transformation and modernisation programme, moving towards a data-first approach. They are currently in the process of replacing a legacy data-warehouse setup with a platform as a service model using Databricks hosted on Azure, which this role will be responsible for leading, taking … line management responsibilities for their Data Engineering team. You will take ownership for progressing their Databricks setup, from its current PoC/incubator phase through to production, ensuring a high level of optimisation and scalability to operate at a global scale. This will also involve implementing a semantic More ❯

vital role in owning the Databricks strategy and how they use it to innovate across their industry-leading brands. Designing and developing robust data frameworks, powering real-time data pipelines, and creating data services that deliver actionable insights to their global customer base. Role … with business goals Architectural Leadership: Serve as the owner and responsible person for all Databricks- related activities, acting as the architect across the Data Engineering, Data Analytics, and Data Science teams. Collaboration Enablement: Bridge the gap between teams by setting up templates and frameworks … for seamless collaboration, data sharing, and enablement aligned with the product vision. Unity Catalogue Management: Manage Unity catalogue, including permissions, usage, paths, locations, and implementation, ensuring data accessibility, security, and reliability. Guidance and Training: Provide guidance, support, and training to teams regarding Databricks usage, offering best More ❯

Job Title: Senior Data Engineer - 12 month FTC Location: London/Hybrid (2 days per week onsite) Salary: Competative market rate + bonus + benefits Why Apply? This is an exciting opportunity for an experienced Azure Data Engineer to play a key role in delivering the … next phase of a business-critical data programme. You'll apply your technical expertise across Azure Databricks, Data Factory, Azure SQL, and SQL Server, contributing directly to the integration of financial data into a new Azure Data Platform. Responsibilities: Design, build and … optimise scalable data solutions using Azure cloud technologies. Lead the development of data pipelines in Azure Databricks, Data Factory, and T-SQL. Provide senior-level technical direction to onshore and offshore development teams. Translate data requirements into effective data engineering More ❯

Job Title: Senior Data Engineer - 12 month FTC Location: London/Hybrid (2 days per week onsite) Salary: Competative market rate + bonus + benefits Why Apply? This is an exciting opportunity for an experienced Azure Data Engineer to play a key role in delivering the … next phase of a business-critical data programme. You'll apply your technical expertise across Azure Databricks, Data Factory, Azure SQL, and SQL Server, contributing directly to the integration of financial data into a new Azure Data Platform. Responsibilities: Design, build and … optimise scalable data solutions using Azure cloud technologies. Lead the development of data pipelines in Azure Databricks, Data Factory, and T-SQL. Provide senior-level technical direction to onshore and offshore development teams. Translate data requirements into effective data engineering More ❯

Data Engineer Azure | Databricks | PySpark | Hybrid Cloud | Fabric Location: London (Hybrid) Salary: £85,000 + Bonus + Benefits Type: Permanent A Data Engineer is required for a fast-evolving (re)insurance business at the heart of the Lloyd's market, currently undergoing a major data transformation. With a strong foundation in the industry and a clear vision for the future, they're investing heavily in their data capabilities to build a best-in-class platform that supports smarter, faster decision-making across the business. As part of this journey, they're … impact data solutions. Support DevOps practices and CI/CD workflows in Azure Technical Requirements: Strong hands-on experience with: Databricks (including pipeline development and orchestration) PySpark and Python for data transformation and processing Azure Data Factory for data integration Solid More ❯

Data Engineer Azure | Databricks | PySpark | Hybrid Cloud | Fabric Location: London (Hybrid) Salary: £85,000 + Bonus + Benefits Type: Permanent A Data Engineer is required for a fast-evolving (re)insurance business at the heart of the Lloyd's market, currently undergoing a major data transformation. With a strong foundation in the industry and a clear vision for the future, they're investing heavily in their data capabilities to build a best-in-class platform that supports smarter, faster decision-making across the business. As part of this journey, they're … impact data solutions. Support DevOps practices and CI/CD workflows in Azure Technical Requirements: Strong hands-on experience with: Databricks (including pipeline development and orchestration) PySpark and Python for data transformation and processing Azure Data Factory for data integration Solid More ❯

Senior Data Engineer - SC Cleared Remote (UK-based) £75,000 - 85,000 + Benefits Full-Time | Central Government Projects We're looking for an experienced Senior Data Engineer to lead the design and delivery of secure, scalable, cloud-native data solutions across high-impact … remote role , but active SC clearance is essential . Applicants without current SC clearance cannot be considered. As a senior member of the Data Engineering team, you'll play a pivotal role in designing high-quality data pipelines, guiding delivery teams, and collaborating with cross-functional … experts to solve complex data challenges. You'll champion engineering best practices and bring thought leadership to technical planning, client engagement, and innovation. What You'll Be Doing Designing and delivering robust, secure data pipelines using tools like Azure Data Factory , dbt , Fabric , and More ❯

My client is based in the London area are currently looking to recruit for an experienced AWS Databricks Data Architect to join their team. They are one of the leaders within the consulting space and are currently going through a period of growth and are looking for an … experienced Data Architect to join their team. They are backed by a huge Multi National equity firm who are looking to bolster my clients financial position. They are expected to see year on year growth, which will allow them to implement and utilise the most in demand and … role will include: Responsible for designing and implementing effective Architectural solutions around the AWS Severless Technologies (S3, Lambda, Athena, Kafka) and Databricks including Data Lake and Data Warehousing. Assess database implementation procedures to ensure they comply with GDPR and data compliance. Guide, influence and More ❯

Role: Senior Software Engineer , Data Solutions Location: Hybrid (2 days on-site in Central London) Salary: £70,000 to £80,000 + Excellent Benefits Candidates must be eligible for UK Security Clearance The Opportunity We are proud to be working in partnership with a major defence systems integrator … into a critical delivery team. This is a unique opportunity to join a high-performing, mission-led environment focused on building robust, scalable data and analytics platforms for government and defence customers. This hybrid role offers the chance to work on-site in London just two days a … week initially, with increased flexibility over time. You'll be part of a team delivering impactful solutions in a secure and complex data landscape—an ideal environment for those who want to develop cutting-edge systems and contribute to national resilience. The Role As a Senior Software Engineer More ❯

into a critical delivery team. This is a unique opportunity to join a high-performing, mission-led environment focused on building robust, scalable data and analytics platforms for government and defence customers. This hybrid role offers the chance to work on-site in London just two days a … week initially, with increased flexibility over time. You'll be part of a team delivering impactful solutions in a secure and complex data landscape—an ideal environment for those who want to develop cutting-edge systems and contribute to national resilience. The Role As a Senior Frontend Developer … you will play a pivotal role in the design, development, and operation of innovative front-end solutions that interface with enterprise-scale data ecosystems. Working in close collaboration with data engineers, delivery managers, external partners, and client stakeholders, you will help drive the transformation of critical More ❯

A small and rapidly growing Consultancy are looking for a Lead Data Scientist to join their expanding team - this is a hybrid role, requiring around 2-3 days per week either in the office or on client site, depending on requirements. Many of their clients are in the … role. In this role, you will lead on client projects and provide them with subject matter expertise - you'll proactively identify opportunities for data science to be used to help solve their unique challenges, and will action this appropriately. This will involve working with varied data sources, and designing and implementing various data science and machine learning techniques and algorithms, both on-premises and on the cloud, depending on what's best for each particular client. You'll communicate your findings and insight to the client, getting involved in presentations to uncover More ❯

growing tech team working on an exciting new platform. This is an opportunity to work with cutting-edge search technologies and large-scale data processing while contributing to a product that makes a real impact. Your Role As a Senior Java Developer, you’ll play a key role … in designing, building, and maintaining a robust data platform that powers our core products. You’ll collaborate with cross-functional teams to create highly performant and scalable solutions. Key Responsibilities: Deliver high-quality, well-structured code using Agile and TDD practices Develop new features across the full stack … front-end to Java-based backend services Build and optimize search solutions using technologies like Apache Lucene, Solr, or OpenSearch Design and implement data pipelines in collaboration with Data Engineers Work with cloud technologies (Azure, AWS, or GCP) for scalable data processing Conduct code More ❯

Data Engineer | Hybrid | £45K–£65K + Equity | London (No Sponsorship) Gravitas is partnering with a high-growth startup that’s building infrastructure for the insurance industry. We’re hiring a Data Engineer to join their London-based team (hybrid – up to 3 remote days/week … . This is a hands-on, client-facing role for someone who enjoys working with complex data sets and seeing the real-world impact of their work. The Opportunity Hybrid model: Central London office, up to 3 days remote Salary: £45,000–£65,000 + up to 0.15 … equity Type: Permanent, full-time Sponsorship: Not available What You’ll Be Doing Ingest, clean, and transform structured and unstructured insurance/financial data Build Python and SQL scripts to map client data to internal models Work directly with clients to understand requirements and deliver data More ❯

Data Engineer | Hybrid | £45K–£65K + Equity | London (No Sponsorship) Gravitas is partnering with a high-growth startup that’s building infrastructure for the insurance industry. We’re hiring a Data Engineer to join their London-based team (hybrid – up to 3 remote days/week … . This is a hands-on, client-facing role for someone who enjoys working with complex data sets and seeing the real-world impact of their work. The Opportunity Hybrid model: Central London office, up to 3 days remote Salary: £45,000–£65,000 + up to 0.15 … equity Type: Permanent, full-time Sponsorship: Not available What You’ll Be Doing Ingest, clean, and transform structured and unstructured insurance/financial data Build Python and SQL scripts to map client data to internal models Work directly with clients to understand requirements and deliver data More ❯

Join a leading force in the music industry, empowering artists at every stage of their careers. We're looking for a Lead Data Engineer to spearhead the development and optimisation of our cutting-edge Analytic Data Platform (ADP). You’ll design scalable data solutions, lead a talented team of engineers, and collaborate across tech and business teams to deliver impactful data products. Your work will directly support strategic decision-making and innovation across the company. What you’ll do: Architect and build efficient, reliable data pipelines and … products. Lead and mentor a growing data engineering team. Collaborate with DevOps, QA, IT Ops, analysts, and business experts. Champion best practices in data design, development, and cloud architecture. Stay on top of the latest tools and trends, especially in AWS and open-source data More ❯

Palantir Foundry Consultant – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions using Palantir Foundry? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you. … Morela is proud to partner with one of the UK's leading Palantir consultancies, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled Palantir Foundry Consultant to join their dynamic team. This role is perfect for someone … advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a Palantir Foundry Consultant, you'll play a crucial role in designing and implementing data solutions that empower clients to More ❯

Senior Python Engineer – Cloud & Data Orchestration 📍 Hybrid (1–2 days/week in office) | 💼 £140k+ Package | 🕵️‍♂️ Security-Cleared or Security Clearable required Location: London | Sector: Intelligence, Analytics & Secure Data | Process: 3 stages Our client is a mission-driven consultancy delivering high-impact intelligence, research, and technical … re hiring a Lead Software Engineer/Founding Engineer to take the reins of a specialist engineering unit delivering microservice-based cloud and data solutions at scale. This is a hands-on technical leadership role where you'll work closely with the CTO, shape architecture and tooling, and … the future of our engineering capability. 🔍 What You’ll Be Doing Leading a growing team (currently 2 engineers + external partners) across complex data and cloud engineering projects Designing and delivering distributed solutions on an AWS-centric stack, with open-source flexibility Working with Databricks, Apache Iceberg, and More ❯

Senior Python Engineer – Cloud & Data Orchestration 📍 Hybrid (1–2 days/week in office) | 💼 £140k+ Package | 🕵️‍♂️ Security-Cleared or Security Clearable required Location: London | Sector: Intelligence, Analytics & Secure Data | Process: 3 stages Our client is a mission-driven consultancy delivering high-impact intelligence, research, and technical … re hiring a Lead Software Engineer/Founding Engineer to take the reins of a specialist engineering unit delivering microservice-based cloud and data solutions at scale. This is a hands-on technical leadership role where you'll work closely with the CTO, shape architecture and tooling, and … the future of our engineering capability. 🔍 What You’ll Be Doing Leading a growing team (currently 2 engineers + external partners) across complex data and cloud engineering projects Designing and delivering distributed solutions on an AWS-centric stack, with open-source flexibility Working with Databricks, Apache Iceberg, and More ❯

Data Engineer | Hybrid | £45K–£65K + Equity | London (No Sponsorship) Gravitas is partnering with a high-growth startup that’s building infrastructure for the insurance industry. We’re hiring a Data Engineer to join their London-based team (hybrid – up to 3 remote days/week … . This is a hands-on, client-facing role for someone who enjoys working with complex data sets and seeing the real-world impact of their work. The Opportunity Hybrid model: Central London office, up to 3 days remote Salary: £45,000–£65,000 + up to 0.15 … equity Type: Permanent, full-time Sponsorship: Not available What You’ll Be Doing Ingest, clean, and transform structured and unstructured insurance/financial data Build Python and SQL scripts to map client data to internal models Work directly with clients to understand requirements and deliver data More ❯

Leading Financial Services client is currently going through a large Data transformation and is looking for Data Solution Manager to join them on this exciting journey. The roles are offering a base between £80,0000 to £85,000pa + a strong benefits package and flexible working. … One day in office in every 3 months in East Sussex As a Data Solution Manager you will report to our Head of Data Delivery and lead a small team of some of the best engineers in the industry to deliver, improve and maintain robust data pipelines within our ambitious data architecture. Requirements: You will have a strong background in data engineering, with experience in managing and mentoring other engineers. You should have significant experience with Snowflake and Microsoft Azure, particularly Azure Data Factory and Azure Dev Ops. More ❯

Lead Software Engineer – Cloud & Data Orchestration Hybrid (1–2 days/week in office) | £140k+ Package | ️‍♂️ Security-Cleared or Security Clearable required Location: London | Sector: Intelligence, Analytics & Secure Data | Process: 3 stages Our client is a mission-driven consultancy delivering high-impact intelligence, research, and technical … re hiring a Lead Software Engineer/Founding Engineer to take the reins of a specialist engineering unit delivering microservice-based cloud and data solutions at scale. This is a hands-on technical leadership role where you'll work closely with the CTO, shape architecture and tooling, and … the future of our engineering capability. What You’ll Be Doing Leading a growing team (currently 2 engineers + external partners) across complex data and cloud engineering projects Designing and delivering distributed solutions on an AWS-centric stack, with open-source flexibility Working with Databricks, Apache Iceberg, and More ❯

Lead Software Engineer – Cloud & Data Orchestration 📍 Hybrid (1–2 days/week in office) | 💼 £140k+ Package | 🕵️‍♂️ Security-Cleared or Security Clearable required Location: London | Sector: Intelligence, Analytics & Secure Data | Process: 3 stages Our client is a mission-driven consultancy delivering high-impact intelligence, research, and technical … re hiring a Lead Software Engineer/Founding Engineer to take the reins of a specialist engineering unit delivering microservice-based cloud and data solutions at scale. This is a hands-on technical leadership role where you'll work closely with the CTO, shape architecture and tooling, and … the future of our engineering capability. 🔍 What You’ll Be Doing Leading a growing team (currently 2 engineers + external partners) across complex data and cloud engineering projects Designing and delivering distributed solutions on an AWS-centric stack, with open-source flexibility Working with Databricks, Apache Iceberg, and More ❯