19 of 19 Permanent Data Pipeline Jobs in the City of London

Head of Data Engineering – Databricks, Azure, Data Strategy, Data Governance, Leadership, Management, Azure, Python, ETL, Data Pipelines, Private Markets A global Private Equity firm are seeking an experienced Head of Data Engineering as part of a critical data transformation and modernisation programme, moving towards a data-first approach. They are currently in the process of replacing a legacy data-warehouse setup with a platform as a service model using Databricks hosted on Azure, which this role will be responsible for leading, taking … line management responsibilities for their Data Engineering team. You will take ownership for progressing their Databricks setup, from its current PoC/incubator phase through to production, ensuring a high level of optimisation and scalability to operate at a global scale. This will also involve implementing a semantic More ❯

Head of Data Engineering – Databricks, Azure, Data Strategy, Data Governance, Leadership, Management, Azure, Python, ETL, Data Pipelines, Private Markets A global Private Equity firm are seeking an experienced Head of Data Engineering as part of a critical data transformation and modernisation programme, moving towards a data-first approach. They are currently in the process of replacing a legacy data-warehouse setup with a platform as a service model using Databricks hosted on Azure, which this role will be responsible for leading, taking … line management responsibilities for their Data Engineering team. You will take ownership for progressing their Databricks setup, from its current PoC/incubator phase through to production, ensuring a high level of optimisation and scalability to operate at a global scale. This will also involve implementing a semantic More ❯

Head of Data Engineering – Databricks, Azure, Data Strategy, Data Governance, Leadership, Management, Azure, Python, ETL, Data Pipelines, Private Markets A global Private Equity firm are seeking an experienced Head of Data Engineering as part of a critical data transformation and modernisation programme, moving towards a data-first approach. They are currently in the process of replacing a legacy data-warehouse setup with a platform as a service model using Databricks hosted on Azure, which this role will be responsible for leading, taking … line management responsibilities for their Data Engineering team. You will take ownership for progressing their Databricks setup, from its current PoC/incubator phase through to production, ensuring a high level of optimisation and scalability to operate at a global scale. This will also involve implementing a semantic More ❯

Title: Azure Data Engineer Location: Fully remote (working UAE hours) Salary: 5k GBP per month Are you a data expert with a passion for building scalable, cloud-first data pipelines? We’re hiring an experienced Azure Data Engineer to join a fast … growing team focused on developing a centralised, enterprise-grade data warehouse in the Azure cloud. This is a full-time remote role open to candidates located within GMT +1 to +6 time zones . If you thrive in fast-paced environments, take extreme ownership of your work, and … Creating and maintaining secure, scalable data pipelines and ingestion workflows Leveraging Azure Synapse Analytics and ADF to deliver robust ELT solutions Ensuring pipeline execution, availability, and reliability across platforms Owning physical data models and collaborating with BI teams on reporting layers Supporting data More ❯

Title: Azure Data Engineer Location: Fully remote (working UAE hours) Salary: 5k GBP per month Are you a data expert with a passion for building scalable, cloud-first data pipelines? We’re hiring an experienced Azure Data Engineer to join a fast … growing team focused on developing a centralised, enterprise-grade data warehouse in the Azure cloud. This is a full-time remote role open to candidates located within GMT +1 to +6 time zones . If you thrive in fast-paced environments, take extreme ownership of your work, and … Creating and maintaining secure, scalable data pipelines and ingestion workflows Leveraging Azure Synapse Analytics and ADF to deliver robust ELT solutions Ensuring pipeline execution, availability, and reliability across platforms Owning physical data models and collaborating with BI teams on reporting layers Supporting data More ❯

Title: Azure Data Engineer Location: Fully remote (working UAE hours) Salary: 5k GBP per month Are you a data expert with a passion for building scalable, cloud-first data pipelines? We’re hiring an experienced Azure Data Engineer to join a fast … growing team focused on developing a centralised, enterprise-grade data warehouse in the Azure cloud. This is a full-time remote role open to candidates located within GMT +1 to +6 time zones . If you thrive in fast-paced environments, take extreme ownership of your work, and … Creating and maintaining secure, scalable data pipelines and ingestion workflows Leveraging Azure Synapse Analytics and ADF to deliver robust ELT solutions Ensuring pipeline execution, availability, and reliability across platforms Owning physical data models and collaborating with BI teams on reporting layers Supporting data More ❯

vital role in owning the Databricks strategy and how they use it to innovate across their industry-leading brands. Designing and developing robust data frameworks, powering real-time data pipelines, and creating data services that deliver actionable insights to their global customer base. Role … with business goals Architectural Leadership: Serve as the owner and responsible person for all Databricks- related activities, acting as the architect across the Data Engineering, Data Analytics, and Data Science teams. Collaboration Enablement: Bridge the gap between teams by setting up templates and frameworks … for seamless collaboration, data sharing, and enablement aligned with the product vision. Unity Catalogue Management: Manage Unity catalogue, including permissions, usage, paths, locations, and implementation, ensuring data accessibility, security, and reliability. Guidance and Training: Provide guidance, support, and training to teams regarding Databricks usage, offering best More ❯

Senior Data Analyst Sports Agency £600 per day (Outside IR35) 4 Days per week in London Office Role and Responsibilities Stakeholder Management : Build strong relationships with internal and external stakeholders, ensuring clear communication and project alignment. Project Management : Work on multiple projects simultaneously, delivering results on time and … maintaining quality in fast-paced environments Data Integration : Oversee data integration into CRM systems, ensuring smooth data flow and accessibility for analysis. Data Pipelines : Develop and optimise data pipelines, ensuring efficient data flow between systems for reporting and … insights. Data Strategy : Shape and execute data strategy, providing actionable insights to drive business decisions. Collaboration & Reporting : Work cross-functionally, preparing and presenting reports to guide business strategy and project outcomes. Essential tools - Power BI Python BigQuery Google Cloud Platform Looker Google Analytics 4 (GA4) Solid More ❯

Senior Data Analyst Sports Agency £600 per day (Outside IR35) 4 Days per week in London Office Role and Responsibilities Stakeholder Management : Build strong relationships with internal and external stakeholders, ensuring clear communication and project alignment. Project Management : Work on multiple projects simultaneously, delivering results on time and … maintaining quality in fast-paced environments Data Integration : Oversee data integration into CRM systems, ensuring smooth data flow and accessibility for analysis. Data Pipelines : Develop and optimise data pipelines, ensuring efficient data flow between systems for reporting and … insights. Data Strategy : Shape and execute data strategy, providing actionable insights to drive business decisions. Collaboration & Reporting : Work cross-functionally, preparing and presenting reports to guide business strategy and project outcomes. Essential tools - Power BI Python BigQuery Google Cloud Platform Looker Google Analytics 4 (GA4) Solid More ❯

Data Engineer High-Growth Tech Scale-Up | Strategic + Hands-On Role An exciting opportunity has opened up with a rapidly scaling tech company that's investing heavily in its data infrastructure. They are seeking an experienced Data Engineer to take the lead on … evolving their architecture while collaborating closely with senior leadership to shape the long-term data strategy. This role is perfect for someone who enjoys building from the ground up developing scalable systems, writing production-ready code, and playing a key role in data-driven decision-making … across the business. Role Highlights: Spearheading the evolution of the company's data platform as it scales beyond MVP Building and maintaining scalable data pipelines using Python, Java, Spark, SQL, and more Partnering with cross-functional teams (Product, Finance, Ops, Customer Success) to deliver actionable insights More ❯

Role: Senior Software Engineer , Data Solutions Location: Hybrid (2 days on-site in Central London) Salary: £70,000 to £80,000 + Excellent Benefits Candidates must be eligible for UK Security Clearance The Opportunity We are proud to be working in partnership with a major defence systems integrator … into a critical delivery team. This is a unique opportunity to join a high-performing, mission-led environment focused on building robust, scalable data and analytics platforms for government and defence customers. This hybrid role offers the chance to work on-site in London just two days a … week initially, with increased flexibility over time. You'll be part of a team delivering impactful solutions in a secure and complex data landscape—an ideal environment for those who want to develop cutting-edge systems and contribute to national resilience. The Role As a Senior Software Engineer More ❯

into a critical delivery team. This is a unique opportunity to join a high-performing, mission-led environment focused on building robust, scalable data and analytics platforms for government and defence customers. This hybrid role offers the chance to work on-site in London just two days a … week initially, with increased flexibility over time. You'll be part of a team delivering impactful solutions in a secure and complex data landscape—an ideal environment for those who want to develop cutting-edge systems and contribute to national resilience. The Role As a Senior Frontend Developer … you will play a pivotal role in the design, development, and operation of innovative front-end solutions that interface with enterprise-scale data ecosystems. Working in close collaboration with data engineers, delivery managers, external partners, and client stakeholders, you will help drive the transformation of critical More ❯

party vendors (enterprise software solutions such Document Management, Time Management, Practice Management, Core business i.e. Microsoft etc) to support their integration and master data management implementations Develop Azure-based integration solutions using Logic Apps, Service Bus, Function Apps, API Management, and Data Factory (ADF). Build … robust data pipelines and ETL solutions that support business processes and reporting needs. Conduct code reviews on other people's solutions Working within a team of architects, data engineers, data analysts and C#/.Net Core developers the Integration Developer/Azure Integration Developer … optimises their technology environment. As such you will bring a mix of skills including: Expertise in Azure Integration Services suite with strong Azure Data Factory ETL Logic Apps, Service Bus, API Management Very strong SQL skills, including database design, stored procedures, and query optimisation Underlying programming expertise in More ❯

create modern systems by using Microsoft Fabric Act as a consultant, understanding the client requirements and deliver the best solutions. Building and optimising data pipelines. Debugging issues Keep costs under control Skills Microsoft Fabric - Lakehouse and warehouse models Azure Tools (Data Factory, Synapse, SQL) Python experience … for programming Databases, SQL and NoSQL (CosmosDB, KQL) Data Modelling: Kimball frameworks and 3NF Nice To Have Databricks Power BI AI/ML Azure Infrastructure DevOps Certifications Microsfot certified: fabric Analytics Engineer Associate DP-203 Azure data Engineering AZ-305 Azure Solutions Architect. If this sounds More ❯

Leading Financial Services client is currently going through a large Data transformation and is looking for Data Solution Manager to join them on this exciting journey. The roles are offering a base between £80,0000 to £85,000pa + a strong benefits package and flexible working. … One day in office in every 3 months in East Sussex As a Data Solution Manager you will report to our Head of Data Delivery and lead a small team of some of the best engineers in the industry to deliver, improve and maintain robust data pipelines within our ambitious data architecture. Requirements: You will have a strong background in data engineering, with experience in managing and mentoring other engineers. You should have significant experience with Snowflake and Microsoft Azure, particularly Azure Data Factory and Azure Dev Ops. More ❯

Lead Software Engineer – Cloud & Data Orchestration 📍 Hybrid (1–2 days/week in office) | 💼 £140k+ Package | 🕵️‍♂️ Security-Cleared or Security Clearable required Location: London | Sector: Intelligence, Analytics & Secure Data | Process: 3 stages Our client is a mission-driven consultancy delivering high-impact intelligence, research, and technical … re hiring a Lead Software Engineer/Founding Engineer to take the reins of a specialist engineering unit delivering microservice-based cloud and data solutions at scale. This is a hands-on technical leadership role where you'll work closely with the CTO, shape architecture and tooling, and … the future of our engineering capability. 🔍 What You’ll Be Doing Leading a growing team (currently 2 engineers + external partners) across complex data and cloud engineering projects Designing and delivering distributed solutions on an AWS-centric stack, with open-source flexibility Working with Databricks, Apache Iceberg, and More ❯

Lead Software Engineer - Cloud & Data Orchestration Hybrid (1-2 days/week in office) | £140k+ Package | Security-Cleared or Security Clearable required Location: London | Sector: Intelligence, Analytics & Secure Data | Process: 3 stages Our client is a mission-driven consultancy delivering high-impact intelligence, research, and technical … re hiring a Lead Software Engineer/Founding Engineer to take the reins of a specialist engineering unit delivering microservice-based cloud and data solutions at scale. This is a hands-on technical leadership role where you'll work closely with the CTO, shape architecture and tooling, and … the future of our engineering capability. What You'll Be Doing Leading a growing team (currently 2 engineers + external partners) across complex data and cloud engineering projects Designing and delivering distributed solutions on an AWS-centric stack, with open-source flexibility Working with Databricks, Apache Iceberg, and More ❯

DE/2904/GC_ A leading Quant Fund are looking to build out their Systematic Trading platform, with a focus on the data platform used by Quants and Researchers for their data modelling. You'll be specifically building out their Front Office Data … this role, you'll be: Taking requirements directly from Quants and Traders. Utilising modern technologies to build a platform for modelling. Building out Data Pipelines utilising Python and cloud-based tooling. Optimizing the performance of the data lake. Designing the underlying data infrastructure of More ❯

smarter, simpler ways to insure what they love, without paperwork or phone calls. We are seizing the opportunity to build a digital-first, data-powered MGA designed for modern life with a mission to make Italian families more resilient, financially and emotionally. Backed by Founders Factory , Tetto is … building a radically simpler, smarter, and more affordable way to insure your home and contents starting with a digital-first, data-powered MGA focused on young, urban policyholders. We're now looking for a technical co-founder to join the team and own the technology vision, architecture, and … Founder & CEO to bring Tetto from concept to product-market fit and beyond. You'll lead the design and build of our MVP, data infrastructure, and API-first architecture, setting the foundation for how we acquire, underwrite, and serve customers in a way that's 10x better than More ❯