1 to 25 of 269 Permanent Data Pipeline Jobs in London

direction they choose. About You: You are a motivated and adaptable professional with a strong analytical mindset and a passion for working with data to solve real-world problems. You enjoy working in collaborative, agile teams and take pride in delivering high-quality, data-driven solutions … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise in data ...

IMMEDIATE JOINERS !! 💻 Junior Big Data Developer (Python & SQL Focus) 📊 We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data … maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to integrate data from various sources into ...

Advisory : Combining architectural assessments with platform selection guidance, providing vendor-independent recommendations for optimal data ecosystem design. Data Migration, Integration & Pipeline Support : Providing strategic guidance on data migration and integration approaches, logical pipeline design, and data flow orchestration, based … understanding of methodologies and principles of data science and MLOps, including model development, validation, and lifecycle management. Experience in data pipeline design, ETL/ELT processes, and data integration approaches and appreciation of trade-offs associated with specific use-cases and architectural choices. ...

HEAD OF ERP DATA MAT COVER LONDON (HYBRID) UP TO £90,000 This is a standout opportunity to lead a data function through a major ERP transformation while shaping the future of product data, governance, and analytics in a consumer‐driven environment. You will … play a pivotal role in stabilising and optimising a new data ecosystem, guiding a growing team, and embedding high‐quality data foundations across the business. The Company The client is a global consumer brand undergoing significant digital and data transformation. With ...

stringent service level agreements (SLAs) and business requirements. What experience you need to be the successful Data Engineer: Proficiency in Palantir Foundry pipeline development: Extensive experience in building, maintaining, and optimising data pipelines and transformations within Palantir Foundry, leveraging tools such as Foundry Code Workbooks … integration. Strong coding skills in Python (Pandas) and PySpark: Essential experience in using Python (Pandas) and PySpark for data manipulation, transformation, and pipeline development within Palantir Foundry, ensuring high performance and scalability across various data flows. Experience in data modelling and ontology development ...

stringent service level agreements (SLAs) and business requirements. What experience you need to be the successful Data Engineer: Proficiency in Palantir Foundry pipeline development: Extensive experience in building, maintaining, and optimising data pipelines and transformations within Palantir Foundry, leveraging tools such as Foundry Code Workbooks … integration. Strong coding skills in Python (Pandas) and PySpark: Essential experience in using Python (Pandas) and PySpark for data manipulation, transformation, and pipeline development within Palantir Foundry, ensuring high performance and scalability across various data flows. Experience in data modelling and ontology development ...

Overview We are looking for a Consultant to join SmartCo with a focus on Data and AI. This is a billable, client-facing role, sitting at the intersection of advisory and delivery. The role is split across two core areas: Supporting clients with data strategy, data architecture, data migration and data-led transformation programmes. Helping SmartCo build and mature its internal data capability, including reporting, dashboards and insight across core platforms (CMAP, Sage Intacct, Pipedrive). In parallel, this role will play a key part in shaping ...

core part of HDI's data transformation agenda, enabling improved decision-making, automation, and analytics maturity. Key accountabilities Data Pipeline Engineering & Integration Design, develop, and maintain end to end ingestion pipelines into appropriate data technologies such as Snowflake from internal systems (policy admin … sizing, storage costs, and compute efficiency. Implement workload separation, time travel optimisation, clustering, and pruning strategies. Documentation & Knowledge Sharing Produce comprehensive documentation for pipelines, data models, data flows, and architecture components. Provide technical guidance to junior team members and evangelise engineering best practices. Skills & experience Technical ...

Office.Full time hours. We are happy to discuss flexible working! Top 3 skills needed for this role: Expert in building scalable, high-quality data pipelines Hands-on experience with cloud data platforms The ability to optimise, automate, and deliver reliable data solutions independently What … this role is all about: Join us as a Data Engineer and become a driving force behind high-impact, high-performance data solutions. Youll take ownership of designing and supercharging data pipelines that keep our business moving, bringing fresh thinking and technical flair ...

Location: London, Watford or Bristol (Hybrid working options available) The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires strong expertise in Azure cloud services, Databricks, data engineering … DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions. The role involves: Interpreting Outcomes and user stories and translating them into technical solutions. Creating innovative solution designs for domain and enterprise data products. Overseeing Data Analysts ...

Full time hours. We are happy to discuss flexible working! Top 3 skills needed for this role: Expert in building scalable, high-quality data pipelines Hands-on experience with cloud data platforms The ability to optimise, automate, and deliver reliable data solutions independently What … this role is all about: Join us as a Data Engineer and become a driving force behind high-impact, high-performance data solutions. You’ll take ownership of designing and supercharging data pipelines that keep our business moving, bringing fresh thinking and technical flair ...

financial and tax planning, offering home finance and annuities propositions, and providing collective fund solutions to third party customers. Job Purpose The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires … strong expertise in Azure cloud services, Databricks, data engineering, and DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions. The role involves: Interpreting Outcomes and user stories and translating them into technical solutions. Creating innovative solution designs for domain ...

Role: Contract Business Analyst Project: Trading Data Platform (Data Lake & Data Warehouse) Industry: Energy & commodities trading Location: London (hybrid 3 days per week) Rate: £700–800/d (inside IR35) Contract: 6 months initial (multiyear scope) X4 Technology are partnered with a leading global … energy trading firm offering the opportunity for a contract Business Analyst to support a major data transformation programme. This role sits within a strategic data platform initiative focused on the design and build of a cloud-based data lake and enterprise data ...

ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries … lineage practices using Microsoft Purview . Build and maintain CI/CD pipelines to automate deployment of Fabric assets, notebooks, and data pipeline A bit about YOU! As much as we just love working with great, fun people, there are some obvious required Skills and Experience ...

Data Quality Analyst - London (Hybrid) - Azure, Databricks, SQL, Power BI - Up to £55,000 This is an opportunity to join a global organisation that takes data quality seriously and sees it as essential to how the business operates and reports. The organisation continues to invest … data platforms and governance, with a clear focus on reliability, consistency and long-term improvement. You'll be part of a Global Data Team where quality matters, collaboration is encouraged, and people are trusted to take ownership. If you enjoy getting into the detail of data ...

other consulting practices, and they are looking to build a team that is equally ambitious. Position Overview Our client is seeking a Senior Data Engineer who thrives on building scalable, cloud-first data systems. In this role, you will design and manage data pipelines … data engineering or cloud data development Strong understanding of data architecture, APIs, and modern data pipeline design Hands-on experience within Microsoft's Azure ecosystem, with an interest in emerging technologies such as Fabric, AI-enhanced ETL, and real-time data ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data Storage, and DevOps methodologies Role Overview: This role sits within our client’s rapidly growing Cloud Data Platforms team, part of the Insights and Data Global Practice. You will join a multidisciplinary group of data and platform specialists who deliver modern cloud ...

Company: Live Nation Department: International Data and Audience Location: Farringdon, London Reports to: Director, BI & Analytics, International Working Hours: Full time Job Type: Permanent Role Description We’re looking for an Analytics Engineer to play a critical role in enabling data access, platform operations, and analytical … data modelling across Live Nation's international data ecosystem. You will work with rich datasets and manage data workflows in large-scale data environments, ensuring reliable and performant data access in Databricks, BigQuery, Tableau and Data Studio. ...

Data Quality Analyst A global organisation undergoing significant digital and data transformation is looking for a Data Quality Analyst to join its growing data function. This role plays a critical part in ensuring data is accurate, consistent, and trusted across … enterprise reporting and analytics. You'll work closely with business stakeholders, data engineers, and product teams to identify data quality risks early, diagnose issues at source, and embed strong governance and quality practices across data platforms. Key Responsibilities Partner with business stakeholders to identify ...

Hawksworth are looking to hire a ‘ Celonis Process Mining Data Engineer’ for an initial 6-month assignment to work on site at a global financial organisation. Rate negotiable for the right candidate but above market rates available! (Inside IR35). London- hybrid working. The job As the Celonis … model within a highly regulated banking environment. Some key responsibilities; Data Engineering & Event Log Construction, Data Model & Data Pipeline Development, Develop and optimize ETL/ELT pipelines from Source systems , Optimize queries, transformations, and data models for performance and scalability. Collaboration ...

client, a highly prestigious hedge fund, is seeking a Data Engineer to join their Data Platform team in London. Embedded within a high-performing and collaborative data function, you will play a key role in designing, building and enhancing a best-in-class data platform that supports front-office decision making across multiple asset classes. Working closely with investment professionals, technology teams and data stakeholders, you will help drive data quality, accessibility and scalability across a complex, business-critical environment. This is an opportunity to take ownership ...

Senior Data Engineer Location : London (Hybrid) Type : Permanent Salary : £110,000 - £140,000 A global energy and commodities trading organisation is looking for a Senior Data Engineer to join its growing Data, AI & Analytics team in London. This is an opportunity to work … heart of a highly data-driven trading environment, building the platforms and pipelines that power advanced analytics, machine learning and systematic trading strategies. The firm operates across global energy and commodities markets and is known for combining quantitative research, advanced analytics and modern technology to support trading ...

Cleared Senior Data Consultants and Analysts – London – Up to £70,000+ per annum Are you a data-driven professional with a passion for delivering impactful solutions? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity … you. Morela is proud to partner with one of the UK's leading data consultancies, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled SC & DV Cleared Senior Data Consultant and Analysts ...

company seeking a Senior Associate - Marketing Technology to support and evolve its enterprise marketing ecosystem. This position operates at the crossroads of marketing, data, and technology, with a strong emphasis on marketing tech data, AI & machine learning, and data workflows. You will play … role in enhancing platform performance, strengthening integrations, and enabling scalable, data-driven marketing operations. This opportunity is ideal for someone who thrives in complex environments and enjoys improving how systems, data, and teams connect. Key Responsibilities Optimise and maintain core marketing technology platforms to ensure strong ...

company seeking a Senior Associate - Marketing Technology to support and evolve its enterprise marketing ecosystem. This position operates at the crossroads of marketing, data, and technology, with a strong emphasis on marketing tech data, AI & machine learning, and data workflows. You will play … role in enhancing platform performance, strengthening integrations, and enabling scalable, data-driven marketing operations. This opportunity is ideal for someone who thrives in complex environments and enjoys improving how systems, data, and teams connect. Key Responsibilities Optimise and maintain core marketing technology platforms to ensure strong ...