1 to 25 of 303 Data Pipeline Jobs in London

engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources … effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote ...

IMMEDIATE JOINERS !! 💻 DATA ENGINEER (Python & SQL Focus) 📊 We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data processing, strong … maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to integrate data from various sources into ...

stringent service level agreements (SLAs) and business requirements. What experience you need to be the successful Data Engineer: Proficiency in Palantir Foundry pipeline development: Extensive experience in building, maintaining, and optimising data pipelines and transformations within Palantir Foundry, leveraging tools such as Foundry Code Workbooks … integration. Strong coding skills in Python (Pandas) and PySpark: Essential experience in using Python (Pandas) and PySpark for data manipulation, transformation, and pipeline development within Palantir Foundry, ensuring high performance and scalability across various data flows. Experience in data modelling and ontology development ...

Senior Data Planner This role owns relationships with external data vendors and is accountable for ensuring externally sourced data is technically fit, well-integrated, governed, and delivers long-term value across the organisation. Client Details Senior Data Planner The employer … services and supporting the community. As a large organisation, it offers a professional and structured environment with opportunities for impactful work. Description Senior Data Planner Define and deliver the external data sourcing strategy, ensuring alignment with enterprise data architecture, analytics ambitions, and business priorities ...

Location: London, Watford or Bristol (Hybrid working options available) The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires strong expertise in Azure cloud services, Databricks, data engineering … DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions. The role involves: Interpreting Outcomes and user stories and translating them into technical solutions. Creating innovative solution designs for domain and enterprise data products. Overseeing Data Analysts ...

want to build the infrastructure that brings advanced analytics and AI from theory into reality? University College London Hospitals is looking for a Data Engineer (AI Enablement) to join the SAFEHR team.We are solving hard problems: building the secure, modern data infrastructure that lets advanced research … will develop and improve UCLH's data warehouse environments. Being involved in the transition from using an R-based data pipeline to Spark jobs running on a data platform. You will model and transform data from our Epic electronic health record ...

Role: Contract Business Analyst Project: Trading Data Platform (Data Lake & Data Warehouse) Industry: Energy & commodities trading Location: London (hybrid 3 days per week) Rate: £700–800/d (inside IR35) Contract: 6 months initial (multiyear scope) X4 Technology are partnered with a leading global … energy trading firm offering the opportunity for a contract Business Analyst to support a major data transformation programme. This role sits within a strategic data platform initiative focused on the design and build of a cloud-based data lake and enterprise data ...

Data Quality Analyst - London (Hybrid) - Azure, Databricks, SQL, Power BI - Up to £55,000 This is an opportunity to join a global organisation that takes data quality seriously and sees it as essential to how the business operates and reports. The organisation continues to invest … data platforms and governance, with a clear focus on reliability, consistency and long-term improvement. You'll be part of a Global Data Team where quality matters, collaboration is encouraged, and people are trusted to take ownership. If you enjoy getting into the detail of data ...

Role Summary Leyton Orient is building a genuinely data-driven recruitment operation one where statistical rigour, AI tooling, and traditional scouting judgement work in concert rather than in tension. This role sits at the centre of that ambition. As Recruitment Data Scientist, you will design … databases or semantic search systems for unstructured data retrieval Exposure to cloud infrastructure (AWS, GCP, or Azure) for scalable data pipeline deployment Experience with modern data orchestration tools (Airflow, Prefect, dbt) What We Offer Direct access to senior football operations leadership, with genuine ...

Data Analyst - London (Hybrid) - Azure, Databricks, SQL, Power BI - Up to £55,000 This is a great opportunity to join a globally recognised organisation that has been delivering landmark, high-value projects for decades and continues to invest heavily in technology, data and long-term capability. … first culture built around approachable leadership, inclusion and respect. The Global IT function plays a critical role in modernising how the organisation uses data, and data quality is seen as a core enabler. You'll join a collaborative Global Data Team where quality, governance ...

Data Engineer | Location: London (Hybrid - 2 days WFO) | Salary: £60,000-£80,000 | London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated … Data Engineer with Insurance experience to play a key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data Storage, and DevOps methodologies Role Overview: This role sits within our client’s rapidly growing Cloud Data Platforms team, part of the Insights and Data Global Practice. You will join a multidisciplinary group of data and platform specialists who deliver modern cloud ...

Overview We are looking for a skilled Data Engineer with strong experience in Snowflake to join our growing data team. You will be responsible for designing, building, and maintaining scalable data pipelines and architectures that support analytics, reporting, and data-driven decision … Collaborate with data analysts, scientists, and business stakeholders to deliver data solutions Monitor and troubleshoot data workflows and pipeline performance Implement best practices for data security, privacy, and compliance Document data architecture, processes, and workflows Required Skills & Experience Proven ...

passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing … category? If so, you might be the ideal candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program ...

Senior Data Engineer ( SQL/BigQuery/Airflow/Terraform ) London/Hybrid 70-80k base plus super and equity A fast-growing, data-driven organisation is seeking a Senior Data Engineer to design, build, and maintain scalable data infrastructure … workflows that power analytics and decision-making across the business. This role suits an engineer who’s passionate about data warehousing, data operations, and cloud infrastructure, with strong technical foundations and a focus on delivering robust, production-ready solutions. This will suit an experienced Data ...

Company: Live Nation Department: International Data and Audience Location: Farringdon, London Reports to: Director, BI & Analytics, International Working Hours: Full time Job Type: Permanent Role Description We’re looking for an Analytics Engineer to play a critical role in enabling data access, platform operations, and analytical … data modelling across Live Nation's international data ecosystem. You will work with rich datasets and manage data workflows in large-scale data environments, ensuring reliable and performant data access in Databricks, BigQuery, Tableau and Data Studio. ...

seeking a highly detail-oriented and experienced VP-level Technical Systems Analyst to support the analysis and implementation of a new enterprise data platform with a focus on Risk and ESG reporting. The successful candidate will bring 5+ years of experience in business and systems analysis within banking … financial services, with strong capability across technical requirements definition, data architecture, and database-driven solution design. This role will play a critical part in supporting regulatory and ESG-driven data initiatives in a complex, multi-stakeholder environment. Key Responsibilities Contribute to the technical implementation ...

Responsibilities Enterprise Data Modelling Standards Define and own a group‐wide data modelling standard, including Star Schema patterns, Snowflake object hierarchies, and modelling conventions that underpin all analytical and operational data products. Cross‐Cloud Data Orchestration Design and implement secure, high‐throughput … data pipelines across cloud platforms, integrating AWS S3 and Azure‐based APIs through Snowflake. Ensure data integrity, lineage, and end‐to‐end auditability. Snowflake Security & Governance Own the end‐to‐end Snowflake security model, including RBAC design, dynamic data masking, row‐level security ...

Data Quality Analyst A global organisation undergoing significant digital and data transformation is looking for a Data Quality Analyst to join its growing data function. This role plays a critical part in ensuring data is accurate, consistent, and trusted across … enterprise reporting and analytics. You'll work closely with business stakeholders, data engineers, and product teams to identify data quality risks early, diagnose issues at source, and embed strong governance and quality practices across data platforms. Key Responsibilities Partner with business stakeholders to identify ...

client, a highly prestigious hedge fund, is seeking a Data Engineer to join their Data Platform team in London. Embedded within a high-performing and collaborative data function, you will play a key role in designing, building and enhancing a best-in-class data platform that supports front-office decision making across multiple asset classes. Working closely with investment professionals, technology teams and data stakeholders, you will help drive data quality, accessibility and scalability across a complex, business-critical environment. This is an opportunity to take ownership ...

seeking a highly detail-oriented and experienced VP-level Technical Systems Analyst to support the analysis and implementation of a new enterprise data platform with a focus on Risk and ESG reporting . The successful candidate will bring 5 + years of experience in business and systems analysis … within banking or financial services , with strong capability across technical requirements definition, data architecture, and database-driven solution design . This role will play a critical part in supporting regulatory and ESG-driven data initiatives in a complex, multi-stakeholder environment. Key Responsibilities Contribute ...

Junior Data Engineer, Data Operations £40,000 to £45,000 Basic + 10% Bonus + Benefits London HQ | Remote across the UK fine though We’re working with a growing, international SaaS organisation that is expanding its Data Operations capability and looking to hire … Junior Data Engineer. This is an excellent opportunity for someone early in their data engineering career to gain hands-on experience in a modern, cloud-first environment. You’ll play a key role in building and maintaining reliable data pipelines that support reporting, analytics ...

Role Title: Pre-Sales & Data Solution Architect Business Unit/Segment: Data Management Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent Summary Our client, a leading global data and AI consultancy, is seeking a Pre-Sales & Data Solution Architect Lead … workshops and influencing senior stakeholders on strategy, roadmaps, and innovation. ETL/ELT & Data Engineering – Provide oversight on robust data pipeline and integration designs using SSIS, ADF, Informatica, or IBM DataStage. Data Governance & Quality – Define governance, metadata, and quality frameworks using tools such ...

summary UCLH is looking for a Senior Software Engineer to lead the design and delivery of secure, high-quality data pipelines. This will ultimately lead to AI-ready platforms that let clinicians and researchers move faster from hypothesis to patient impact. You'll join the SAFEHR team that … turns routinely-collected NHS data into research-grade assets. The stack is modern (R, Python and moving to a data platform) and the problems are hard (clinical data at scale, governance, real-world messiness). This role would also be suitable for a research ...

Cleared Data Consultants and Analysts – London – Up to £60,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity … you. Morela is proud to partner with one of the UK's leading data consultancies, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled SC & DV Cleared Data Consultant and Analysts to join ...