1 to 25 of 296 Data Pipeline Jobs in London

Morgan Hunt are working with a housing association in London to recruit an Azure Data Engineer on a permanent basis. The purpose of the role is to lead the implementation of data flows to connect operational systems, data for analytics and BI systems. … Integrate various data platforms and tools to create a cohesive and robust data ecosystem Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability of data services Collaboration: Work closely with data scientists, analysts and other stakeholders ...

IMMEDIATE JOINERS !! 💻 Junior Big Data Developer (Python & SQL Focus) 📊 We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data … maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to integrate data from various sources into ...

/Job Title: MLOps Tech Lead Work Location: London, UK Office Requirement (Hybrid): 2 days per week Key Responsibilities (High-Level) Data Pipeline Development: Lead the technical direction of projects and ensure the use of Sainsbury's best practices to the best quality. Data Integration … software engineers to ensure data is clean, accessible, and optimised for large-scale processing and analysis. Your Responsibilities Data Pipeline Development: Lead the technical direction of projects and ensure the use of Sainsbury's best practices to the best quality. Data Integration: Lead ...

Title: Senior Data Engineer Salary: £75,000 - £85,000 Location: London (Hybrid - 2 days on-site) Overview We are seeking a Data Engineer to join a data and analytics function within the energy and environmental services sector. This is a highly impactful … role focused on designing, building, and embedding modern data platforms that support operational insight, business intelligence, and strategic decision-making. Operating in a low data-maturity environment, this role will play a key part in shaping the organisation's data foundations, architecture, and governance. ...

passionate and dedicated insurance and software professionals on a mission to upgrade the insurance industry from the inside out. RESPONSIBILITIES The Full Stack Data Engineer is responsible for integrating data engineering, analytics, and data science to drive business intelligence and data-driven … related field. • Proficient in Python, including libraries like Pandas, NumPy, PySpark, and Scikit-learn. • Strong experience with SQL, ETL processes, and data pipeline development. • Expertise in Tableau BI for data visualization and dashboarding. • Hands-on experience with AWS services (S3, Redshift, Lambda, Glue, Athena, etc. ...

ABOUT DIGIMASTERS Digimasters Ltd was founded in 2017 as a digital transformation consultancy focused on technology, business process optimisation and data analytics. Digimasters works across all industries and provides experience in organisations of all sizes. Primarily based in London, UK, we work in many regions including … Architecture, Engineering, and Construction (AEC), as well as other sectors, we have several roles supporting the delivery of technology, business change, and data programmes. THE ROLE We are looking for an experienced Data Engineer to join our delivery team on a contract basis, with a specific ...

clients to ensure data is sent on time and in the correct format, processing data through our data pipeline and debugging any issues that arise. The apprentice will have the opportunity to gain detailed knowledge and experience of data workflows … clients to ensure data is sent on time and in the correct format Process data through our data pipeline Debug issues that arise Contribute to the improvement of efficiency in data ingestion and data processing Contribute to data ...

Senior Data Engineer – Azure ** 5 days a week onsite - Central London ** £70,000 - £80,000 per annum About the Role One of the UK’s leading insurers are looking for a Senior Data Engineer with a primary focus on Azure to lead the design and implementation … call auditing. Collaborate with product managers, analysts, and data scientists to align data strategy with business objectives. Monitor and optimise pipeline performance, ensuring data quality, reliability, and consistency. Implement best practices for data governance, security, and compliance. Required Experience & Skills Proven ...

Lead Data Engineer Lead Data Engineer required to join my Client’s Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud … develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with ...

Cleared Data Pipeline Developer - Central Government (Contract) Duration: ASAP start (4 weeks onboarding) until 31 October 2026 Rate: £600-£650 per day ( Outside IR35 ) Location: Vauxhall until May, then Stratford - 5 days per week onsite Clearance: UKSV DV (active, minimum 12 months remaining) Nationality: UK Nationals only … seeking an experienced DV Cleared Data Pipeline Developer to support a large UK Central Government department on a long-term, high-assurance programme. This engagement is Outside IR35 , operating on a project-based delivery model with a clear statement of work and deliverables. The Role You will ...

Senior Data Engineer to join our Anti-Piracy team who will be responsible for expanding and optimizing our data pipeline as well as optimizing data flow and collection within the Anti-Piracy Team The Senior Data Engineer will be responsible … designing, building, and scaling the data infrastructure that powers our anti-piracy operations and intelligence capabilities. You'll develop and maintain data pipelines, architect data storage solutions, and help shape data standards and governance across the org. You'll partner closely with ...

join us in building a future of smarter farms, thriving chickens, and healthier lives. The role We are currently seeking a Senior Data & Platform Engineer to work directly under our Engineering Director in our office in London. We’re a Series A ready start-up with plenty … room for progression and making direct impact for our customers. This high-impact role demands "best-in-class" data engineering and MLOps skills to build, maintain, and deploy the production-grade commercial applications that power our AI and analytics platform. The ideal candidate will have experience navigating complex ...

Data Engineer Python | AWS | Accounting Data | Insurance | London A leading insurance firm is seeking a Data Engineer to join a newly formed Data squad responsible for building a greenfield data platform. This Data Engineer will work closely with … internal Accounting and Finance stakeholders, supporting business-critical reporting and regulated financial processes. As a Data Engineer, you will take ownership of designing and building data pipelines from scratch, working primarily with Python and AWS. This is a true 01 initiative, where the Data ...

Front-office Data Management Consultant (VP) - sought by investment based in London - Hybrid *12-month Fixed term contract - then conversion to permanent role* Sitting within the Business Change & Governance team, you'll work closely with Front Office, COO, IT, Finance, ESG and other key functions to enhance data quality, build robust data models, and drive data-led transformation initiatives. Key Responsibilities Data Management, Governance & Oversight Lead governance of Front Office banking data, ensuring quality, consistency, and continuous improvement. Create ETL pipelines and automated data ingestion processes. ...

Data Engineer - TV Advertising Data (FAST) Location: London - 3 days onsite Salary £75,000 - £85,000 Neg DOE Reference : J13057 Note: Full and current UK working rights required for this role We're currently seeking a Data Engineer to build the foundations behind … Fabric ecosystem Optimise data pipelines for performance, scalability, and efficiency, following best-practice engineering standards including version control and code reviews Monitor pipeline health, data freshness, and quality, implementing proactive alerting and issue resolution Translate business and analytical needs into well-structured data ...

Sanderson are currently working with a client who are looking to develop their data engineering capability, this involves working on mission critical solutions that focuses on data services for their customers. You will … managing and developing data pipelines that transforms raw data, enabling downstream analytics. You will be responsible for Data pipeline development - Data ingestion and pipeline orchestration design and tooling. Database schema design/database modelling Data integration - Integrating ...

Senior Data Engineer (Python & SQL) Location London with hybrid working Monday to Wednesday in the office Salary £70,000 to £85,000 depending on experience Reference J13026 An AI first SaaS business that transforms high quality first party data into trusted, decision ready insight at scale … transform and validate data from multiple upstream sources ·Taking ownership of data quality, consistency, and reliability across the pipeline lifecycle ·Shaping scalable data models that support a wide range of downstream use cases ·Working closely with Product, Engineering, and Data Science ...

Data Scientist £Up to £60,000 GBP Hybrid WORKING Location: London, Central London, Greater London - United Kingdom Type: Permanent Join a highly regarded digital, data, and technology consultancy recognised for delivering advanced analytics, AI, and data-driven solutions within secure government, defence, and public … sector environments. The client is known for its innovation in applied data science, engineering excellence, and ability to deliver complex, high-impact solutions in highly regulated settings. This Data Scientist Specialist role requires candidates who already hold active SC clearance. The client has built a strong ...

Data Scientist/Engineer - Outside IR35 Contract Location: London (Hybrid Working) Contract: Outside IR35 Clearance: Active SC Clearance required Email : henry.clay-davies@searchability.com Phone : 07719 065951 Overview We are seeking an experienced Data Science/Data Engineering Contractor to join a high-impact programme … based in London, working on advanced data-driven and LLM-enabled platforms. This is an outside IR35 contract offering hybrid working, ideal for contractors with strong experience building scalable data pipelines, analytics services, and AI-enabled systems in cloud environments. You will play a key role ...

enthusiastic team players who are excited by the prospect of accelerating, scaling, and building out a greenfield platform. Key responsibilities Data Pipeline Engineering: Build, optimise, and maintain robust end-to-end data pipelines for key business functions. Focus on implementing low latency, strong observability … 3+ years' experience working as a data engineer in a product-focused environment. Strong Python experience working with data pipeline, orchestration, and API framework technologies. Ideally, but not limited to, Data Load Tool (dlt) and FastAPI. Hands-on experience working in a Google ...

Azure Data Engineer Rate - up to £350/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based … Central London. They are seeking an experienced Azure Data Engineer to join the project on an initial 6-month contract, with strong potential for extension. Key Responsibilities - Azure Data Engineer: Design, build and maintain scalable and secure data pipelines on the Azure platform. Develop ...

Senior Data Engineer Rate - up to £450/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based … Central London. They are seeking an experienced Senior Data Engineer to join the project on an initial 6-month contract, with strong potential for extension. This role is Outside IR35 and offers £450/day, requiring 2 days onsite per week in Central London. Key Responsibilities - Senior Data ...

Data Engineer Fully Remote 6 Months Contract £550 Inside IR35 (PAYE Rate) + Holiday Overview We’re looking for a talented and motivated Data Engineer to join a growing Data Engineering team delivering high-quality, enterprise-scale data solutions. This … great opportunity to work in a collaborative, technically strong environment using Microsoft technologies to build robust data platforms that enable data-driven decision-making across the business.You’ll work closely with Architects, Senior Engineers, and a wide range of stakeholders to design, develop, and deliver scalable ...

About the Company Our client a Google Partner is looking to hire an experienced Data Engineer. About the Role You will be part of a team responsible for the development and overall delivery of big data platform solutions, automation solutions and data AI Agents. … BigQuery, BQ Sharing (Analytics Hub), Cloud Storage, APIs, Compute Engine, etc.) to address specific client needs. You will be designing, maintaining, and optimising data infrastructure for data collection, management, transformation, and access. You will work collaboratively with internal teams and clients to uncover their unique marketing ...

Head of Data Engineering Location : London Contract Type : Permanent Working Pattern : Hybrid Sector : FMCG About the Role A leading FMCG organisation we are working with is seeking an experienced Head of Data Engineering to join their leadership team on a permanent basis. This is an exciting … opportunity to lead and shape the data engineering function within a fast-paced, consumer-focused environment. As the Head of Data Engineering, you will be responsible for building and leading a high-performing data engineering team, establishing robust data infrastructure, and driving ...