26 to 50 of 556 Data Pipeline Jobs in London

Junior Data Engineer Location: UK-based, hybrid working Security Clearance: BPSS or SC clearance Required Working Style: Agile, product-led delivery We are looking for a Junior Data Engineer to support the design, build and operation of scalable data platforms for digital services. Working … Understanding of REST APIs, HTTP methods and JSON payloads Ability to consume data from APIs as part of a data pipeline Good problem-solving skills and ability to troubleshoot basic data issues Desirable Skills Experience with AWS Aurora PostgreSQL Basic understanding of data ...

platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Accepting applications until: 14 August 2026 Job Description Your Role: Data Engineer (DAX) Global is looking for a Data Engineer to join the Data Engineering team supporting our Digital Ad Exchange … Monitor and support the day-to-day operation of production pipelines and data processes. Lead or contribute to the investigation of pipeline failures, data quality issues and performance problems, improving observability, alerting and reliability, and deepening the team's understanding of the DAX data ...

Data & AI Delivery Specialist - London (Hybrid) - Data Transformation - AI Programmes - Azure, AWS & GCP - Multiple Levels Available - Up to £75,000 Our client is an established professional services and technology business helping organisations solve complex data, digital and operational challenges. Following continued growth and investment … they are expanding their London-based Data & AI capability and are looking to hire talented professionals across multiple experience levels. You'll join a collaborative and high-performing team delivering large-scale transformation programmes that help organisations improve decision-making, modernise data capabilities and unlock value ...

Lead Data Engineer - Fully Remote (UK) - AWS - AI & Machine Learning - Up to £110,000 Are you a Senior Data Engineer looking for the opportunity to own a data function rather than simply contribute to one? We're working with a high-growth technology business … that is scaling rapidly and investing heavily in its data, analytics and AI capabilities. The organisation develops cutting-edge products that combine data, machine learning and AI to help global enterprise clients make better decisions through intelligent, evidence-driven insights. This is an opportunity to join ...

strategy. Prioritize needs across multiple stakeholders to construct a coherent backlog that reduces complexity and achieves focus. Balance competing infrastructure needs, including observability, pipeline analysis, and technical migrations. Possess a robust knowledge of data manufacturing approaches across Data, and develop strategies that improve adoption while … respecting Engineering architecture and operational constraints. Evaluate where agentic and LLM-based approaches add value in the data manufacturing pipeline, and where deterministic microservices, rules engines, APIs, or other traditional implementations remain the better solution. Partner with Engineering on new pipeline components to ensure added intelligence ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You Will Be Working With As a Data Engineer at Capgemini, you will design, build and operate reliable, scalable data pipelines and data products that enable analytics … GenAI. You will work hands-on with modern data engineering tools and cloud services to ingest, transform and serve trusted datasets, using AI-assisted engineering to accelerate delivery, improve quality and automate routine tasks—while applying sound judgement and secure engineering practices. You will be part ...

have a background in Automotive Data Quality, are you excited about data management and validation? Expleo are seeking a highly organised and proactive Data Quality Engineer, you will be a part of the team testing the next generation of electrified propulsion systems, based … Warwickshire on a Contract basis. Key Responsibilities of the Data Quality Engineer include: Work across Electric machine, Electric Drive Unit (EDU), Inverter, Cell, Battery, Power in loop (PiL) and Vehicle in Loop (ViL) test beds Provide timely, accurate, secured and accessible test data for wider engineering ...

Data Engineer Up to £60,000 - London (3 days in office) We are partnering with a global consulting and technology services organisation that delivers large-scale digital, data and AI transformation programmes for enterprise clients across a range of industries. Due to continued growth within … Data & Analytics practice, the organisation is looking to hire a Data Engineer to play a key role in designing, building and optimising modern enterprise data platforms. This is an excellent opportunity to join a highly skilled team working on complex data transformation ...

Bournemouth or London Vitality Offices. Full time hours. We are happy to discuss flexible working! Top 3 skills needed for this role: Data Operations Leadership Strategic stakeholder management skills Scalable Systems & Compliance Mindset What this role is all about: At Vitality, data isnt just numbers … that powers our strategy, drives our Journey model and enables smarter, faster decisions across the business. We rely on quick, accurate and accessible data to fuel insights, support our operational teams and continuously improve how we work. As we scale our data platforms and increase ...

e.g. SSIS or equivalent tools and frameworks). Programming (e.g. Python) - Experience using Python or similar languages for data processing, automation, or pipeline development. Cloud & Platform Technologies - Familiarity with modern data platforms and cloud-based architectures (desirable). Performance & Scalability Optimisation - Ability to design … modelling, system design, and integration patterns. Strong experience with SQL and data processing at scale. Experience working with data pipeline and ETL tools (e.g. SSIS or equivalent). Experience with programming languages (e.g. Python) for data processing or automation. Experience defining ...

Data Engineer (AWS) 12-month FTC, Canary Wharf, London One of our government clients is recruiting for a Data Engineer to join them on a 12-month fixed term contract (FTC). They are offering £49,400 per annum plus excellent pension. This is an exciting … opportunity to apply your data engineering skills for the public good in the Data, Technology and Insights (DTI) unit, a multidisciplinary team of data engineers, data scientists, technologists, behavioural scientists, and digital forensics experts. What you ll do: Join a multidisciplinary team ...

Data Engineer (AWS) 12-month FTC, Canary Wharf, London One of our government clients is recruiting for a Data Engineer to join them on a 12-month fixed term contract (FTC). They are offering £49,400 per annum plus excellent pension. This is an exciting … opportunity to apply your data engineering skills for the public good in the Data, Technology and Insights (DTI) unit, a multidisciplinary team of data engineers, data scientists, technologists, behavioural scientists, and digital forensics experts. What you’ll do: Join a multidisciplinary team ...

Data Engineer £50,000 - London (3 days in office) We are partnering with a global consulting and technology services organisation that delivers large-scale digital, data and AI transformation programmes for enterprise clients across a range of industries. Due to continued growth within its Data & Analytics practice, the organisation is looking to hire a Data Engineer to help design, build and optimise modern data platforms and solutions. This is an excellent opportunity to join a highly skilled team working on complex data transformation initiatives that enable organisations ...

Senior Data Engineer - Reference Data (Assistant Vice President) London, United Kingdom Job Description Jefferies is looking for a highly experienced Senior Data Engineer to join the Reference Data Group within our Technology division. You will play a key role in designing, building … operations teams in a fast‐paced environment. Problem Solving : Analytical mindset with a track record of diagnosing complex data quality and pipeline issues in production environments. Ownership : Takes end‐to‐end accountability for data products — from design through delivery, monitoring, and continuous improvement. Adaptability : Comfortable ...

member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Job Title : Cloud Data Engineer About the Job you are considering: We are seeking an experienced Cloud Data Engineer with expertise in AWS, Snowflake, dbt, PySpark … design, build, and maintain scalable cloud-based data platforms and analytics solutions. The ideal candidate should have strong experience in cloud data engineering, ETL/ELT development, data transformation, data warehousing, and performance optimization. Experience working in regulated industries such as Banking ...

passionate about making a positive impact, we'd love to have you on our team. About the role As the Data Pipeline Manager, you will lead a team responsible for building and maintaining scalable, reliable data pipelines that support enterprise reporting and analytics. You will … pipelines can process the data received from Customers Liaise with business to understand customer requirements, and to keep the business informed of pipeline progress. Provide feedback to users about the quality of the customers data. Establish and maintain a data stewardship model that works ...

Senior Data Engineer Microsoft Azure data This is a new and exclusive opportunity for a Senior Data Engineer with strengths in Microsoft Azure data to be a key lead in strengthening, evolving, and modernising our core data platforms. Job details … Title: Senior Data Engineer Technical Stack: Microsoft Azure data Location: London or Glasgow with 1 day a week in the office Industry: STEM Technology Permanent role salary £50- £70,000 dependant on skills and location Requirements: Strong experience as a Senior Data Engineer ...

Role description Principal Software Engineer – Data Technology Platforms Location London Start : ASAP End : As of now till Dec 2026 with possible extesnions Seeking an experienced and data-focused Principal Software Engineer to join our Data Technology Platforms team. This team is responsible for building … enhancing, and operating enterprise-wide data platforms that support operational, analytical, regulatory, and AI-driven business capabilities. The ideal candidate will have deep expertise in modern data engineering, database technologies, cloud platforms, and data governance. You will play a key role in defining strategic ...

Title: HR Data Delivery Lead Role Overview A new data lake solution is being implemented and the HR Data Delivery Lead will be responsible for end-to-end delivery of data products, pipelines, and reporting solutions across multiple teams. This role will … practices and data governance. Key Responsibilities Delivery Leadership · Lead end-to-end delivery of data initiatives (ETL/ELT pipelines, data models, dashboards, reporting products) · Own delivery plans, milestones, RAID logs, and dependencies across multiple squads · Ensure on-time, in-scope delivery of data ...

Architect - London (Hybrid) - Databricks - Spark - PySpark - AWS - Up to £115,000 + Bonus Our client, a large-scale organisation undergoing significant investment in data and cloud technologies, is seeking an experienced Senior Databricks Architect to join its expanding Data & AI practice. This is an exciting opportunity … play a key role in large-scale data transformation programmes, helping enterprise organisations modernise legacy platforms and build cloud-native data solutions. You'll be responsible for designing and delivering scalable data architectures, enabling advanced analytics, real-time data processing and modern ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Description Are you passionate about solving complex data challenges and building innovative data solutions, especially with cutting-edge tools like Microsoft Fabric, Azure, Google, AWS? Do you thrive on logical problem … solving and are energized by using technology to drive impactful results? If you have hands-on experience as a Data Engineer and are eager to work with Copilot agents and AI tools, we want to hear from you. We’re searching for a Data Engineer with ...

Fabric Data Engineer Up to £70,000 - West London (Hybrid - 1 Day Onsite) We are partnering with a well-established international organisation operating within a sustainability-led sector that is investing heavily in its technology and data capabilities. As part of an ambitious digital transformation programme … Hands-on experience with Microsoft Fabric and modern cloud-based data platforms Strong background in ETL development, data integration and pipeline engineering Advanced SQL/T-SQL development skills Experience designing and implementing data models for reporting and analytical requirements Experience using Python ...

next generation of research and healthcare innovation. Role Overview We are seeking an experienced GCP Data Engineer to own the technical pipeline infrastructure for a Finance Transformation program. The successful candidate will design and implement the shared pipeline architecture that underpins the program's data … model, lineage graph, and real‐time event capture infrastructure. This is a senior, hands‐on engineering role requiring deep expertise in GCP pipeline services, Workday and Oracle API extraction, and data lineage architecture. The candidate will establish the GCP native pipeline pattern used ...

Senior Manager, Databricks Architect, AI & Data, FS Location: London Other locations: Primary Location Only Date: 11 Jul 2026 Overview The EY Financial Services AI & Data team is continuing to grow and develop unique advisory propositions aligned to market needs and demand. We are currently looking … exceptional Senior Manager to lead on developing our Data Engineering Capability with an initial focus on Databricks. This is a senior architecture role and will require an individual with an exceptional track record of delivering data transformation programs in the Financial Services sector. The AI & Data ...

transforming, validating and serving complex datasets. Design scalable data models, schemas and storage systems for structured, semi-structured and geospatial data. Build pipeline orchestration using directed acyclic graphs, or DAGs, to manage dependencies, retries, scheduling and observability. Develop systems for data quality testing, lineage, versioning … products, customers and AI systems. Develop workflows for batch processing, event-driven processing and long-running computational jobs. Create monitoring and alerting for pipeline failures, unexpected data changes and quality regressions. Work directly with customers and domain experts to understand source systems and data problems. ...