2,301 to 2,325 of 2,980 Data Pipeline Jobs in the UK

Project description This is a strategic data engineering engagement with our client to architect and plan the migration of their entire data processing and ETL estate from Matillion to AWS Glue — a foundational shift in how one of the world's largest financial market infrastructure companies … handles its data pipelines.During this Mobilisation Phase, you'll work jointly with client's engineering teams to reverse-engineer the existing landscape, design the target-state architecture across every layer (infrastructure, data processing, workflows, dependencies, and operating model), and build the detailed delivery blueprint that will ...

Project description This is a strategic data engineering engagement with our client to architect and plan the migration of their entire data processing and ETL estate from Matillion to AWS Glue — a foundational shift in how one of the world's largest financial market infrastructure companies … handles its data pipelines. During this Mobilisation Phase, you'll work jointly with client's engineering teams to reverse-engineer the existing landscape, design the target-state architecture across every layer (infrastructure, data processing, workflows, dependencies, and operating model), and build the detailed delivery blueprint that ...

Location: LeedsSalary: 72,000 - 108,000 (per annum)Job type: PermanentWorking pattern: Full time/Flexible workingIndustry: Technology & Internet Services/Data & Advanced AnalyticsCompany: HaysConsultant: Jonathan WaltersHays office: Leeds — Part 6th Floor, Broad Gate, The HeadrowPhone: 0113 200 3750Email: jonathan.walters@hays.comLead AI EngineerLeeds or Edinburgh72,000 - 108,000Your … roleThe Data, Technology and Innovation (DTI) division enables the group to be a digital-first, data-led smart regulator by delivering a secure, agile, and cost-effective technology and data ecosystem that drives better decisions, transparency, and operational efficiency. Working alongside the wider ...

front lines, dedicated to safeguarding our platform against sophisticated financial crime. We leverage cutting-edge machine learning, real-time transaction monitoring, and advanced data analysis to create robust controls and detection capabilities. Our vision is to build a globally scalable fraud prevention engine that protects customer accounts, prevents …/CD pipelines, Distributed, and Concurrent Systems.\* Product Ownership: A strong product mindset, accountability, and the ability to drive projects independently, making data-driven decisions with the customer in mind.\* Data Proficiency: Experience with relational and non-relational databases, including query optimisation and designing resilient schemas. ...

Leonard Curtis is seeking a Data Engineer to build, maintain, and optimise robust data pipelines. This role develops efficient ETL/ELT workflows using Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics. You will implement … Delta Live Tables, write PySpark and SQL in Fabric Notebooks and Databricks clusters, and ensure data access control, quality checks, and governance through Unity Catalog. #J-18808-Ljbffr ...

Harnham - Data & Analytics Recruitment is seeking a Data Engineer in London with ownership of data infrastructure and decisioning systems powering a live lending platform. You will design, build and maintain production data pipelines across the lending lifecycle, including AWS Lambda-based decisioning … processes and end-to-end ETL/ELT workflows. The role emphasizes API development, data integration across sources, and strong focus on monitoring, reliability and production controls within a #J-18808-Ljbffr ...

Roke Manor Research Ltd is seeking a Data Engineer to design and develop data pipelines and analytics for National Security customers, leveraging distributed compute to transform raw data into actionable insights. You will work with diverse data sources, collaborate with customers … scrum team, and ensure data security and quality. DV clearance eligibility is required for this role. #J-18808-Ljbffr ...

currently working on a Data Engineer opportunity with an exciting early-stage technology business in London . They’re looking for a hands-on engineer to join a small, growing team and play an important role in building out their data platform. What they're looking … Strong Python and SQL Solid production Data Engineering experience Experience building and maintaining data pipelines Exposure to modern cloud technologies Experience with AI/LLMs would be highly beneficial Comfortable working in a fast-paced, entrepreneurial environment Strong ownership and problem-solving mindset This ...

Checkout.com is hiring an Analytics Engineer to design and build data pipelines that process data from our systems and services. The role partners with Finance to translate requirements into robust models and reliable data processing. You will maintain data quality while enabling … business. The position is hybrid in London, three days in the office, and you will work with Finance and Treasury teams to uphold data integrity and compliance as Checkout continues to #J-18808-Ljbffr ...

leading project solutions provider in London is seeking a Senior Data Engineer to build scalable, cloud-first data systems. You will design and manage data pipelines for analytics and AI across complex projects. The ideal candidate has a solid understanding of data … company's IDEAL values: Integrity, Drive, Empathy, Adaptability, and Loyalty. Join us to make a significant impact in the UK's data-driven transformation. #J-18808-Ljbffr ...

Australia and New Zealand.The RoleTo take technical responsibility for the operation and modernisation of Peninsula’s finance and HR systems, working in the Data Team, alongside our in-house Development Team and third-party technology suppliers across the globe. We seek technical experts with:Substantial experience of developing … solutions, data pipelines and systems integrations in both legacy and contemporary technologies using the Microsoft stack.A proven track record working with finance professionals, systems, processes and data.A history of liaising with stakeholders at the highest level in international corporate businesses.Reporting to the Associate Director of Data ...

Jingdong Retail (UK) Limited is seeking a Data Engineer to design, build, and maintain scalable data pipelines and platforms that power analytics and ML systems. You will work with product managers, data scientists, and business stakeholders to ensure data availability, quality ...

Zealand. The RoleTo take technical responsibility for the operation and modernisation of Peninsula's finance and HR systems, working in the Data Team, alongside our in-house Development Team and third-party technology suppliers across the globe. We seek technical experts with: Substantial experience of developing solutions, data … processes and data. A history of liaising with stakeholders at the highest level in international corporate businesses. Reporting to the Associate Director of Data & Systems Engineering, this role is for a candidate willing and able to develop and implement solutions, troubleshoot existing deployments and manage technical debt, whilst ...

Morrisons is seeking an Analytics Engineer to join our Data & Analytics team at our Head Office. You will shape data models and centralised semantic layers that power trusted reporting and data products across the business. You’ll translate complex business requirements into scalable data structures, mentor colleagues on SQL and data testing, and collaborate with stakeholders to drive insight-driven decisions while optimising data pipelines on Google Cloud Platform. #J-18808-Ljbffr ...

Kalpa Group is seeking an experienced Software Engineer to join the Data Platform team in a hybrid role based in Central London. You will own end-to-end data journeys—from ingestion with fund administrators to modeling and exposing reliable APIs for customer-facing applications … analytics. The ideal candidate has deep experience building production data pipelines and scalable data models, with proficiency in TypeScript and Python, and a strong understanding of Azure-based data tooling. #J-18808-Ljbffr ...

consistency. Technical Translation & Requirements: Translate complex infrastructure metrics (LLM inference optimization, GPU utilization, compute orchestration) into actionable roadmaps. Map demands like multi-tenancy, data privacy, and isolation into platform features. Risk & Dependency Mitigation: Proactively identify, track, and mitigate technical risks unique to massive-scale GenAI infrastructure and global … Kubernetes), or distributed systems. AI/ML Infrastructure Literacy: Foundational understanding of the infrastructure required for the Generative AI lifecycle, including high-throughput data pipelines, GPU/CPU cluster utilization, or model training/evaluation setups. Masterful Communication: Proven track record of presenting to and influencing executive-level ...

operate the platform powering compute-intensive analysis of large event-stream datasets. The work resembles a game engine's replay loop, a telecom packet pipeline, or a streaming analytics platform, applied to financial market data. Our stack includes modern C++ for throughput-critical ingestion and simulation, Python with C++ … bindings for research tooling, and distributed computing on HPC clusters. Your work will span exchange-data ingestion, HPC orchestration, simulation, and research tooling. Trading experience is not required; we provide comprehensive onboarding. Key responsibilities Design, build, and maintain high-performance, scalable software and data systems used ...

Apple Inc. is seeking a Senior Data Science Manager to lead strategic data solutions in Cambridge, MA. The role oversees analytics engineering and experimentation, driving data integrity and scalable data pipelines across multiple sources. You will guide teams in data storytelling, performance optimization, and collaboration with cross-functional leaders to align analytics with strategic objectives, while promoting an inclusive data-driven culture. #J-18808-Ljbffr ...

platform (NXT) to onboard AI-driven RBQM (Risk-Based Quality Management) solutions in cardiology. These solutions are created by data scientists and domain experts but without the right engineering layer, they never reach end users. That is where you come in. You will help build the “last mile … integration layer for AI solutions Develop services and APIs that enable ML models to be deployed and consumed within the platform Translate data science outputs into production-ready components Full stack application development Implement frontend and backend components for new platform capabilitiesEnsure clean integration between UI, services ...

seeking a Palantir Data Engineer to join our Insurance practice in London. You will design, build, and optimize scalable data pipelines, ingest and transform data in Palantir Foundry, and develop AI-driven analytics applications. You will collaborate with data architects, product teams … business stakeholders to deliver production-grade data products. Strong Foundry experience and Python/PySpark skills are essential. #J-18808-Ljbffr ...

days per week, or 40% of your time, at one of our above office sites About this opportunity We're transforming how data and security are engineered across Lloyds Banking Group, using data, automation and modern architectures to detect, disrupt and deter threats at pace … scale. Within the Chief Security Office, our Security Data & AI Lab is building intelligent, AI-driven security capabilities that help keep our customers and colleagues safe! As a Site Reliability Engineer, you'll join a collaborative team focused on the resilient operation of cloud-hosted applications and services. ...

83zero Ltd. is seeking an experienced Data Engineer to join their engineering team on an initial 6-month contract. The role focuses on cloud-native data applications and scalable pipelines within Google Cloud Platform. You will design and build ETL pipelines, leverage Python/Go/ ...

total funding to $55M from elite investors including Y Combinator, 20VC, Visionaries, Microsoft and Thomson Reuters. About the role We’re hiring a data engineer to build the ingestion and search systems behind Solve Intelligence’s AI products. Our sources include global patent literature, case law, technical standards … contributions, scientific databases, academic papers, and content from across the web. The data spans structured records, documents, images, audio and video. You’ll work across bulk ingestion and on-demand retrieval, making this information searchable and useful in our products You’ll own systems from source acquisition through ...

Cushman & Wakefield seeks a Senior Data Engineer to drive data transformation across EMEA & APAC. You will advance a Databricks-native Lakehouse, build agentic workflows, and own end-to-end data pipelines. The role demands architectural judgment, cross-domain depth, and a hands-on approach … complex data problems. You will report to a team lead and collaborate with analytical engineers to push the frontier of what is possible in enterprise AI-enabled data platforms. #J-18808-Ljbffr ...

Senior Full Stack Engineer (GCP) – AI-Powered Market Intelligence PlatformAre you a Full Stack Engineer who thrives on building scalable, data-driven platforms that solve real-world problems Our client is transforming a global supply chain through AI and real-time market intelligence. Operating at the intersection … data, cloud engineering and user-centric product development, they are scaling rapidly and investing heavily in engineering excellence.This is your opportunity to take ownership of core systems, influence technical direction and deliver meaningful impact across an industry that touches millions of lives daily.The OpportunityAs a Senior Full Stack ...