26 to 50 of 84 Data Pipeline Jobs in the City of London

Lead Solution Architect (SAM / BEEDS)

Hiring Organisation
Inspire People
Location
City of London, South East, United Kingdom
Employment Type
Temporary Contract, Hybrid
Salary
£90,360
England, in partnership with Inspire People, is recruiting experienced Lead Solution Architects to design and deliver complex, cloud-based solutions across its regulatory data services. Hybrid working from London or Leeds, salary up to £90,360 plus an 8% cash benefits allowance, 10-25% discretionary annual bonus … monetary and financial stability. As part of its ongoing technology modernisation, the Bank is investing in platforms that improve how regulatory data is collected, processed, integrated and used across the organisation. These programmes include modernising the collection of regulatory submissions from banks and insurers, alongside developing internal data ...

Data Engineer

Location
City Of London, England, United Kingdom
Data Engineer London (Hybrid) 6 months Inside IR35 - umbrella only Active SC clearance required If you're a data engineer who enjoys turning data into reliable pipelines and usable datasets, this is a great chance to make an impact in a secure, public-sector … environment. What you'll be doing: Building and supporting ETL pipelines to move and transform data efficiently Developing reliable data flows that help teams access the right information at the right time Working within a secure environment, following relevant controls and best practices Helping ensure data ...

Sr. Director Client Enablement & Technology Assembly

Location
City Of London, England, United Kingdom
turning platform strategy into reliable end-to-end delivery execution. This includes leading client onboarding, APIs, Kafka streaming, reusable components, integration patterns, and data domain pipelines through clear plans, milestones, ownership models, and release-ready outcomes. The role combines delivery leadership, client-centric execution, technology assembly, and enterprise … Come be part of Ready for Next. Responsibilities Delivery Leadership & Management Provide executive delivery leadership for engineering teams spanning architecture, platform engineering, integration, data, and client enablement capabilities. Translate strategy into delivery roadmaps, execution plans, milestone commitments, operating rhythms, and success measures aligned to platform adoption and client ...

Remote Data Engineer: Snowflake & Matillion Migration

Location
City Of London, England, United Kingdom
Morgan McKinley is seeking a Data Engineer for a six-month contract to join … migration project. The ideal candidate will have strong SQL skills and hands-on experience with Matillion and Snowflake, focusing on data pipeline optimisation. The role is remote with occasional travel to the office, and requires coordinating with the data team to ensure a smooth migration ...

Databricks Engineer

Hiring Organisation
Gazelle Global Consulting Ltd
Location
City of London, South East, United Kingdom
Employment Type
Temporary Contract, Hybrid
Salary
Negotiable
programme, building and managing enterprise-scale Lakehouse platforms. You'll play a key role in developing secure, scalable and reliable Databricks environments, supporting data engineering teams across multiple environments and cloud platforms. This is a hands-on opportunity involving platform configuration, automation, deployment and performance optimisation. Key Responsibilities … Catalog, Autoloader and Structured Streaming. Knowledge of AWS S3, IAM, KMS, Glue and Lambda. Experience with Git, CI/CD and data pipeline development. Location: London/Manchester - Hybrid, 3 days onsite. For more information or to apply directly, please email I review applications daily and will ...

AI Infrastructure Lead Architect

Location
City Of London, England, United Kingdom
networking, and cost levers. Design deployment, automation, and CI/CD strategies for reliable, repeatable, and scalable releases of AI systems, models, and data pipelines into production. Establish AI monitoring and observability strategy across InfraOps and MLOps, defining SLAs, SLOs, alerting, and performance/cost tracking, and driving … infrastructure a subject, preferred knowledge of AI infrastructure. Good proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem‐solving skills and ability to work in a fast‐paced environment. Excellent communication ...

Senior .NET Developer

Location
City Of London, England, United Kingdom
build, enhance, and support enterprise applications. This role requires strong hands-on development in C#, deep SQL expertise focused on troubleshooting and data analysis, and the ability to deliver business-critical insights through Power BI. The developer will also support SaaS applications and contribute to the design … support APIs and integrations across internal and third-party systems Ensure code quality, scalability, and performance across the full SDLC SQL/Data Troubleshooting (Core Focus) Perform complex SQL querying and troubleshooting to support production issues Analyse, debug, and resolve data-related defects and performance bottlenecks ...

Undergraduate Placement - Data Science & Fraud Analytics

Location
City Of London, England, United Kingdom
Undergraduate Placement Data Science & Fraud Analytics APPLICATION CLOSING DATE January 2027 START DATE July 2027 LOCATION London (Hybrid) DURATION 13 months Ready to take on real-world challenges? Are you looking for a paid industrial placement as part of your degree and want to work on problems that … through advanced analytics, machine learning and digital identity intelligence. We're looking for curious, ambitious students who enjoy tackling complex problems, working with data and learning new technologies. If you thrive on challenges and want to apply your skills to real customer problems at scale, we'd love ...

Supply Chain and Ops AI infrastructure Architect

Location
City Of London, England, United Kingdom
premises compute resources such as GPU clusters and distributed training environments, deploy AI systems and models into production, and build and optimize data pipelines that feed AI and ML workflows. You optimize the computational stack for performance, cost, power, and scalability, monitor AI systems and infrastructure health across … computing infrastructure a subject, preferred knowledge of AI infrastructure. Proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication ...

Lead Data Engineer

Location
City Of London, England, United Kingdom
Lead Data Engineer | Build and Lead the Function Salary: Up to £90,000 Location: London | Four days per week in the office Ref: J13197 A scaling AI-powered SaaS business is looking for a Lead Data Engineer to build and lead its Data Engineering … next stage of growth. You’ll have real ownership and a direct influence on how the business builds and delivers its data products. From improving engineering practices to delivering critical pipelines, you’ll see the results of your work in live products and the value they create ...

Data Engineer

Location
City Of London, England, United Kingdom
currently looking for a Data Engineer for a six month contract. You will be working on a key migration project. It is important that you have strong SQL skills and experience working with Matillion and Snowflake. This role will be remot with occasional travel … office. Job Overview/Tech Spec Migration Project - Matillion to Matillion Maia Strong SQL Have worked with Snowflake platform Data Pipeline optimisation Reach out if you would like to discuss further. #J-18808-Ljbffr ...

Principal Solution Architect, Data & AI

Location
City Of London, England, United Kingdom
will be subject matter experts in the areas of Predicative AI, Machine Learning, Generative AI along with associated capabilities in areas like MLops, Data Pipelines, and DevOps. The role will interface directly with the customers' business, data science and IT Operations teams to establish CDW credibility … full CDW stack and portfolio whilst maintaining accurate and up to date information in CDW’s CRM system to support sales forecast and pipeline management. Documentation - Produce high-quality documentation from solution designs and request for proposal (RFP) responses to total cost ownership (TCO) & return on investment (ROI) models ...

Senior Astronomer Data Engineer

Location
City Of London, England, United Kingdom
platform is ready for production. Work closely with the existing data engineering team to support implementation and integration. Establish best practices for pipeline development, monitoring and maintenance. Document technical processes, configurations and deployment procedures. Train and upskill the wider engineering team to enable them … platform independently. Essential Experience Proven hands-on experience implementing and deploying Astronomer (Astro). Strong knowledge of Apache Airflow, including workflow orchestration and pipeline scheduling. Experience building, deploying and managing data pipelines. Experience with dbt and Snowflake. Strong technical troubleshooting and problem-solving skills. Ability to take ...

Senior Data Scientist

Location
City Of London, England, United Kingdom
About the Role We are seeking a highly experienced Senior Data Scientist to lead the research, development, and scaling of our next-generation conversational AI and multimodal systems. In this role, you will focus on Speech Processing. You will own the end-to-end lifecycle of our core … models — from designing massive data pipelines and human-in-the-loop labelling systems, to training, fine-tuning, and deploying state-of-the‐art Automatic Speech Recognition (ASR) models. Key Responsibilities Speech technology (ASR): Build, train, and optimise custom ASR models for high-accuracy transcription in noisy environments. Data ...

Tech Consultant Graduate: Data & AI / Networking

Location
City Of London, England, United Kingdom
architects, consultants and engineers who work together to turn technology strategies into successful customer outcomes. By combining expertise across Workplace, Networking & Security, Data Centre & Hybrid Cloud, and Cloud & Applications, we create integrated solutions that address customers’ wider business and technology challenges. As part of the programme … follow one of two specialist pathways: Data & AI , within our Cloud & Applications Practice Networking, Security & AI , within our Networking & Security Practice Whichever pathway you join, you’ll receive structured development, hands-on experience and support from experienced colleagues as you begin building your career in IT consultancy. What ...

Principal Software Engineer / Principal AI Engineer

Location
City Of London, England, United Kingdom
Principal AI Engineer Are you excited about building intelligent systems powered by innovative AI technologies? Do you enjoy creating solutions that turn complex data into impactful outcomes? About the team Embedded Innovation Teams are cross-functional squads embedded within our segments to rapidly turn internal AI experimentation into … deliver new ones. Design and govern reusable agentic AI patterns (orchestration, tool use, memory, retrieval). Ensure delivery meets architecture, security and data-governance standards; recommend infrastructure, hosting and data residency. Codify validated solutions into patterns, reference implementations, and starter kits so they can be picked ...

Python Developer DV cleared

Location
City Of London, England, United Kingdom
capabilities within air-gapped environments Deploy and manage containerised applications using Docker and Kubernetes Build and integrate APIs and microservices Develop and maintain data pipelines and workflow orchestration Configure and integrate workflow tooling such as Jira Work with a range of database, search and storage technologies Troubleshoot … management Previous experience working within air-gapped environments Strong understanding of APIs and microservices Experience with Prefect, Airflow or similar data pipeline/orchestration technologies Experience configuring and integrating workflow tooling such as Jira Experience with database and storage technologies such as: SQL Elasticsearch MongoDB DSE/ ...

Principal Software Engineer / Principal AI Engineer

Location
City Of London, England, United Kingdom
Principal AI Engineer Are you excited about building intelligent systems powered by innovative AI technologies? Do you enjoy creating solutions that turn complex data into impactful outcomes? About the team: Embedded Innovation Teams are cross-functional squads embedded within our segments to rapidly turn internal AI experimentation into … deliver new ones. Design and govern reusable agentic AI patterns (orchestration, tool use, memory, retrieval). Ensure delivery meets architecture, security and data-governance standards; recommend infrastructure, hosting and data residency. Codify validated solutions into patterns, reference implementations, and starter kits so they can be picked ...

AI Infra Architect: Scalable Supply Chain Ops

Location
City Of London, England, United Kingdom
drive best practices for InfraOps and MLOps while focusing on performance, cost, and scalability. You will lead container orchestration, model serving, and data pipelines, collaborating with senior teams to deliver production-grade AI solutions at scale. #J-18808-Ljbffr ...

DV Cleared Python Developer – Onsite London

Location
City Of London, England, United Kingdom
will develop, maintain and deploy Python applications, build APIs and microservices, and work with Docker/Kubernetes in air-gapped environments. Experience with data pipelines (Prefect, Airflow) and Jira is desirable. #J-18808-Ljbffr ...

Senior Full Stack Software Engineer

Location
City Of London, England, United Kingdom
global technology organisation is looking for a SeniorFull Stack Software Engineer to develop and enhance a range of data-driven applications, cloud platforms and intelligent software tools. This is a hands-on, full-stack engineering role combining backend development, cloud infrastructure, web technologies and emerging AI capabilities. … applications handling large datasets. Implement authentication and authorisation mechanisms for secure enterprise applications. Support infrastructure deployment, Infrastructure as Code and CI/CD pipeline development. Collaborate with engineering, product, data and business stakeholders to define requirements and deliver new features. Help scale successful applications into robust, maintainable ...

Cloud Data Engineer: Google BigQuery & Looker | Hybrid

Location
City Of London, England, United Kingdom
Datatech Analytics in London is seeking an experienced Data Engineer to join a hybrid team in the Insight, Analytics & Data function. You will design and maintain cloud-based data pipelines, integrating data from marketing platforms and delivering scalable data solutions that power reporting and decision-making. Key focus areas include ELT pipelines, data modelling in Google BigQuery, and leveraging Looker or similar BI tools. #J-18808-Ljbffr ...

Senior AI Solutions Engineer

Hiring Organisation
Randstad Technologies Recruitment
Location
City of London, London, United Kingdom
Employment Type
Contract
Contract Rate
£700 - £850/day
Based within Product Development Data Sciences (PDD) , you will serve as the technical lead and architect driving the organization's enterprise AI roadmap. You will transition operational teams from manual data handling to intelligent, automated steering through production-grade AI agents, agentified dashboards, and automated data … engineers and guide cross-functional teams on AI adoption. Must-Haves Candidates must meet the following minimum criteria: Experience: 4+ years in software, data, or ML engineering, including 2+ years building production LLM apps, RAG, or autonomous agents. Python: Expert-level production Python (FastAPI, Pydantic, asyncio, pytest, packaging ...

Senior AI Solutions Engineer

Hiring Organisation
Randstad Digital
Location
City of London, South East, United Kingdom
Employment Type
Temporary Contract, On-site
Salary
£700 - £850 per day
Based within Product Development Data Sciences (PDD) , you will serve as the technical lead and architect driving the organization's enterprise AI roadmap. You will transition operational teams from manual data handling to intelligent, automated steering through production-grade AI agents, agentified dashboards, and automated data … engineers and guide cross-functional teams on AI adoption. Must-Haves Candidates must meet the following minimum criteria: Experience: 4+ years in software, data, or ML engineering, including 2+ years building production LLM apps, RAG, or autonomous agents. Python: Expert-level production Python (FastAPI, Pydantic, asyncio, pytest, packaging ...

The Core Engineering - London - Vice President - Software Engineering

Location
City Of London, England, United Kingdom
Core Engineering - London - Vice President - Software Engineering Job Description The Core Engineering builds and operates the platforms, applications, data solutions, models, and analytics that power critical processes for The Core divisions of the firm (e.g., Risk, responsible for the risk profile of firm activities; Controllers, responsible … scalable solutions, leveraging cloud, AI, and machine learning for innovation and efficiency. The Core Engineering’s 2,000+ engineers and strats deliver engineering, data, analytics, and quantitative capabilities within six business units: Metrics & Analytics Platforms: responsible for the measurement and management of the firm’s risk, capital ...