26 to 50 of 72 Data Pipeline Jobs in the City of London

Title: Data Engineer (Mid-Level) Location: London (Hybrid 1 Day PW) Salary: £70,000 About the Role We’re looking for a Data Engineer to help build and scale our data platform. You’ll design pipelines, support analytics and ML use cases, and ensure … Data Engineering • Strong Python and SQL skills • Hands-on experience with Google Cloud Platform (GCP) • Experience with data warehousing and pipeline tools • Strong problem-solving and collaboration skills If this is of interest please apply and I will call to discuss. ...

Senior Data Engineer (Microsoft Fabric) London (1–2 days a week onsite) £65,000 – £85,000 The Role This is a hands-on senior data engineering role focused on building modern data platforms from scratch using Microsoft Fabric and cloud technologies. … joining a growing data team working across a range of client projects, helping organisations move from underutilised data to scalable, insight-driven platforms. The work is varied and delivery-focused, typically across 8–12 week projects covering discovery, proof of concept, and full implementation. This ...

Hybrid) Permanent | Start ASAP £65k - £75k We’re working with a fast-growing organisation looking for a SQL Commercial Analyst to sit between data engineering and commercial analysis. You’ll own the SQL data environment and turn raw data into insight that drives decision … making across finance, operations, and leadership. This is a high-ownership role with exposure across the business and real impact on how data is used. What You’ll Be Doing Build and maintain a scalable SQL data warehouse Develop and manage data pipelines ensuring ...

product and engineering culture. As a full-stack engineer, you'll work across the entire technology stack—from backend services and data pipelines to infrastructure and deployment. You'll collaborate closely with the engineering team to architect, build, and scale our micro-services based platform while maintaining high … oldest and least digitised sectors in the world. The core system ingests unstructured purchase orders and transforms them into structured materials data, integrating with a network of suppliers and logistics partners to automate quoting, sourcing, and fulfilment workflows. What We're Building We're building a sophisticated ...

product and engineering culture. As a full-stack engineer, you'll work across the entire technology stack—from backend services and data pipelines to infrastructure and deployment. You'll collaborate closely with the engineering team to architect, build, and scale our micro-services based platform while maintaining high … oldest and least digitised sectors in the world. The core system ingests unstructured purchase orders and transforms them into structured materials data, integrating with a network of suppliers and logistics partners to automate quoting, sourcing, and fulfilment workflows. What We're Building We're building a sophisticated ...

Engagement : Full‐Time Contractor Location : London/Hybrid Length: 12 month contract Role Summary We are seeking a software engineer specialising in distributed data systems to design and build low‐latency, high‐volume data processing solutions that underpin regulatory voice compliance assurance across the Bank … strategic data platforms. This is a hands‐on software development role , focused on event‐driven architectures, streaming pipelines, and scalable data matching engines rather than traditional reporting or BI. You will engineer resilient, production‐grade systems capable of processing high‐frequency voice metadata and transactional records ...

title: Data Engineer This role is paying up to £80,000 p/a and is hybrid working in London. **Must have insurance experience** Role overview We are looking for a Data Engineer with strong technical skills and experience in the insurance sector to join … fast-paced data team. Key Responsibilities Build and maintain scalable data pipelines (full ETL lifecycle) Perform data cleaning, transformation, and integration Work with Microsoft Fabric, Notebooks, Python, and PySpark Manage and develop solutions using SQL Server and Cosmos DB Handle multiple data ...

experience in the financial sector. Experience with CI/CD , microservices , and event-driven architectures is essential, and knowledge of Python (pyspark) for data-driven workflows is advantageous Key Responsibilities Design, develop, and maintain full stack applications using React JS , C#.NET Core , and supporting technologies. Build high-performance … stakeholders and risk, Regulatory Reporting and Finance domain experts to deliver solutions in these domains. Have a strong understanding of Power BI dashboards , data models, and analytical reports for business users. Work with DevSecOps to implement and optimize CI/CD pipelines , ensuring robust automated testing, deployment ...

Title: Senior Platform Engineer (AWS) – Data Platform Focus Location: Hybrid, 2days/week onsite-London, UK Duration: 6Months+ Contract Outside IR35 520GBP/Day Outside IR35 Overview We are hiring a Senior Platform Engineer (AWS) to work on a large project focused on moving data to AWS and building a modern data platform. The role is mainly platform and DevOps focused, with some involvement in data migration and data pipelines. We’re looking for someone who is strong in AWS, infrastructure, and automation, and can help build ...

What you will be doing: Build and deploy AI/ML and Generative AI solutions, including LLMs, RAG, and agentic AI systems. Develop data pipelines, automate ML workflows, and manage cloud-based MLOps infrastructure. Fine-tune LLMs using prompt engineering, vector databases, and PEFT methods. Monitor and optimize ...

risks and dependencies. Contribute to opportunity shaping and ongoing client relationships through strong strategic and delivery‐led thinking. Required Experience & Profile Data Pipeline Development Proven experience in enterprise communications, engagement, or change communications within large, complex organisations. Strong ability to translate technical, digital, or process change into ...

Integrate advanced AI capabilities including voice, reasoning, and context management ⚙️ Design and own scalable APIs connecting products and intelligence systems ⚙️ Architect data pipelines that power decision-making and agent context ⚙️ Build backend systems for knowledge extraction, enrichment, and automation ⚙️ Contribute to DevOps practices across CI/CD, infrastructure ...

Hybrid – London | Global FinTech Innovator Our client is an established yet fast-growing FinTech specialising in high-performance market data analytics . Their platform ingests and processes terabytes of global trading data daily , powering decision-making for leading investment firms, exchanges, and research institutions. They … seeking a Market Data Engineering Lead to take ownership of their equities data pipelines and infrastructure , helping scale the next generation of data-processing systems within a collaborative engineering leadership team. This role offers a 50/50 split between hands-on coding ...

reliability, scalability, and operational integrity of our machine-learning systems in research & production. This role sits at the intersection of data engineering and ML infrastructure: youll design and operate data pipelines that feed models, and youll build the tooling that trains, deploys, monitors, and retrains them. … lifecycle infrastructure Productionizing models: packaging, deployment, versioning, and rollback Designing CI/CD pipelines for ML (training validation deployment) Implementing model monitoring (data drift, prediction drift, performance decay) Managing experiment tracking and reproducibility Data engineering foundations Building and maintaining batch and nearreal-time data ...

Solutions Architect (B2C Domain) will design and implement scalable, secure, and user friendly systems for our B2C service lines. This includes integrating customer data, analytics, and AI-driven tools to improve user experience, streamline client and property workflows, and ensure compliance with data privacy regulations … systems across various projects. Key Responsibilities: * B2C System design: Lead the architecture for B2C systems, including property listing systems, portals, and analytics dashboards. * Data integration: Design data pipelines to aggregate customer behaviour, property performance, and third-party data (eg, market trends) for actionable insights. ...

technology to trade a broad range of energy, metals, and agricultural commodities globally. Our success is driven by cutting-edge analytics, high-frequency data processing, and a commitment to innovation. We are now looking for a Senior Python Engineer to join our dynamic team in London and drive … Python Engineer, you will be at the heart of our technology platform, building robust systems that enhance our trading strategies, risk management, and data analysis. You will collaborate closely with quants, data scientists, and traders, providing Python-based solutions that directly impact the profitability ...

impact on our product and engineering culture. As a Python Developer, you'll work across the entire technology stack from backend services and data pipelines to infrastructure and deployment. You'll collaborate closely with the engineering team to architect, build, and scale our micro-services based platform while … oldest and least digitised sectors in the world. The core system ingests unstructured purchase orders and transforms them into structured materials data, integrating with a network of suppliers and logistics partners to automate quoting, sourcing, and fulfilment workflows. What We're Building We're building a sophisticated ...

Senior Market Data Engineer Our client is a global quantitative and systematic investment firm operating across all liquid asset classes worldwide. The organisation is highly technology- and data-driven, applying a scientific approach to investing. By combining data, research, technology, and trading expertise … delivering consistent, high-quality returns. The role You will work closely with researchers and quantitative developers to unlock insights from high-frequency market data and help power large-scale research and trading workflows. Key responsibilities include: Partnering with research and quant teams to deliver insights from tick ...

Full Stack Data Scientist - AI & Knowledge Systems About the Role We are seeking an exceptional Full Stack Data Scientist to join our clients innovation team. This role combines traditional data science expertise with software engineering capabilities to build end-to-end AI solutions. … models to address complex business problems Scale AI solutions from proof-of-concept to MVP and full production Collaborate with backend engineers on data pipelines and infrastructure Work within solution architecture frameworks to ensure AI integration Contribute to solution design and technical decision-making Translate business requirements into ...

Responsibilities Multi-Engine Management: Administer a hybrid database environment, ensuring seamless data flow between PostgreSQL (Live Trading) and ClickHouse/Snowflake (Analytics). Data Movement & ETL: Own the reliability of CDC pipelines that stream data from production Postgres instances into the analytical layer. Schema … Evolution: Manage schema changes across different engines, ensuring that transactional data models translate effectively into columnar formats for analytics. Monitoring & Cost Governance: Implement unified observability for the entire stack. Specifically, monitor Snowflake credit usage and ClickHouse resource utilization to ensure peak ROI. Automation: Use Python, Bash and/ ...

Consulting Engineer London (Hybrid) SC Cleared £50 - 55,000 Overview: Anson McCade are working with a cutting‐edge data analytics consultancy that partners with major public and private sector organisations to solve complex, real‐world problems using advanced data and AI platforms. This is an opportunity … join a high‐impact engineering team operating at the intersection of data engineering, analytics, cloud platforms, and client delivery . You’ll work directly with customers, building and deploying solutions that drive meaningful outcomes. The Role As a Consulting Engineer, you’ll take ownership of solution delivery ...

currently working with a London-based fintech/data business hiring a Data Engineer to join a high-impact team building modern data infrastructure and analytics products around complex, high-volume datasets. This is a strong opportunity for someone who enjoys owning production pipelines … properly end-to-end in production, rather than just building transformations in isolation. What you’ll be doing: Building and maintaining production-grade data pipelines in Python Onboarding and integrating new data sources Designing and optimising transformations using a modern columnar stack Owning data ...

Contract Duration: 6 Months Pay Rate: 250 to 270 GBP/Day via Umbrella(Inside IR 35) The Opportunity Are you a Senior Data Analyst who is tired of just "maintaining" dashboards? Our client is looking for a forward-thinking analyst to join a Global Customer Success Data … into core workflows to automate insights and enhance the customer journey across multiple global markets. If you are passionate about moving beyond manual data prep and into the world of AI-native analytics , this is the role for you. What You'll Do Build AI-Native Foundations: Work ...

Databricks Data Engineer (Contract) 🚀 📍 2 days per week onsite in London 📅 ASAP Start -6-Week initial Contract 💰 Outside IR35 We’re supporting a Databricks Delivery Partner on a short-term, high-impact migration engagement and are looking for a strong hands-on Databricks Data Engineer … join the project immediately. This piece of work will focus on migrating data tables and ETL workflows from AWS Glue into Databricks, working closely with an experienced delivery team in a fast-paced consulting environment. 🔑 The Role Migrate existing data pipelines and tables into Databricks Build ...

business impact. This one sits right in the middle. We’re hiring a Solutions/Forward Deployed Engineer for a fast-growing B2B data SaaS company transforming how sales teams define and target their markets. TL;DR Location: London (hybrid) Setup: 2-3 days in office Language: English … Focus: Data modelling, integrations, customer delivery Stack: CRM (Salesforce/HubSpot), APIs, JSON, data warehouse Comp: ~£65-75k base + bonus Growth: 315% YoY The role You’ll work directly with customers and commercial teams to build and deliver custom datasets that drive real revenue ...