101 to 125 of 303 Data Pipeline Jobs in London

paced, dynamic environment with leading industry expertise and state-of-the-art technology. About this job The mission Work with our AI and data team on Pack AI, our AI driven order consolidation and VRP module. Understand each prospect’s unique data and constraints, shape … recipe. You contribute meaningfully to Athena AI agent development (e.g., build an eval suite for tool execution quality, implement a new data pipeline for agent context) Must-have Strong analytical & problem-solving skills: Able to decompose messy, real-world problems and craft tailored solutions. Proficient in Python ...

leading organisation undergoing major investment in its data and engineering capabilities is looking for a Senior Automation QA Engineer to strengthen quality across complex, distributed systems. This role sits at the intersection of software engineering and data engineering, supporting the delivery of high quality services … reliable data products at scale. You ll work closely with cross functional teams, driving automation, improving test maturity, and ensuring the accuracy and resilience of data pipelines and backend services. This is a hands on role suited to someone who enjoys ownership, technical depth, and influencing ...

leading organisation undergoing major investment in its data and engineering capabilities is looking for a Senior Automation QA Engineer to strengthen quality across complex, distributed systems. This role sits at the intersection of software engineering and data engineering, supporting the delivery of high‑quality services … reliable data products at scale. You’ll work closely with cross‑functional teams, driving automation, improving test maturity, and ensuring the accuracy and resilience of data pipelines and backend services. This is a hands‑on role suited to someone who enjoys ownership, technical depth, and influencing ...

Full-Time The Company Our client is an innovative and rapidly growing technology-driven organisation based in London. The business is building advanced data and AI capabilities to support intelligent products, predictive analytics, and automated decision-making across its platforms. With a strong investment in data … learning technologies, the company is creating an environment where engineers can work on complex problems, develop scalable ML solutions, and collaborate closely with data scientists, engineers, and product teams. This is an exciting opportunity to join a high-performing team focused on delivering cutting-edge machine learning solutions ...

Senior Data Engineer London (Hybrid Working) Full-time | Permanent £80,000 - £90,000 (depending on experience) About the Company: Viqu Energy is working with a fast-growing tech company building solutions at the forefront of the energy transition. As the grid shifts toward renewables, their platform helps optimise … collaborative, inclusive team solving complex problems in a fast-paced, high-impact environment. About the Role: We're looking for a Senior Data Engineer to design, build, and scale the data infrastructure behind the company's platform. Data is central to their work, from ...

Data Integration Analyst (Azure/Databricks) Hybrid – Central London | £43,000 pro rata | ⏳ up to 6-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business … initial 3-month fixed-term contract . This is a great opportunity for someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. The Opportunity ...

Senior Data Engineer – London Insurance Market | London (Hybrid) About the Role We are hiring an experienced Senior Data Engineer to join a high-impact transformation programme focused on modernizing data platforms within the London Insurance Market . This is an excellent opportunity to work … native solutions that power underwriting, pricing, claims, reinsurance, regulatory reporting, and AI-driven analytics. You will play a key role in designing scalable data architectures, building robust pipelines, and partnering with senior stakeholders across business and technology functions. Location: London, United Kingdom Working Model: Hybrid Key Responsibilities Design ...

Senior Software Engineer/Data Platform Engineer London Area, United Kingdom (Hybrid – 3 days onsite) Contract Type: 6 month Inside IR35 £700–£750 per day The Role You will support the evolution of a large-scale financial data platform, modernising legacy enterprise systems while building scalable … skills. Nice-to-Haves Financial services or market data background Experience modernising legacy platforms API design and ETL/data pipeline experience AI-assisted development tools (GitHub Copilot) Quantitative or mathematics background To Apply - click the link provided. OR Email Barry.Ansell@HarringtonStarr.com for a faster ...

Fimador is currently recruiting for a Principal Data Engineer to join a team developing cutting-edge data-driven products. … This role is helping the firm pioneer AI and ML in the global environment. This role is central to designing and maintaining scalable pipelines, data platforms, and integrations, while ensuring solutions meet regulatory standards and align with architectural best practices. Key Responsibilities: Build and optimise scalable data ...

Engineer London & Leeds (Hybrid) Cntract - Inside IR35 SC Eligible Looking for strong SQL + Python , AWS/Azure , and data pipeline (ETL) experience. Exposure to Palantir Foundry is a big plus. 📩 Interested? Drop me a message or share with your network! #Hiring #DataEngineer #SQL #Python ...

experience to design, build, and deploy AI‐driven solutions across the deal lifecycle. This role sits at the intersection of advanced machine learning, data engineering, and strategic transactions , supporting high‐impact decisions during acquisitions, integrations, and divestments. You will work closely with investment teams, corporate development, finance, legal … data teams to apply AI to due diligence, valuation, synergy modelling, risk analysis, and post‐merger integration. Key Responsibilities Design, build, and deploy AI/ML models to support M&A activities, including: Due diligence automation (financial, commercial, operational, and legal) Target screening and opportunity identification Risk detection ...

Senior Data Consultant Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that specialises … modern data platforms. You’ll be working with well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Senior Data Consultant, you will be designing and delivering cutting-edge solutions across Azure Data ...

ASAP for 6 months - likely to extend About the Role We’re partnering with a financial client that’s undertaking a large-scale data transformation, modernising legacy systems and building a unified analytics platform in the cloud. As part of this initiative, you’ll play a key role … developing and optimising a Snowflake-based data warehouse and delivering high-quality visualisations and reporting through Power BI. The role offers the chance to work on greenfield architecture, migrate legacy SQL Server solutions and collaborate closely with senior stakeholders on complex, high-impact data initiatives. What ...

Senior Data Scientist London (Hybrid - 2-3 Days a Week on-site) £80,000 – £90,000 We’re partnering with a global software provider in the energy and utilities sector to hire a Senior Data Scientist to join a high-impact, innovation-focused internal team. This … fantastic opportunity to work on cutting-edge and data initiatives, helping shape advanced analytics products used across the business. This is an ultra visible team who will be positioned at the forefront of real innovation. The Opportunity As a Senior Data Scientist, you’ll work ...

GenAI Data Engineer Location: London/Edinburgh - (Hybrid - 2 days per week in the office) Day Rate: Market rate (Inside IR35) Duration: 6 months The Role We are seeking a highly skilled GenAI Data Engineer to join a forward-thinking team delivering advanced data and AI solutions. This role will focus on designing scalable data platforms and integrating Generative AI capabilities into enterprise systems. Key Responsibilities Design, build and maintain scalable data pipelines using PySpark, Python and distributed computing frameworks Architect and optimise AWS-based data ...

# Lead Analytics Engineer/Senior Data Contractor **London/Hybrid | Contract | SaaS/Product-Led Environment** I'm currently supporting a fast-growing SaaS business with an urgent requirement for an experienced **Lead Analytics Engineer/Senior Data Contractor** to help drive and stabilise their … analytics capability. This is a highly hands-on role,ideal for someone who enjoys working across **data engineering,analytics,and commercial insight**,with strong exposure to modern cloud data stacks and stakeholder-facing delivery. You'll be joining a fast-paced environment where data ...

Hybrid) Permanent | Start ASAP £65k - £75k We’re working with a fast-growing organisation looking for a SQL Commercial Analyst to sit between data engineering and commercial analysis. You’ll own the SQL data environment and turn raw data into insight that drives decision … making across finance, operations, and leadership. This is a high-ownership role with exposure across the business and real impact on how data is used. What You’ll Be Doing Build and maintain a scalable SQL data warehouse Develop and manage data pipelines ensuring ...

Data Engineer - SC Cleared | Outside IR35 | £525/day | 5-Month Contract We are currently seeking a highly capable Data Engineer to join a fast-paced, delivery-focused environment working on large-scale, data-driven solutions. This role offers the opportunity to work … complex data challenges within a modern cloud ecosystem, contributing to the design, build, and optimisation of robust data platforms. Contract Overview: Duration: 5 months (with potential for extension) Rate: Up to £525 per day IR35 Status: Outside IR35 Clearance: Active SC Clearance is essential Role Responsibilities ...

Compliance in Transaction reporting ), is a market-leading solution for regulatory transaction reporting and reconciliation across global regimes. En:ACT automates reporting, reconciles data across systems, and maps errors directly to regulatory rules, helping firms remediate quickly, reduce risk, and meet regulatory obligations with confidence. Already trusted … technical users. Alongside our SaaS offering, our unique model delivers consulting services across Risk & Compliance (including Transaction Reporting and Operational Resilience), ESG, Strategy, Data, and Operations. Unlike larger consultancies, we embed ourselves within client teams to deliver both insight and execution, taking ownership of outcomes and driving measurable ...

Data Engineer Ncounter is partnering with a highly specialised consultancy delivering advanced engineering and data-driven capabilities into secure Government and Defence programmes. We are looking for an SC Cleared Data Engineer to join a growing technical team focused on building scalable, production-grade … decision making. This role is centred on hands-on engineering within secure environments, where you will design and develop systems that enable complex data to be ingested, processed, and utilised effectively. You will work across both software and data domains, contributing to robust platform development while ...

cloud infrastructure, and scientific research to accelerate discoveries in life sciences. As a Staff Backend Engineer , you’ll build the distributed systems and data infrastructure that power the lab’s next-generation biology platform. From model serving to real-time data processing, your work will form … haves Experience with MLOps and model-serving infrastructure. Background in high-performance computing or large-scale scientific workloads. Expertise in data pipeline architecture and real-time streaming systems. Knowledge of scientific or biological computing environments . This is a rare opportunity to join a deep-tech ...

outcomes, provide decision support, and unlock new capabilities in medical robotics. You will work across the full ML lifecycle, from problem definition and data strategy through to deployment, monitoring, and continuous improvement. You will be expected not only to build models, but to define robust ML architectures, establish … regulatory, and quality teams. Key responsibilities: Translate clinical and product requirements into ML problems, datasets, metrics, and evaluation plans. Define the data pipeline, from raw and uncurated data to model-ready and traceable datasets. Develop robust training, validation, and evaluation pipelines with strong reproducibility ...

Senior AWS Data Engineer | London | Hybrid | £75,000-£105,000 I'm working with a fast-growing B2B finserv business based in London, and they're looking for a Senior Data Engineer to join their data platform team. This is a genuinely interesting engineering … data engineering experience with strong Python and SQL Hands-on with Airflow and/or dbt Solid AWS experience Experience with ETL pipeline development at scale Comfortable working in Agile/Scrum environments Full right to work in the UK — no sponsorship available for this role ...

data models using DBT Orchestrate workflows using Apache Airflow Write clean, modular Python code for data engineering solutions Improve pipeline reliability, performance, and observability Introduce and embed CI/CD, testing, and deployment best practices (Azure DevOps) Define and implement clear data domains … with strong business logic and modelling capability Experience with DBT, Airflow, and Python Experience building modular, scalable solutions within Snowflake CI/CD pipeline experience, ideally using Azure DevOps Exposure to Docker and modern software engineering practices Strong understanding of software delivery lifecycles and engineering best practices Background ...

data models using DBT Orchestrate workflows using Apache Airflow Write clean, modular Python code for data engineering solutions Improve pipeline reliability, performance, and observability Introduce and embed CI/CD, testing, and deployment best practices (Azure DevOps) Define and implement clear data domains … with strong business logic and modelling capability Experience with DBT, Airflow, and Python Experience building modular, scalable solutions within Snowflake CI/CD pipeline experience, ideally using Azure DevOps Exposure to Docker and modern software engineering practices Strong understanding of software delivery lifecycles and engineering best practices Background ...