101 to 125 of 301 Data Pipeline Jobs in London

Full-Time The Company Our client is an innovative and rapidly growing technology-driven organisation based in London. The business is building advanced data and AI capabilities to support intelligent products, predictive analytics, and automated decision-making across its platforms. With a strong investment in data … learning technologies, the company is creating an environment where engineers can work on complex problems, develop scalable ML solutions, and collaborate closely with data scientists, engineers, and product teams. This is an exciting opportunity to join a high-performing team focused on delivering cutting-edge machine learning solutions ...

Data Engineer Ncounter are supporting a specialist technology consultancy delivering advanced data and software platforms into highly secure Government and Defence environments. We are seeking an SC Cleared Consultant Engineer to join a growing engineering capability working on complex, mission critical programmes where large scale data … heart of operational decision making. This is a highly technical position suited to engineers who enjoy building robust software solutions and scalable data pipelines while working closely with analysts, architects and stakeholders to solve complex problems. The focus of the role is hands on engineering, designing and developing ...

Role OverviewIt's an exciting time of growth for Nest and the Pension sector. We're looking for a Data & AI Literacy Trainer to support our enterprise-wide strategic goals around data-driven decision making, and responsible AI adoption. You will be responsible for building Nest … into a data and AI enabled workforce.This role blends technical expertise with adult learning principles. You will educate, upskill and empower colleagues at all levels to use data and AI tools effectively and with confidence. Are you a natural at training others in technical topics? Champion ...

Data Analyst 3 Month Rolling Farringdon - Onsite 1 day per month Inside IR35 Are you a data-driven professional with a passion for helping customers? Do you have a deep understanding of CRM and the data that enables execution and decision making in this … make a difference through leveraging your experience in a fast-paced, impactful environment, we want you to join our team as a Senior Data Analyst. Here's a taste of what you'll be doing: Consultative Leadership: Spearhead initiatives with cross-functional stakeholders, employing a consultative approach ...

Engineers to support a large-scale digital transformation programme for a major logistics client. The ideal candidates will have strong experience testing complex data platforms, with a particular focus on Salesforce Data Cloud , large data pipelines, and cloud-native architectures. You will be responsible … ensuring data accuracy, platform reliability, and end-to-end quality across integrated systems. Essential Skills & Experience Strong hands-on experience with Salesforce Data Cloud (Customer 360 Audiences/CDP). Solid Python skills, including Python test automation and Pandas for data manipulation. Proven experience ...

Data Lead Central London | Hybrid Up to £120k dbt, Python, Airflow, Looker, SQL We’re partnered with a high-growth fintech company looking to hire a Data Lead to take ownership of a critical data platform that powers commercial performance and incentive models across … pounds annually, making them a core part of how the organisation scales its commercial teams and measures success. They’re looking for a Data Lead who can lead a small team of Analytics Engineers while remaining hands-on technically, designing scalable data solutions that translate complex ...

Title: Snowflake Data Engineer Location: London (2 days on-site per week) Salary/Rate: £550 - £600 per day inside IR35 Start Date: March Job Type: Initial 3-6 month contract Company Introduction We have an exciting opportunity now available with one of our sector-leading consultancy clients … They are currently looking for a skilled Snowflake Data Engineer to help on their cloud migration project. Job Responsibilities/Objectives You will be responsible for designing and building scalable data pipelines, Data Vault models/Dimension Model, and Snowflake/dbt workloads ...

Data Engineer (Databricks) Inside IR35 | 6-Month Contract Sector: Public Sector/Central Government Location: London or Telford (Hybrid - Remote with on-site as required) Security Clearance: Active SC Clearance due to time scales About the Role We are seeking an experienced Data Engineer with deep … expertise in Databricks to support the development of scalable data platforms within a Central Government environment. This role is delivery focused and requires someone who has worked in secure, regulated public sector settings. You will be responsible for designing, building, and optimising data pipelines that enable ...

Principal Data Engineer (MS Azure) Location | UK Remote Salary | Up to £68,000 home based nationally or up to £74,00 home based for those living within the M25 dependent on experience plus a £600 per annum home working allowance Job Ref | J13058 We are looking … Principal Data Engineer to shape the technical direction of data engineering across a cloud based Enterprise Data Platform built on Microsoft Azure. This role suits someone with deep hands on data engineering experience who can also set standards, guide teams, and influence ...

Senior Data Engineer - Sponsorship Offered £65,000 - £72,000 + 20% Bonus + Excellent Benefits London 2-3 days on-site Our client is a leading global hospitality brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they … building a world-class data platform to power decision-making across every area of the business - from supply chain and logistics to marketing, customer sales and in-store operations. We are seeking an experienced Senior Data Engineer with deep expertise in Databricks to design, build ...

looking for a D365 Data Migration Specialist to join a high-priority digital transformation project. You will lead the migration of complex legacy data sets into a centralised Dynamics 365 environment using Azure Data Factory (ADF) . … This is a fully remote contract for a London-based client. You must hold an active SC Clearance to be considered. Key Responsibilities ETL Pipeline Development: Design, modify, and maintain robust data pipelines using Azure Data Factory . Data Mapping: Lead ...

large businesses in their staffing & recruitment transformation. About the role Join Manatal as a Product Analyst, taking full ownership of our product data structure, and collaborating with Engineering to build essential data pipelines. Generate insightful reports on key Product Department topics and conduct independent analyses, providing … recommendations on critical issues. Bring your expertise in data analysis and communication skills to drive data-driven decision-making in a dynamic and innovative environment. Core Responsibilities 1. Own the Product Data Structure: Take complete ownership of the data structure required ...

Data Engineer -Remote - AWS - Python - SQL - dbt - Up to £80,000 I'm working with a fast-growing B2B SaaS scale-up that's transforming how global organisations manage, clean and activate their data. Their platform is used by major enterprise brands to ensure data integrity … contributions Clear opportunities to grow with the team and step into a leadership path Key Experience Needed SQL, essential, used across the warehouse and pipeline layers. Python, especially for production pipelines, APIs and semi-structured data. Solid experience with AWS: Redshift (core data warehouse) S3 RDS/ ...

Data & Analytics Domain Solution Architect Up to £110k per annum + £6k car allowance + 30% bonus + Private Healthcare Hybrid - 3 days per week in London office We are seeking a Data & Analytics Domain Solution Architect to take on a strategic, business-critical role within … global, multi-brand organisation. This is a senior opportunity within the Architecture & Engineering function, supporting a major modernisation of data, analytics, and digital capabilities across a truly international footprint. As the Data & Analytics Domain Solution Architect , you will own the architecture vision across data ...

Junior Data Engineer - Research & Technology Role Overview This role supports the development and maintenance of a scalable data platform underpinning private equity investment activity across EMEA. Working closely with investment teams, you will build and optimise data pipelines, automate workflows, and transform fragmented market … real estate data into structured intelligence that informs underwriting, portfolio strategy, and capital allocation decisions. Role Responsibilities * Build and maintain scalable data pipelines, managing large data sets from internal and external sources. * Develop and optimise ETL processes using AWS, SQL, and modern cloud technologies. ...

what you'll build. What You'll Build This is genuinely 0-to-1. There is no existing model, no data pipeline, no baseline to iterate on. You're starting from a blank sheet - which means you'll need to be comfortable with ambiguity, scrappy about data … reach for Gaussian processes, gradient-boosted ensembles, neural state-space models, or hybrid symbolic-statistical approaches - and, critically, knows why. Integrate alternative data sources. Satellite imagery, shipping data, weather signals, procurement index feeds, news sentiment — the edge is often in the signal no one else ...

FABRIC DATA ENGINEER 8-MONTHS £575-£625 PER DAY (INSIDE IR35) This is a fantastic opportunity for a Data Engineer with Azure Fabric experience to contribute to a high-velocity organisation delivering cutting-edge data transformation projects. You'll take on a central role … building scalable, cloud-native pipelines and supporting reliable data flows across the business. This environment fosters autonomy, technical input, and exposure to modern data engineering approaches across a hybrid cloud ecosystem. THE COMPANY This global company operates in a dynamic, insights-driven industry, where data ...

Contract Opportunity for an eDV Cleared Data Engineer with a leading National Security Consultancy in London. Active Enhanced DV Clearance required £680 p/d inside IR35 12-month engagement Full-time on-site in Central London The Role: You will design and deliver mission-critical data services for National Security clients. Working across AI, cyber security, cloud, big data and digital transformation initiatives, you will help shape the future of national security. You will build and manage robust data pipelines that convert raw, diverse data sources (batch, streaming ...

organisation. If you enjoy combining technical delivery with business facing work and want to play a key part in a wider digital and data transformation, this role offers both impact and progression. The Company They are a large, multi brand training group undergoing a significant transformation … they use data, automation and technology. With multiple businesses under one group, they are building more standardised systems, strengthening their data infrastructure and moving towards more automated, insight driven decision making. The BI and data function is central to this journey and works across ...

organisation. If you enjoy combining technical delivery with business facing work and want to play a key part in a wider digital and data transformation, this role offers both impact and progression. The Company They are a large, multi brand training group undergoing a significant transformation … they use data, automation and technology. With multiple businesses under one group, they are building more standardised systems, strengthening their data infrastructure and moving towards more automated, insight driven decision making. The BI and data function is central to this journey and works across ...

Role Overview We are seeking an AI Agent Data Engineer to join the Technology, Data & Innovation division, This role sits at the core of building next-generation AI processes and control agents deployed across multiple Agent Factories. You will work closely with AI Acceleration Leads … cross-functional teams to drive projects from concept to production. The position focuses on designing scalable, agent-ready data systems and enabling seamless integration between AI agents and enterprise environments. Key Responsibilities Ensure organizational data is agent-ready by aligning data access, availability ...

Contract Opportunity – Snowflake Technical Lead | 🟢 Outside IR35 | Hybrid London A leading Data Consultancy is supporting a large enterprise insurance organisation delivering a major cloud data platform programme and we’re looking to bring in an experienced Snowflake Technical Lead to take ownership of a key delivery … sitting purely in architecture or governance discussions. The Role You’ll be responsible for leading the technical delivery of a standalone data pipeline within Snowflake, working as part of a wider transformation programme modernising core data capabilities. Responsibilities will include: Designing and building Snowflake data ...

Lead Data Analyst Up to £80,000 + Bonus About the Role I am currently recruiting for a Lead Data Analyst to support the delivery of data and analytics transformation programmes within a global technology consulting organisation. Working across a variety of enterprise … public sector clients, this role sits between business strategy, data platforms and analytical delivery. You will lead teams responsible for delivering modern analytics solutions, data platforms and reporting capabilities built on modern cloud and big data technologies. This role is ideal for someone ...

Microsoft Fabric Data Engineer About Movar At Movar, we understand that project delivery is getting increasingly complex. Since 2013, we’ve been helping companies of all sizes improve the way projects are delivered. Our mission is to be the number one provider of innovative project solutions, driven … change and thrive in it. Loyalty – We stand by each other and our mission. Job Summary Lead the design and delivery of modern data platforms on Microsoft Fabric, owning end-to-end data engineering solutions from ingestion to consumption. Design and build scalable data ...

project. Due to the nature of the work, candidates hold UKSV DV clearance. Key Skills & Experience Strong expertise in Python, Docker, Kubernetes, and Data Governance Experience working in air-gapped … environments, including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range ...