401 to 425 of 1,459 Data Pipeline Jobs in London

Help us make a big green dent in the universe. Key Responsibilities Design, build, and maintain scalable data pipelines in Databricks, ensuring data is reliable, timely, and well-documented. Own and evolve our Databricks models - define schemas, enforce testing, and keep the warehouse clean. Automate manual … technical teams to understand their problems and translate them into data solutions. Requirements Strong SQL and Python skills, used daily for pipeline development, data modelling, and automation. Experience with modern data stack tooling: a cloud data platform (Databricks preferred), and version ...

ever-evolving world by building, shaping, and optimizing diverse talent strategies. AMS is supporting a leading global consulting firm in hiring an experienced Data Engineer for an initial 12-month contract. (Offices in London/Birmingham/Bristol) Responsibilities Develop and maintain reliable data pipelines using … warehouses. Perform data validation, cleansing, and quality checks to ensure accurate and reliable data. Troubleshoot data issues and resolve pipeline failures efficiently. Collaborate with technical and business teams to deliver effective data solutions and improve data processes. Essential Criteria Strong ...

DescriptionRole – AI Evangelist (Senior Technology Architect) Technology – AI/ML/Gen AI, Data Science, Poly Cloud – Azure, AWS, GCP Location – London – UKBusiness Unit – TOPAZDLVRYCompensation – Competitive (including bonus)Job Summary: We are seeking a highly skilled and experienced Senior Architect/Consultants to lead our Generative AI Technologies … Protocol (MCP) & Interoperability: Strong working knowledge of the Model Context Protocol (MCP) for standardized, secure connectivity between LLMs/agents and enterprise tools, data sources, and systems. Ability to architect, build, and govern MCP servers and clients and to work with MCP primitives such as tools, resources ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … engaging with clients, understanding their needs, and translating them into effective outcomes. The Role: We are seeking an experienced Python Developer with significant data engineering experience to join a high-performing engineering team working on secure, data-intensive systems. The successful candidate will have a strong ...

Design, build and maintain robust, scalable data pipelines that support data science workflows and advanced analytics use cases Develop and manage complex Airflow orchestration, ensuring pipelines are reliable, observable and maintainable Work hands-on with Databricks suite to deliver high-quality data engineering solutions … data science teams Contribute to collaborative development through GitHub, code reviews and shared engineering standards Work effectively in feature-led environments, supporting repeatable, controlled and high-quality delivery Strong data engineering experience, with the ability to work independently, take ownership, and be accountable for delivery outcomes. ...

across Concept & Validation, Prototype, MVP, Pilot, and Launch. Own the stage-gate process and bring product perspective to trade-offs between methodology input, data availability and delivery. Customer discovery: Lead structured discovery with pilot companies to validate demand and shape the product around real needs. Fold UX feedback … carbon accounting to ground methodology design choices in real-world corporate practice. Oversee progress data management: Ensure the progress data pipeline and outputs meet product needs , prioritising data requirements against the roadmap. Supervise and task the reporting Data Manager to build ...

minutes. Engineering commits are entirely AI-assisted, which shifts the focus from team size to the quality of your thinking, and our data warehouse connects directly to an AI assistant for instant answers. Backed by a modern tech stack (Claude Code, Snowflake, Figma and Zapier) and a commitment … quarters, you get complete ownership to do the most impactful work of your career. Purpose of the role We're looking for a Data Engineer to join our data engineering function, helping to build and maintain the data platform that powers Zego's ambitious ...

using the power of next-generation sequencing (NGS), population-scale clinical studies, and state-of-the-art computer science and data science to overcome one of medicine’s greatest challenges. GRAIL is headquartered in the bay area of California, with locations in Washington, D.C., North Carolina … global investors and pharmaceutical, technology, and healthcare companies. For more information, please visit grail.com GRAIL is seeking a Staff Software Engineer for the Data Team. This team designs, builds, and operates the software systems that manage GRAIL’s end-to-end data lifecycle, from sample ingestion ...

Fabric Data Engineer - London (Hybrid) - Up to £90,000 - Permanent We're working alongside a leading Microsoft solutions organisation that's at the forefront of Data, AI and Business Intelligence applications. Following some consistent growth and investment across their Microsoft Data practice, they … looking for a Microsoft Fabric Consultant to help modernise the internal analytics solutions. The Role Designing, building and optimising data pipelines using Microsoft Fabric, Azure Data Factory, Synapse and Databricks. Implementing scalable data solutions to ingest, transform and serve large volumes of data. Working ...

international technology business founded to solve the immense information gap that exists in the energy industry. By using massive amounts of new satellite data and pioneering work in artificial intelligence, Vortexa creates an unprecedented view on the global seaborne energy flows in real-time, bringing transparency and efficiency … energy markets and society as a whole. http://www.vortexa.com/Ingesting data from multiple external vastly different sources at hundreds of rich data points per second, moving terabytes of data while processing it in real time, running complex and complicated prediction ...

business priorities alongside meaningful social, community, and societal impact. Ciena is advancing intelligent, automated networks through its Blue Planet portfolio by enabling data-driven innovation and AI-powered operations. This role leads the definition of data strategy, architecture, and productization for telecom data, enabling … scalable digital twin capabilities and data platforms that support next-generation network operations. The position plays a critical role in aligning data foundations with AI, automation, and product innovation across the portfolio. How you will make an impact: Define and own the canonical telco data ...

From Fivetran’s founding until now, our mission has remained the same: to make access to data as simple and reliable as electricity. With Fivetran, customer data arrives in their warehouses, canonical and ready to query, with no engineering or maintenance required. We’re proud that … more organizations continue to leverage our technology every day to become truly data-driven. About Us Fivetran and dbt Labs are bringing together two industry‐leading companies with a shared mission: helping organizations unlock the full value of their data. Together, we’re delivering the data ...

raised over $200 million in funding. And we’re only just getting started. Purpose of the role We're looking for a Senior Data Engineer to be a key technical contributor within our data engineering function, helping to build and evolve our data platform … meet Zego's ambitious growth. This is a hands‐on technical role — you'll design and build scalable, resilient, and secure data systems, while supporting the wider team through knowledge sharing and collaboration. You'll work closely with peers across Engineering, Data Science, Analytics, and Product ...

simplify payment processes. The company focuses on leveraging modern technology to make payment acceptance accessible and efficient for merchants. Задачи Build and maintain data pipelines for ingestion, transformation, and export across multiple sources and destinations. Develop and evolve scalable data architecture to meet business and performance … requirements. Partner with analysts and data scientists to deliver curated, analysis-ready datasets and enable self-service analytics. Implement best practices for data quality, testing, monitoring, lineage, and reliability. Optimize workflows for performance, cost, and scalability. Ensure secure data handling and compliance with relevant ...

Title: Business Data Analyst Client Location: Central London - Hybrid (3 on-site days/week) Starting: October 2026 Pay Comments: PAYE - 37.5 hrs/week Minimum Pay (per day): 200.00 Maximum Pay (per day): 217.00 Duration: 10 months Job Description: Aquent is partnering with a leading global technology … Science, with ideal exposure to Customer Success, Operations, or Digital Experience domains. Proficiency in SQL for data extraction, transformation, and pipeline development. Experience with dashboarding and visualisation tools (e.g., Tableau, Qlik, or similar). Familiarity with big data tools (e.g., Snowflake, Databricks, Spark ...

LEAD DATA ENGINEER (Azure) Uo to £75,000 + Benefits London (Hybrid) This is a fantastic opportunity to join one of the UK's most recognisable cultural organisations as they embark on a major data transformation programme. You'll take ownership of building a modern data platform from the ground up, driving best practice across data engineering while helping the organisation unlock the full value of its data and AI ambitions. THE COMPANY Part of a renowned charitable organisation that entertains millions across the UK, this is the largest publicly ...

looking for someone who has practical experience in building big analytics systems, handling row counts of 100 million or more, or data measured in terabytes. We'd prefer someone who has implemented SQL and NoSQL database designs in a big data context and has previously … worked with agile methodologies. Responsibilities: Bridge the gap between backend web development and data science teams Work on backend data pipeline development Integrate backend web services with databases/data warehouses Develop cutting‐edge data processing infrastructure How to apply Send ...

savings, budgeting, financial coaching & rewards. Stream - Employee financial wellbeing support: early access to your earned pay, savings, budgeting, financial coaching & rewards. Responsibilities: Data ingestion: Work to build, test and implement solutions for new data acquisition, building end to end process to support the entire department. Using … python, connect to various third party APIs, returning complex data from multiple endpoints. Implement processes to retain and refresh this data within business systems. Data Modeling: Using the businesses preferred ETL tools, generate curated datasets from raw input tables. Ensure all datasets have clear ...

This role is a strategic leadership position responsible for transforming vendor management into a data‐driven, digitally enabled function. The Senior Manager will own the design and execution of automation, data architecture, and advanced analytics initiatives to enhance commercial visibility, operational scalability and decision‐making across … vendor ecosystem. The position requires a combination of vendor management domain expertise, strong data and systems capability, and the ability to lead cross‐functional digital transformation initiatives at a regional or global level. Key Responsibilities Digital Strategy and Transformation Leadership Define and execute the digital transformation roadmap ...

tool/context integration (including emerging protocols such as MCP) Define and enforce responsible AI, governance, and assurance frameworks - covering bias, safety, data privacy, and model risk - aligned to client and regulatory requirements Lead and mentor a team of AI engineers and architects, building technical capability and clear … sales support, and stakeholder management at senior client level Strong software engineering fundamentals: API design, cloud-native architecture, microservices, and data pipeline/data engineering experience Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent professional experience; an advanced degree ...

company queries directly. You\'ll lead the team that owns the project end-to-end — staging, intermediates, and marts — plus the CI/CD pipeline and Snowflake platform underneath it. This is a technical leadership role, not a heads-down modelling one — most of your time goes to architecture … business with high-cardinality partner/catalogue data. Experience building or supporting AI/LLM-facing data products — a chatbot, a RAG pipeline, an agent with database access. Experience with GitHub Actions-based CI/CD for data pipelines. Good To Know: TodayTix Group takes ...

Python Data Scientist – Fintech80,000 Plus BonusQuant Capital is urgently looking for a Senior Data Scientist to join or well known Fintech50 client. Our client is a well-known cloud based fintech in the global payments and e invoicing space. They are a tech firm driven … responsibilities will be to develop further client facing machine learning use cases across multiple lines of businesses and to oversee the end-to-end pipeline of transforming the selected use-cases into performance code and deploying them into production. In addition to Python you should also be familiar with ...

LEAD DATA ENGINEER (Azure) Uo to £75,000 + Benefits London (Hybrid) This is a fantastic opportunity to join one of the UK's most recognisable cultural organisations as they embark on a major data transformation programme. You'll take ownership of building a modern data platform from the ground up, driving best practice across data engineering while helping the organisation unlock the full value of its data and AI ambitions. THE COMPANY: Part of a renowned charitable organisation that entertains millions across the UK, this is the largest publicly ...

world's money. For everyone, everywhere. More about our mission and what we offer. Job DescriptionWe're looking for an Lead Data Analyst who is passionate about our mission of Money Without Borders to partner with our operational teams to help drive data-driven decisions that … refining analytical models for strategic capacity planning. Take ownership of forecasting efforts to align with business growth and operational demands. Data Pipeline Ownership. Take ownership of data pipelines to maintain and improve data flow, ensuring reliability and accuracy. Predictive Modeling and Cause ...

experienced Data Engineer looking for more than simply delivering another backlog of tickets, this could be an opportunity to have genuine influence over the technology, the solution and the direction of major National Security programmes. We’re working with a highly regarded specialist technology consultancy operating across Data … reputation for technical excellence and is winning significant programmes against much larger organisations. As part of continued growth, they are looking for experienced Data Engineer (with current UK security clearance) to play a key role in designing and delivering complex data solutions. Our client is open ...