176 to 200 of 303 Data Pipeline Jobs in London

real-world ML systems used at scale? We’re looking for a curious and motivated Junior Machine Learning Engineer to join a collaborative, data-driven technology team, working in a flexible hybrid setup based in London. This role is ideal for someone early in their career … learn from experienced engineers in a fast-moving environment. You’ll be part of a modern engineering function working on large-scale data and ML products, contributing to model development, data pipelines, and deployment workflows that power business-critical platforms. 🔍 In this role, you’ll: 🤖 Build ...

forecasting algorithm and time-series models are already built. What we need now is someone to make them run reliably—ingesting messy client data, maintaining our GCP/BigQuery infrastructure, and shipping outputs consistently as we scale from pilot to production. This role owns that. … Data/ML Engineer with strong software engineering instincts. You write clean Python, you're comfortable wrangling dataframes, and you know how to build pipelines that don't break at 2am. Required 🐍 1–3 years of commercial experience in data engineering, ML engineering, or a similar ...

Senior Microsoft Fabric Data Engineer 12 month contract - outside IR35 circa £600 a day Remote - you will need to be based in the UK & have the right to work in the UK What you will be doing Set up and govern a Microsoft Fabric environment (workspaces, security, RBAC … Build data pipelines & Dataflows for ingestion and transformation Develop Fabric Notebooks (PySpark/SQL) for advanced logic Create performant SQL views & data models for analytics Implement CI/CD pipelines Design and deliver Power BI dashboards & semantic models Manage integrations Produce documentation and support knowledge transfer ...

doing Designing and deploying production AI applications using LLMs Building RAG pipelines, agentic workflows, and scalable orchestration layers Integrating vector databases, APIs, and data pipelines Creating evaluation frameworks to measure system performance and reliability Improving AI systems through observability, feedback loops, and experimentation Optimising prompts, latency, cost ...

Team & Structure Current team: 6 engineers , scaling to 8 in the near term Planned split into focused teams, including a dedicated data pipeline/backend platform group This role becomes the primary technical and delivery owner for one of those areas Acts as a key bridge between ...

distributed systems in a regulated industry setting. This is a strategic test leadership role supporting large-scale transformation programmes, involving integration-heavy platforms, data pipelines, and compliance-driven technology estates. The successful candidate will guide distributed QA teams, shape automation-led strategies, and ensure test coverage aligns with ...

where digital analytics sits at the heart of how they plan, optimise, and measure media. If you enjoy variety, solving complex problems with data, and working closely with stakeholders, this role offers a broad remit, strong mentorship, and clear room to grow. The Company They … global footprint and a strong presence in the UK. Their clients span household-name brands across energy, public sector, education, and ecommerce. Data, measurement, and experimentation are central to how they design and deliver marketing solutions. You will join a close-knit analytics team embedded within the wider ...

Senior Full Stack Data Engineer – Decho Group (Part of Accenture) About Decho Group Decho Group is a fast-growing Tech and AI consultancy, founded to solve complex data challenges for governments and enterprises. We specialise in Palantir technologies, advanced analytics, and AI-driven solutions that transform … seeking Senior Consultant Engineers who want to apply their technical mastery in AI consultancy and Palantir engineering while shaping the future of data-driven decision-making. This is a hands-on, client-facing role where you’ll lead technical delivery, partner directly with stakeholders ...

than 4 countries. Blupace provides innovative software solutions for businesses of all sizes, with a focus on Web & Mob Applications, e-commerce websites, data & Analytics , Field services and more. We are passionate about developing innovative technology solutions that make a difference. We have the expertise and experience … Continuous Integration, Continuous Delivery). Experience using Microsoft Azure DevOps (ADO) to manage code and build deployment pipelines. Experience in designing and building data pipelines using SQL, code, ETL tools where appropriate. Experience in building reports using PowerBI or similar tools. The Package We offer a competitive salary ...

Informatica experience (IICS/ETL design and support) – this is critical SC clearance (or very close to obtaining it) Strong SQL/data engineering background , ideally in Azure‐based environments Nice to have/optional skills (not essential, but beneficial): Experience with Microsoft Fabric (e.g. Data … Factory, Synapse, OneLake) Exposure to financial services/FinTech environments Familiarity with Azure DevOps and/or GitHub Experience with testing practices for data pipelines (unit testing, QA) Broader Azure data services (Azure SQL, Managed Instance, Data Lake ...

real-world machine learning systems used at scale? We’re looking for a curious and motivated Junior AI Engineer to join a collaborative, data-driven technology team, working in a flexible hybrid setup with offices in London and Luton . This role is ideal for someone early … learn from experienced engineers in a fast-moving environment. You’ll be part of a modern engineering function working on large-scale data and AI products, contributing to model development, data pipelines, and deployment workflows that power mission-critical platforms. 🔍 In this role, you’ll: 🤖 Build ...

senior stakeholders, procurement teams, and decision-making committees. Navigate procurement processes, vendor registration, framework agreements, NDA/commercial approvals, and compliance with regional data protection and information security standards. Collaborate with global solution … teams, delivery, legal, and marketing to design tailored proposals and ensure successful implementation and client satisfaction. Maintain up-to-date client data, pipeline forecasts, and sales activities using CRM. Achieve and exceed revenue, retention, and growth targets. Requirements: 10+ years of account management/business development/ ...

Senior Data Engineer - London (Hybrid) We are working with a forward-thinking client who is looking for a Senior Data Engineer with strong experience in either AWS or GCP. Their platform operates across both clouds, so deep expertise in one is essential, along with a willingness … work within the other. About the Role You will design, build and maintain backend data pipelines that support the organisations key data products. The position requires strong Python engineering skills and experience working with modern data ecosystems. Experience with multi-tenant architectures is highly ...

engineering team building AI solutions for large enterprise clients. Typical work includes: • Developing and deploying machine learning models • Building scalable AI and data pipelines • Engineering ML systems on modern cloud platforms • Working with architects and data engineers on enterprise AI platforms Technology • Python • SQL • Spark/… Databricks or Snowflake • Exposure to GenAI or LLMs Background We’re interested in engineers with experience in: • AI or machine learning engineering • Data engineering with ML exposure • Applied data science with production deployment Financial services and consulting experience is preferred, particularly across banking, capital markets ...

Your new company Working for a globally renowned financial organisation Your new role We're looking for a Senior Software/Data Platform Engineer to help evolve a large-scale financial data platform. The environment includes both long-standing enterprise systems and modern AWS cloud services. … platform handles high-volume structured data and supports internal systems and customer-facing products.A big part of the role involves working with large SQL Server environments, so strong SQL skills are essential. You'll help modernise core systems, improve performance and reliability, and build scalable backend and data ...

Full Stack Data Scientist - AI & Knowledge Systems About the Role We are seeking an exceptional Full Stack Data Scientist to join our clients innovation team. This role combines traditional data science expertise with software engineering capabilities to build end-to-end AI solutions. … models to address complex business problems Scale AI solutions from proof-of-concept to MVP and full production Collaborate with backend engineers on data pipelines and infrastructure Work within solution architecture frameworks to ensure AI integration Contribute to solution design and technical decision-making Translate business requirements into ...

digital tools supporting flexible connections and DERMS. Perform power system studies (thermal, voltage, fault level) to identify network constraints. Develop Python-based tools, data pipelines, dashboards, and APIs . Use GitHub for version control and collaborative development. Work with teams across DSO, Planning, Operations, and IT , as well ...

boundaries of modern cloud security. You’ll be joining a world-class engineering team tackling genuinely hard problems - distributed systems, large-scale data pipelines, real-time detection, and automated response systems. This is hands-on, high-impact work, with the code you ship being in production fast ...

operational challenges and build high-impact solutions that bridge product and deployment. The role is intentionally broad and may include: Building and optimising data pipelines Developing backend services and APIs Creating lightweight UI components where needed Supporting on-site integration with customer environments Feeding real-world insights back ...

automation, and scalable platform engineering , typically involving technologies such as: Large language model–driven systems AI-assisted automation and orchestration Intelligent workflow systems Data pipelines and evaluation frameworks Distributed platform architectures What We’re Looking For Core Experience Strong experience building complex software platforms or distributed systems Experience ...

great opportunities to combine foundational statistics with modern AI to find meaning in consumer finance data. We are looking for a hands-on Data Scientist to work alongside our lead data scientist to experiment, engineer, and deliver innovative predictive models into our modern AWS production environments. … Current Areas of Focus: Affordability, income and expenditure analysis, credit risk, and fraud detection, with excellence in Entity Resolution – tying together disparate consumer data into a holistic view. Your work will directly help traditionally underserved consumers to access the most suitable financial products, whilst supporting our customers ...

across major exchanges and wagering markets. This role sits within a small technical team responsible for building and maintaining the internal tools and data infrastructure that support trading activity. You will work closely with traders and analysts to develop systems that process large volumes of sports data and enable real-time decision making. The Role The position focuses on building internal platforms and data pipelines used by trading teams. The successful candidate will be involved in developing new functionality, maintaining existing systems, and ensuring data reliability across the trading environment. ...

Azure and AWS AI stacks, Fast API microservices, Kubernetes, and secure vector search patterns. Strong background in FinOps, secure landing zones, and regulated data architectures aligned to FS controls and Responsible AI standards. Have delivered cross-cloud AI patterns across Microsoft Partner ecosystems and interoperable 3Ps wih platform … agnostic vector architectures. Deep expertise in IT architecture, data platforms, and product development, combined with strong influence across ISD and the Microsoft Partner ecosystem. I create clarity in ambiguity - converting executive ambition into structured architecture, adoption, and measurable value help in shaping multi-year transformation portfolios, structuring investment ...

Data Engineer | Outside IR35 | £450 - £500 | 6 months | Hybrid London We’re supporting a company who are looking for a Data Engineer to build and enhance the data processing capabilities within their Databricks environment. You’ll be responsible for developing the code that drives … their data pipelines, using Python, Spark, and Databricks Workflows to deliver new platform functionality and ensure efficient execution. Key Responsibilities Develop reliable Python and PySpark code to support data ingestion, transformation, and end‐to‐end processing. Deliver new technical features and components aligned to approved solution ...

where you'll lead the design, development, and optimisation of enterprise-wide BI solutions using Microsoft Fabric, Power BI and advanced cloud-based data engineering technologies. About the Role As Senior BI Developer, you'll translate complex business requirements into scalable, high-quality BI solutions used across multiple … regions. You will design and maintain enterprise data models, architect advanced Power BI solutions, and lead development within a Microsoft Fabric Lakehouse environment. This role also acts as a technical leader within the BI practice, supporting other developers and serving as the primary escalation point for advanced ...