51 to 75 of 107 Data Pipeline Jobs in the City of London

models, and integrating them with enterprise databases and cloud platforms. The candidate should be comfortable working across AI solution design, backend development, and data engineering. Key Responsibilities • Design and develop AI and Generative AI applications using Python. • Build backend services and APIs using Flask or Django … integrate GenAI capabilities such as LLM-powered workflows, AI assistants, or automation tools. • Design scalable architectures for AI solutions including model deployment and data pipelines. • Build REST APIs and microservices to integrate AI models with enterprise applications. • Work with cloud platforms (Azure preferred) to deploy and scale ...

support cutting-edge research in biotechnology and life sciences. You will play a key role in designing and developing platforms that enable scientists, data engineers, and bioinformaticians to analyze complex biological data, accelerate drug discovery, and improve clinical research workflows. This role combines strong backend engineering … cloud infrastructure and data engineering, with an interest in working alongside scientists and research teams. Key Responsibilities Design and develop scalable backend systems and APIs for scientific and clinical data platforms Build and maintain data pipelines for large biological and research datasets Collaborate with ...

real-world ML systems used at scale? We’re looking for a curious and motivated Junior Machine Learning Engineer to join a collaborative, data-driven technology team, working in a flexible hybrid setup based in London. This role is ideal for someone early in their career … learn from experienced engineers in a fast-moving environment. You’ll be part of a modern engineering function working on large-scale data and ML products, contributing to model development, data pipelines, and deployment workflows that power business-critical platforms. 🔍 In this role, you’ll: 🤖 Build ...

Senior Microsoft Fabric Data Engineer 12 month contract - outside IR35 circa £600 a day Remote - you will need to be based in the UK & have the right to work in the UK What you will be doing Set up and govern a Microsoft Fabric environment (workspaces, security, RBAC … Build data pipelines & Dataflows for ingestion and transformation Develop Fabric Notebooks (PySpark/SQL) for advanced logic Create performant SQL views & data models for analytics Implement CI/CD pipelines Design and deliver Power BI dashboards & semantic models Manage integrations Produce documentation and support knowledge transfer ...

doing Designing and deploying production AI applications using LLMs Building RAG pipelines, agentic workflows, and scalable orchestration layers Integrating vector databases, APIs, and data pipelines Creating evaluation frameworks to measure system performance and reliability Improving AI systems through observability, feedback loops, and experimentation Optimising prompts, latency, cost ...

distributed systems in a regulated industry setting. This is a strategic test leadership role supporting large-scale transformation programmes, involving integration-heavy platforms, data pipelines, and compliance-driven technology estates. The successful candidate will guide distributed QA teams, shape automation-led strategies, and ensure test coverage aligns with ...

Senior Full Stack Data Engineer – Decho Group (Part of Accenture) About Decho Group Decho Group is a fast-growing Tech and AI consultancy, founded to solve complex data challenges for governments and enterprises. We specialise in Palantir technologies, advanced analytics, and AI-driven solutions that transform … seeking Senior Consultant Engineers who want to apply their technical mastery in AI consultancy and Palantir engineering while shaping the future of data-driven decision-making. This is a hands-on, client-facing role where you’ll lead technical delivery, partner directly with stakeholders ...

than 4 countries. Blupace provides innovative software solutions for businesses of all sizes, with a focus on Web & Mob Applications, e-commerce websites, data & Analytics , Field services and more. We are passionate about developing innovative technology solutions that make a difference. We have the expertise and experience … Continuous Integration, Continuous Delivery). Experience using Microsoft Azure DevOps (ADO) to manage code and build deployment pipelines. Experience in designing and building data pipelines using SQL, code, ETL tools where appropriate. Experience in building reports using PowerBI or similar tools. The Package We offer a competitive salary ...

real-world machine learning systems used at scale? We’re looking for a curious and motivated Junior AI Engineer to join a collaborative, data-driven technology team, working in a flexible hybrid setup with offices in London and Luton . This role is ideal for someone early … learn from experienced engineers in a fast-moving environment. You’ll be part of a modern engineering function working on large-scale data and AI products, contributing to model development, data pipelines, and deployment workflows that power mission-critical platforms. 🔍 In this role, you’ll: 🤖 Build ...

senior stakeholders, procurement teams, and decision-making committees. Navigate procurement processes, vendor registration, framework agreements, NDA/commercial approvals, and compliance with regional data protection and information security standards. Collaborate with global solution … teams, delivery, legal, and marketing to design tailored proposals and ensure successful implementation and client satisfaction. Maintain up-to-date client data, pipeline forecasts, and sales activities using CRM. Achieve and exceed revenue, retention, and growth targets. Requirements: 10+ years of account management/business development/ ...

Senior Data Engineer - London (Hybrid) We are working with a forward-thinking client who is looking for a Senior Data Engineer with strong experience in either AWS or GCP. Their platform operates across both clouds, so deep expertise in one is essential, along with a willingness … work within the other. About the Role You will design, build and maintain backend data pipelines that support the organisations key data products. The position requires strong Python engineering skills and experience working with modern data ecosystems. Experience with multi-tenant architectures is highly ...

Full Stack Data Scientist - AI & Knowledge Systems About the Role We are seeking an exceptional Full Stack Data Scientist to join our clients innovation team. This role combines traditional data science expertise with software engineering capabilities to build end-to-end AI solutions. … models to address complex business problems Scale AI solutions from proof-of-concept to MVP and full production Collaborate with backend engineers on data pipelines and infrastructure Work within solution architecture frameworks to ensure AI integration Contribute to solution design and technical decision-making Translate business requirements into ...

digital tools supporting flexible connections and DERMS. Perform power system studies (thermal, voltage, fault level) to identify network constraints. Develop Python-based tools, data pipelines, dashboards, and APIs . Use GitHub for version control and collaborative development. Work with teams across DSO, Planning, Operations, and IT , as well ...

boundaries of modern cloud security. You’ll be joining a world-class engineering team tackling genuinely hard problems - distributed systems, large-scale data pipelines, real-time detection, and automated response systems. This is hands-on, high-impact work, with the code you ship being in production fast ...

operational challenges and build high-impact solutions that bridge product and deployment. The role is intentionally broad and may include: Building and optimising data pipelines Developing backend services and APIs Creating lightweight UI components where needed Supporting on-site integration with customer environments Feeding real-world insights back ...

automation, and scalable platform engineering , typically involving technologies such as: Large language model–driven systems AI-assisted automation and orchestration Intelligent workflow systems Data pipelines and evaluation frameworks Distributed platform architectures What We’re Looking For Core Experience Strong experience building complex software platforms or distributed systems Experience ...

across major exchanges and wagering markets. This role sits within a small technical team responsible for building and maintaining the internal tools and data infrastructure that support trading activity. You will work closely with traders and analysts to develop systems that process large volumes of sports data and enable real-time decision making. The Role The position focuses on building internal platforms and data pipelines used by trading teams. The successful candidate will be involved in developing new functionality, maintaining existing systems, and ensuring data reliability across the trading environment. ...

Data Engineer | Outside IR35 | £450 - £500 | 6 months | Hybrid London We’re supporting a company who are looking for a Data Engineer to build and enhance the data processing capabilities within their Databricks environment. You’ll be responsible for developing the code that drives … their data pipelines, using Python, Spark, and Databricks Workflows to deliver new platform functionality and ensure efficient execution. Key Responsibilities Develop reliable Python and PySpark code to support data ingestion, transformation, and end‐to‐end processing. Deliver new technical features and components aligned to approved solution ...

partnering with an AI first UK Biotech startup focused on the development of foundation models for next generation biological data analysis. (Senior) Full-Stack Engineer – London, Hybrid Role: Senior Full-Stack Engineer Location: London, UK (on-site/hybrid) Type: Full-time, Senior Level Full Stack Developer (Python … fast-growing team building cutting-edge technology used by scientists to accelerate drug discovery. This role sits at the intersection of software engineering, data, and life sciences, helping create platforms that enable researchers to run large-scale virtual experiments and analyse complex biological data. You’ll work across ...

About Decho Group Decho Group is a fast-growing Tech and AI consultancy, founded to solve complex data challenges for governments and enterprises. We specialise in Palantir technologies, advanced analytics, and AI-driven solutions that transform how organisations make decisions. In October 2025, Accenture acquired Decho Group, recognising … thrives on curiosity, collaboration, and bold thinking, working on projects that genuinely change lives and industries. The Role We’re seeking Full stack Data Engineers , across all levels from Junior to Senior Manager, who want to apply their technical skills in AI consultancy and Palantir engineering. ...

responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor … products and services Design solutions for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs ...

models, and scalable API platforms. Key Responsibilities Own the technical strategy and execution across the company’s core products, including real-time APIs, data pipelines, and LLM-powered analytics. Collaborate closely with Product and Data Science to deliver a forward-thinking technology roadmap. Lead, mentor … high-performing engineering team (currently ~10), nurturing a culture of ownership, speed, and technical excellence. Make key architectural decisions, ensuring system scalability and data infrastructure performance. Maintain high engineering standards while remaining close to critical technical choices. Recruit top talent and build a strong, inclusive team culture. Oversee ...

bonus Job Overview We are seeking an AI Security Engineer to design, implement, and maintain security solutions that protect complex systems and sensitive data, with a strong focus on GenAI and AI/ML platforms. This role works closely with data scientists, engineers, and security teams …/ML systems. Key Responsibilities Threat Analysis and Vulnerability Assessment Conduct regular threat modelling and vulnerability assessments across AI/ML systems, including data pipelines, model APIs, and GenAI services Develop tools, scripts, and benchmarks to automate AI/ML security testing Perform secure code reviews and penetration ...

partnered with a high-growth fintech company looking to hire a Head of Analytics Engineering to take ownership of a critical data platform that powers commercial performance and incentive models across Europe. These systems distribute tens of millions of pounds annually, making them a core part … looking for a Head of Analytics Engineering who can lead a small team of Analytics Engineers while remaining hands-on technically, designing scalable data solutions that translate complex commercial strategies into reliable systems. As Head of Analytics Engineering, you’ll sit at the intersection of data ...

Please send your CV to: ilana@omnamgroup.com ABOUT THE ROLE Your Impact Architect and implement core systems: cloud infrastructure, backend services, APIs, and data pipelines Build secure, scalable, and reliable components ready for real-world operational environments Lead integrations with external systems and support early data … tooling, documentation, and technical processes from the start Set up observability, monitoring, and performance systems Jump in wherever needed, from quick scripts and data cleaning to debugging production issues What You Bring 5+ years of engineering experience with strong architecture/complex backend systems experience Deep hands ...