976 to 1,000 of 1,474 Data Pipeline Jobs in London

measure and monitor system performance, accuracy, and reliability Build and maintain production‐grade AI applications with clean code, appropriate error handling, APIs, and data pipelines Experience implementing, maintaining and evaluating retrieval systems (vector/graph databases, ingestion pipelines, chunking strategies, retrieval techniques such as HyDE) Implement feedback loops … testing frameworks, and deployment pipelines Solid foundations and understanding of production‐grade, cloud‐native platform and infrastructure requirements, design, and implementation. Strong data manipulation skills (pandas, SQL) and understanding of evaluation strategies for LLM‐based systems Ability to work with ambiguity and optimise non‐deterministic systems through ...

Bedrock, LangChain, HuggingFace Transformers, or OpenAI API. Design prompt templates and implement retrieval strategies to increase answer precision and factuality. Assist in creating data pipelines for training and testing, including annotation and evaluation tooling. Collaborate with product managers to translate user requirements into technical features. Participate in error … planning, reasoning, and tool use. Extend Microsoft 365 Copilot by building custom plugins and declarative agents within Microsoft Copilot Studio to surface enterprise data in Teams and Office apps. Operationalize AI solutions using Microsoft AI Foundry for model catalog management, Prompt Flow evaluation, and lifecycle governance. Architect scalable ...

Carnall-Farrar is seeking a Lead Platform Engineer in the UK to steer the data platform architecture and delivery. The role entails mentoring the data engineering team, translating architectural direction into implementable designs, and ensuring security and regulatory compliance across NHS data pipelines. … will collaborate with the Director of Data, Analytics and Intelligence, support partnerships with Databricks and other data organisations, and drive platform standards while delivering #J-18808-Ljbffr ...

catalogue of capability The orchestrator, and the resource model that tracks consumables and instruments as a live digital twin of the lab The capture pipeline that structures the data coming off the floor, with audit logging on every action and edit so nothing is unaccounted … what the lab produces. Your first 90 days FIRST 30 DAYS Get productive in the codebase and ship your first change into the execution pipeline, following the team’s review and deployment practices. Take ownership of a service or surface within the team. DAYS 30 TO 60 Ship ...

with research staff to advance our quantitative trading strategies. You will translate novel research ideas into production-quality code, build and maintain the data pipelines and modeling infrastructure that underpin our strategies, and apply your own strong mathematical intuition to solve open-ended technical challenges. This role lives … standard. Responsibilities Partner with PhD researchers to design, implement, and productize machine learning models that drive quantitative trading strategies Develop and maintain complex data pipelines, including data ingestion, feature engineering, validation, and quality monitoring Translate research prototypes and novel ideas into performant, well-tested, production-ready ...

This role will focus on enhancing and maintaining data pipelines to process financial and ESG data. What this role will do: Design, build, and maintain robust data pipelines using tools like Snowflake, Dagster, and SQL to process financial, climate, and ESG datasets at scale. Ensure pipelines … agile framework to prioritize tasks, manage time effectively, and align with team goals. Act as a proactive contributor to cross-functional collaboration with data scientists, analysts, and other stakeholders. Skills required: Degree in computer science, engineering, mathematics, quantitative methods or related field. Substantial experience in developing and maintaining ...

looking for an Azure Full Stack Engineer - Cosmos DB to join a major cloud and data engineering programme in London. This is a 6-month contract with a hybrid working model, requiring 1-3 days onsite. The role combines full stack development with modern Azure data engineering, giving you the opportunity to work on scalable applications and critical data components. You'll work closely with solution architects and DevOps teams, helping integrate Cosmos DB into cloud-native and microservices-based solutions while maintaining strong performance, security and data standards. ...

global financial institution based in London seeks a Data Engineer for the Lakehouse and AI Data Platform. In this role, you'll design, build, and support data pipelines, ensuring they are production-ready and meet data quality standards. You will work with ...

with research staff to advance our quantitative trading strategies. You will translate novel research ideas into production-quality code, build and maintain the data pipelines and modeling infrastructure that underpin our strategies, and apply your own strong mathematical intuition to solve open-ended technical challenges. This role lives … high engineering standard. ResponsibilitiesPartner with PhD researchers to design, implement, and productize machine learning models that drive quantitative trading strategiesDevelop and maintain complex data pipelines, including data ingestion, feature engineering, validation, and quality monitoringTranslate research prototypes and novel ideas into performant, well-tested, production-ready codeBuild ...

Jobtailor in London is seeking an experienced Data Engineer to build and maintain ingestion pipelines into the data warehouse, orchestrate data flows, and manage AWS infrastructure as code with Terraform. You will connect HR and payroll data pipelines, ensure secure, reliable data ...

Principal Machine Learning Engineer, AI & Data Platforms (AiDP) London, England, United Kingdom Corporate Functions At Apple, we build AI systems that define experiences for billions of people and we do it with an unwavering commitment to privacy, performance, and craft. The AI & Data Platforms (AiDP) team … Swift, and Java, with the ability to contribute production‐quality code across Apple's technology stack Experience building and operating enterprise‐grade ML pipelines (data preparation, distributed training, model optimisation, serving, and monitoring) in cloud (AWS, GCP, Azure) or on‐prem environments Preferred Qualifications Demonstrated ability to deliver ...

leading Data Management consultancy is seeking skilled professionals to join their team. This role involves delivering innovative data solutions and optimizing data pipelines within Databricks environments. Candidates should excel in data management, engineering, and analytics while demonstrating strong programming skills in Python … SQL. The position requires travel and on-site client work, appealing to those passionate about leveraging data for business insights. An attractive benefits package is offered, including private health insurance and a performance bonus. #J-18808-Ljbffr ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

organisation’s mission of advancing the mobile ecosystem and enabling innovation across global digital infrastructure. This role sits within GSMA’s data and technology function and focuses on designing, developing, and deploying advanced artificial intelligence solutions to support internal operations, member services, and industry initiatives. The successful candidate … systems, working closely with cross-functional teams to translate business requirements into technical solutions. Responsibilities include developing and optimising machine learning models, implementing data pipelines, and ensuring the robustness and scalability of AI-driven applications. The role also involves contributing to AI strategy, evaluating emerging technologies, and promoting ...

SDET Engineer who is passionate about quality and brings hands‐on experience across API and UI automation. You will work alongside engineering and data teams to build robust test frameworks, integrate them into CI/CD pipelines, and improve automation standards. Key Responsibilities Design, implement, and maintain … reliability, and performance. Build and maintain automated regression suites, including consumer‐driven contract tests (e.g., Pact). Automate validation for AI‐driven services, data pipelines, and ETL transformations. Integrate test suites into CI/CD pipelines using Azure DevOps, GitHub Actions, Jenkins, or GitLab CI. Work with data ...

code and ensure robust, well-documented releases. Your Responsibilities Oversee architecture across trading, clearing and post-trade systems, including integrations with CCPs, exchanges, data/platform vendors and customers. Direct modernisation of integration patterns and frameworks, reinforcing strong security principles and practices. Steer data architecture strategy … data quality, ownership, security and accessibility. Chair architecture governance forums, driving timely, effective architectural decisions. Produce architecture documentation, architectural decision records, target-state blueprints and audit-ready artefacts. Design resilient systems meeting RTO/RPO requirements and FCA operational resilience obligations. Meet regulatory obligations by design (FCA/ ...

Fortnum & Mason seeks a Data and Reporting Engineer to build and optimise Power BI-based analytics. You will collaborate with stakeholders to translate business questions into scalable BI solutions, shaping data pipelines and semantic models within Azure Synapse, Data Lake, and Fabric. You will … lead reporting delivery, ensure data quality, and promote best practices for governance and end-user experience across the organisation. #J-18808-Ljbffr ...

Data Scientist (AI & Machine Learning) – Renewable Energy & Emerging Technologies London/Hybrid About the Role We\'re looking for an AI-focused Data Scientist to join our Engineering & Development team, helping transform how renewable energy projects are identified, evaluated and developed. You\'ll work … technologies can improve the way renewable energy projects are developed. You\'ll also have the opportunity to contribute to new technology areas including data centres, onshore wind and future energy infrastructure. The organisation sees AI and advanced analytics as a key enabler of future growth and is looking ...

Consortia Group in London is seeking a Lead Data Engineer to own the design and development of scalable, cloud-based data infrastructure with a focus on Google Cloud Platform (GCP). You will lead a small team, build robust pipelines using Python, Snowflake and Databricks … drive CI/CD practices to ensure reliability. The role offers a hybrid work model with a strong emphasis on data-driven decision making and sustainability. #J-18808-Ljbffr ...

Energy in London (Chiswick) is seeking a Senior Data Engineer to design, build and scale data pipelines on the Google Cloud Platform. You will own hands‐on implementation, optimize pipelines, and mentor junior engineers while advancing our lakehouse and data governance. You’ll work ...

Barclays is seeking a skilled Data Scientist to design and implement ML models for financial crime risk management, including transaction monitoring and fraud detection. You will manage data pipelines, ensure data quality, and explore analytics to support governance across multiple jurisdictions. The role requires ...

Search, SEO, AI Search, Display (Meta, TikTok, etc.), Affiliates, and the next wave of channels yet to emerge. You’ll partner with engineering, data, and marketing teams to build products that efficiently drive new subscribers to Preply at unprecedented scale. Core Responsibilities: Scale paid acquisition channels through Product … posts and optimises millions of keywords - from discovery, through bidding, account structure, and ad copy generation. Push the team toward an always-on, data-driven automated scale of operations. Build creative automation for Display channels - generating, tracking, testing and iterating on creatives, across dozens of languages and regions. ...

global scale. WHAT YOU'LL BE DOINGStrategy & MetricsOwn the Numbers: Define, track, and socialize the core KPIs and OKRs for your product. Enable Data: Own necessary data logging and ensure pipelines are built for accurate product tracking. Drive Insights: Conduct deep-dive analysis to identify … BRINGExpert-level SQL skills with experience querying, manipulating and transforming large, complex, and relational datasets into functional pipelines. Experience designing and building automated data pipelines and transformations. Strong product thinking skills with the ability to translate customer needs into defining the right problem statements, success metrics, and opportunity ...

Celonis is the trusted platform to industrialize Enterprise AI. At our core is the Celonis Context Model — which combines process data, business knowledge, and intelligence into a living digital twin of the enterprise that AI can actually understand, turning AI's operational blind spots into operational clarity. World … support our growing sales team in achieving revenue goals by unlocking technical blockers and partnering closely with our Sales, Value Engineering, Product Management, Data Ops, and Information Security teams. You will be responsible for supporting engagements with new prospects as well as existing customers that look to expand ...

businesses are the backbone of the economy, and we’re here to help them win. We’ve built a platform that uses clever data to get them the funding they need in minutes, not weeks. At Funding Circle, we have the restless energy of a fintech start … campaigns and operational processes Use agentic AI tooling to automate structured tasks and remove delivery bottlenecks Build and maintain scalable, low-code data pipelines between marketing platforms, data sources and reporting tools Monitor and own the health of platforms: identify and mitigate risks, issues or control ...