526 to 550 of 717 Data Pipeline Jobs in the UK

know-how Bonus Points If You Have built complex workflow orchestration systems Know your way around cloud infra Have experience building integrations or data pipelines Love mentoring and growing teams Why Join Saris AI? Join us in building the future of work for the trillion-dollar banking industry ...

know-how Bonus Points If You Have built complex workflow orchestration systems Know your way around cloud infra Have experience building integrations or data pipelines Love mentoring and growing teams Why Join Saris AI? Join us in building the future of work for the trillion-dollar banking industry ...

Cloud Composer using standard agile SDLC techniques. Knowledge of developing guidelines for Airflow clusters and DAGs, performance tuning, task implementation, and data‐pipeline development for onboarding and change management. Installation, configuration and monitoring of Airflow clusters; strong Python programming skills. Understanding of Airflow REST services and integration ...

guidelines for Airflow clusters and DAG's, working knowledge of performance tuning of the DAG's and task implementation, developing DAG - data pipeline to on-board and change management of datasets Experience with installing, configuring and monitoring Airflow cluster, strong Python Understanding of Airflow rest services ...

different technical leads, giving you both variety and continuity. The environment values curiosity, evidence-based thinking, and the confidence to question assumptions constructively. Data scientists work within established delivery frameworks and collaborate closely with engineers, analysts and product-focused teams. Learning happens through doing, supported by an experienced … inclusive data science community. What You'll Be Doing - Contribute to the design, analysis and build of data science solutions addressing real business and operational problems - Apply statistical, mathematical and scientific approaches to explore data, test hypotheses and support decision-making - Write and maintain ...

high-quality production code, and reviews and debugs code written by others \n Defines and drives the technology roadmap, focusing on next-generation data, analytics, and automation platforms \n Champions the use of AI, machine learning, and advanced analytics to deliver real-time trade processing applications \n Identifies … opportunities to eliminate or automate recurring issues to improve overall operational stability of software applications and systems \n Designs and implements data pipelines, analytics workflows, and reporting solutions using Python, Databricks, and Spark \n Develops and maintains web-based applications and dashboards using modern web stacks (React, Angular ...

deploy intelligent, scalable applications. You will work at the intersection of backend engineering and artificial intelligence, building systems that integrate machine learning models, data pipelines, and cloud-native services. \n This role is ideal for someone passionate about clean architecture, performance optimization, and applying AI technologies to real … performance Java-based applications \nIntegrate AI/ML models into production-grade backend systemsBuild RESTful APIs and microservices using modern Java frameworksCollaborate with data scientists to deploy and scale machine learning solutionsOptimise system performance, scalability, and security\n \n Implement CI/CD pipelines and ensure high code ...

working with a major Commodity Trading client based in London who are looking for a Senior Data Engineer to work with Post Trade analytics and valuation. You will need a strong technical expertise in designing, developing, optimising, and supporting scalable data pipelines, data models … will work closely with business stakeholders to understand trading and risk processes, translate business requirements into robust technical solutions, and deliver high-quality data transformations, semantic models, and enterprise reporting capabilities that support informed decision-making. Requirements Strong Commercial experience in Power BI Strong understanding of administrating, server ...

About the Role The Onyx Research Data Tech organization represents a major investment by GSK R&D and Digital & Tech, designed to deliver a step-change in our ability to leverage data, knowledge, and prediction to find new medicines. It is a full‐stack shop that … brings together product and portfolio leadership, data engineering, infrastructure and DevOps, data/metadata/knowledge platforms, and AI/ML and analysis platforms. Our focus is on creating a next‐generation data experience for GSK’s scientists, engineers, and decision‐makers, increasing productivity ...

Principal AI Engineer Are you excited about building intelligent systems powered by innovative AI technologies? Do you enjoy creating solutions that turn complex data into impactful outcomes? About the team: Embedded Innovation Teams are cross-functional squads embedded within our segments to rapidly turn internal AI experimentation into … deliver new ones. Design and govern reusable agentic AI patterns (orchestration, tool use, memory, retrieval). Ensure delivery meets architecture, security and data-governance standards; recommend infrastructure, hosting and data residency. Codify validated solutions into patterns, reference implementations, and starter kits so they can be picked ...

unique opportunity to step into a high-impact Analytics Engineer role within a purpose-driven organisation at a pivotal stage of its data journey. You will take ownership of critical data modelling work within a modern cloud environment, helping to stabilise and scale key data pipelines while contributing to meaningful, real-world outcomes. ROLES AND RESPONSIBILITIES: The Analytics Engineer will: Own and deliver in-flight data modelling projects, ensuring continuity and completion Design and maintain dbt models including fact tables, dimensions, and metric layers Support and optimisie critical data ...

Data Engineer - SC Cleared UK (Remote/Hybrid) | £490 per day | 6 Months | Inside IR35 We're seeking an experienced SC Cleared AWS Data Engineer to support a high-profile Central Government programme delivering critical data capabilities within a secure cloud environment. This … excellent opportunity to contribute to nationally significant work while leveraging modern AWS and data engineering technologies. Key Responsibilities Design, build, and optimise scalable cloud-based data pipelines on AWS Develop and maintain robust ETL processes to support complex data integration requirements Implement and manage ...

committed to doing it well. We are looking to engage an Interim Business Analyst to support the discovery, definition, and shaping of data and analytics initiatives, ensuring clear requirements and actionable outputs to enable delivery, test and benefits realisation for a period of 12-months, therefore you will … implementation of Databricks to replace Synapse and Informatica pipelines and notebooks Carbon reporting tool for customer use Discovery and shaping of additional data initiatives (may include automated quotations, dynamic pricing, product enrichment) You will be responsible for: - Discovery & Requirements Gathering Conduct stakeholder interviews and workshops Capture and document ...

Data Engineer Crypto trading Remote £100k – £180k Plexus is partnering with a well-funded blockchain tech company offering an exciting opportunity within a competitive financial market. The platform enables user to access global financial markets directly from a digital wallet, leveraging on chain technology to create a more … open and efficient trading experience. Backed by leading investors and industry operators, the team is building scalable systems at the intersection of data systems within crypto and blockchain technology. They are now looking for a senior data engineer to join the team and aid x Responsibilities ...

Role AI Evangelist (Senior Technology Architect) Technology, Location & Compensation AI/ML/Gen AI, Data Science, Poly Cloud – Azure, AWS, GCP London, UK Competitive (including bonus) Job Summary We seek a highly skilled senior architect/consultant to lead the Generative AI Technologies team. The candidate must … task execution at scale. Model Context Protocol (MCP) & Interoperability – architectural knowledge of MCP for secure connectivity between LLMs/agents and enterprise tools, data sources, and systems; ability to build and govern MCP servers and clients, and familiarity with related interoperability standards. Agent Skills & Extensibility – extending agent capabilities ...

across eBay Finance by building scalable solutions that improve decision-making and operational efficiency. The team works on complex, often undefined problems using data, AI, and automation. This role focuses on leading end-to-end transformation initiatives, from problem discovery through to production deployment. It involves working across … solution roadmaps Deliver end-to-end AI, machine learning, and automation solutions from concept to production, driving measurable business outcomes Build scalable, reusable data frameworks and pipelines that improve efficiency and enable future innovation Work with large, complex datasets to develop practical solutions that balance speed, accuracy ...

seeking a Senior AI Engineer to design, train, and deploy advanced recommender and personalization models. The role emphasizes production-grade ML systems, scalable data pipelines, and collaboration with cross-functional teams. You will lead experimentation, evaluate new AI techniques, and stay ahead of industry trends while delivering impactful ...

etc.) with libraries/frameworks such as PyTorch, TensorFlow etc.) * Experience with RAG and LLM-based solutions * Solid understanding of AI architectures and data pipelines * Knowledge of security, compliance, and governance principles from a development perspective * Proven mentoring and team development capabilities * Excellent communication and stakeholder management skills ...

using Terraform, ECS, and Lambda while maintaining multi-tenant security and ISO 27001 standards. Develop and optimize hybrid search capabilities and data pipelines, integrating LLMs to automate complex research tasks for dealmakers. The ideal candidate: 7+ years of experience building and shipping production-grade systems in startup ...

modern JavaScript/TypeScript (React) and Python (FastAPI). Demonstrates strong proficiency in cloud infrastructure, specifically AWS, and designing robust database structures and data pipelines. Thrives in a small, fast-paced startup environment and possesses a genuine interest in human-centered AI that enhances domain expertise. ...

modern JavaScript/TypeScript (React) and Python (FastAPI). Demonstrates strong proficiency in cloud infrastructure, specifically AWS, and designing robust database structures and data pipelines. Thrives in a small, fast-paced startup environment and possesses a genuine interest in human-centered AI that enhances domain expertise. ...

myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Description We are seeking a Data Scientist with experience prototyping, building, and scaling AI applications to join WTW’s Data Science team within our Consulting practice. In this role … will help grow our AI and Data Science advisory capability, working alongside leading insurance market experts to design and deliver cutting edge machine learning and generative AI solutions for the world’s leading general insurers and intermediaries. The Role: As a data scientist, you will operate ...

tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose. Join our Data & AI Strategy team and be part of the future of AI consulting, where we’re not just advising clients, we’re actively disrupting traditional consulting … operate at the cutting edge of intelligent enterprise evolution. We DESIGN intelligent, agent-ready platforms – Architect and deliver scalable, secure, and cost-efficient data, analytics, and AI ecosystems that support both human and autonomous agent workloads, leveraging leading cloud platforms (AWS, Azure, GCP). We ENABLE agentic ...

start a career that is out of the ordinary, please apply... Job Details Why this job is important This role is about applying data science where it genuinely matters - in live, production environments that support large‐scale research operations around the world. As a Senior Data … Digital Twins team you'll work on advanced modelling and analytics that improve the quality, reliability and performance of high‐volume data systems. You'll partner closely with engineering, operational and commercial teams, taking ideas from hypothesis through to deployment, and ensuring models deliver real value once they ...

office based in Waterloo station, we are looking for a Junior Business Intelligence Developer who supports the design, development, and maintenance of data systems that transform raw data into meaningful insights. Working under the guidance of senior team members, the role contributes to building data pipelines, reports, and dashboards to support informed business decision-making. Key Accountabilities: Support development of data warehouses, ETL processes, and BI solutions. Develop and maintain reports and dashboards. Perform basic data analysis and identify trends. Assist in data validation and quality assurance. ...