201 to 225 of 557 Data Pipeline Jobs in London

Position Overview This is a newly created engineering leadership role at a pivotal moment for Proximie. We're scaling rapidly, our data capabilities are central to our product and commercial strategy, and we need an experienced leader to own this space end to end. You'll unite … Engineering Own the architecture, quality, and scalability of Proximie's data platform. Lead the team building and maintaining ETL/ELT pipelines, data warehousing, and analytics infrastructure. Set engineering standards, tooling decisions, and technical direction across the data stack (Python ...

Design, train, and optimise machine learning models focused on user personalisation, encompassing recommendation engines, ranking algorithms, user segmentation, and content analysis. Data Pipeline Engineering: Construct and maintain robust and scalable data pipelines for feature engineering and model training utilising both structured and unstructured large-scale … serving to monitoring and maintenance. Proficiency in Python and knowledge of ML libraries/frameworks (e.g., TensorFlow, PyTorch). Experience with high-volume data processing and real-time streaming architectures. Strong understanding of recommendation system design and personalisation algorithms. Familiarity with Generative AI and its applications in production ...

looking for a deeply technical Enterprise Architect who will own the delivery of AI projects end to end from the silicon and data center design that underpins AI workloads, through the software and MLOps stack, to the governance frameworks that make AI trustworthy and defensible at scale. This … Infrastructure-as-code: Terraform and Ansible for repeatable, automated provisioning of GPU clusters and AI platform environments; GitOps (ArgoCD) for continuous, declarative platform delivery. Pipeline orchestration: Kubeflow Pipelines, Apache Airflow, or Argo Workflows to orchestrate multi-stage training, fine-tuning, and inference pipelines. Cluster & workload scheduling: Slurm ...

doesn't quite ring true, and asking the two or three questions that surface a problem while it is still cheap to fix. Data‐driven course correction. Use data to flag delivery risks early, facilitate tough scope and resourcing conversations with Product and Tech Leads … bureaucracy. Build deep, cross‐functional relationships to align disparate teams through influence rather than authority. Financial and operational governance. Own the data pipeline for engineering workloads: repeatable project tracking and a practical approach to categorising engineering spend that supports financial planning, capacity decisions, and future team sizing ...

tools such as dashboards and portfolio management utilities). The engineer will play a key role in modernizing the platform architectures while improving data pipelines, system reliability, and development standards. You will work in a fast-paced environment requiring strong expertise in data engineering, application development … GitHub Copilot, Claude, ChatGPT, AWS Bedrock) for coding, tests, documentation, and prototyping; set review standards for AI‐generated code. Design, build, and maintain data engineering workflows and platform services supporting the Vision platform and model delivery ecosystem Develop and extend platform components responsible for data ingestion ...

that end, we take responsibility for the entire life cycle of the machine learning models that power our language AI products. This includes data, training, quality assurance, and operational aspects. In our highly collaborative teams, each person has the scope to drive impact across the company. Your responsibilities … research direction, prototype rapidly, run large-scale experiments, and drive breakthroughs all the way into production. Your central focus is how we blend data and shape model behaviour after pre‐training. You will fuse high-value human expert data with synthetic data ...

Associate Director you will lead data-centric and technology-enabled engagements across the financial crime spectrum. You’ll partner with payments firms, banks, and other regulated financial firms to assess financial crime risk, design advanced analytic models, implement and independently test detection and monitoring systems, and advise … support vendor selection and integration processes. Collaborate with client data engineering teams to advise on data pipelines, schema design, and pipeline infrastructure needed for analytic and monitoring use cases. Translate complex technical concepts into clear, executive‐level recommendations and actionable roadmaps. Business Development and Lead ...

myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. BMI is currently seeking a Data Scientist based out of our London, Manchester offices BMI's systematic, independent, and data-driven market insights, analysis and forecasts enable customers … validated. We build and maintain robust models that our customers use to identify and manage country risks. Joining as a Data Scientist t o support risk research and analysis, you will help shape the strategic decisions of the world’s leading organizations. Candidates will have the opportunity ...

Data Engineer £500 - £550 per day inside IR35 6-month contract Hybrid working in London We're working with a global healthcare and AI research organisation at the forefront of applying data engineering and machine learning to accelerate scientific discovery. Their work supports large-scale, domain … specific datasets that power research into life-changing treatments. They're now looking for a GCP Data Engineer to join a multidisciplinary team responsible for building and operating robust, cloud-native data infrastructure that supports ML workloads, particularly PyTorch-based pipelines. The Role You'll focus ...

take deep ownership of one or more critical architecture domains - such as agentic application design, AI security and trust, AI operations and observability, data and knowledge engineering, or model platforms and inference - serving as the lead authority in your domain across client engagements. You will develop and maintain … core agent services, including a first-class abstracted memory service with semantic, episodic, and procedural endpoints. Architect the end-to-end data pipeline for AI systems, including data ingestion, preprocessing, and synchronization for fine-tuning and RAG. Design and implement the context layer-spanning knowledge ...

heart of a global financial institution? Then bring your domain knowledge in Credit Risk, Market Risk, Liquidity or Capital, and your skills in data analytics, problem solving and communication to Citi’s Product Development team within our Enterprise Data Office group. By Joining Citi, you will … economic progress. Team/Role Overview This solution design and execution focused product development role will enable implementation of target state processes and data & technology capabilities, through engagement with 1st line teams, Technology, and individual business product teams. Based in London, this role will position the right candidate ...

Senior Machine Learning Engineer. As our Senior Machine Learning Engineer you’ll join the Growth AI programme within Corporate & Institutional Banking (CIB) Data & Analytics. Growth AI is a key pillar of the Insights and Analytics space within CIB Data & Analytics. Our focus is to develop … Implement observability for AI services (logging/metrics/tracing), model performance monitoring, and quality/drift checks with actionable alerting Partner with data scientists, data engineers, platform teams, and governance/risk stakeholders to ensure end-to-end delivery meets control, auditability, and documentation expectations ...

Finance to ship improvements that unlock volume, reduce friction, and increase margin. WHAT YOU’LL BE DOING You will deliver high-impact, scalable data solutions such as building and maintaining robust models and data products that directly support the team's efficiency, effectiveness and risk appetite. … familiar with FX products, treasury or liquidity management domains. You are proficient with SQL and know your way around data pipeline management tools such as Snowflake, dbt, Git, Airflow, Python, and Lightdash. You're comfortable owning analytics from data transformation through to delivering actionable insights. ...

Public facing, household name, critical national infrastructure organisation are seeking an experienced Data Engineer with a strong background in modern data engineering practices and technologies. Note - this is a part-time contract role requiring 2 days a week for a period of 6 months … week in fantastic Central London location). It is a great opportunity to work on challenging, large-scale data projects and deliver real business value. Key Responsibilities & Requirements: Design, build, and maintain robust data pipelines using modern data engineering best practices Hands-on development ...

Architect with strong domain expertise in Human Resources and Legal technology, combined with a deep understanding of AI-enabled solutions, enterprise integrations, and data-driven platforms. This role will define and deliver end-to-end architecture for HR and Legal solutions, ensuring scalability, integration, and alignment with enterprise … data strategies. KEY RESPONSIBILITIES Define end-to-end architecture for HR and Legal platforms with a focus on SAP SuccessFactors and employee experience solutions Design AI-enabled HR and Legal solutions (e.g., copilots, automation, personalization, analytics-driven insights) Lead integration architecture across HR, Legal, enterprise systems ...

direction, design solutions, and lead the optimisation of decisioning frameworks and automation solutions for major clients. You bring deep expertise in NBA logic, data science, and decisioning architecture - and the consulting capability to turn complex challenges into working solutions. You look at a decisioning problem, ask what outcome … need, what data we have, and what model will work best design it and coordinate delivery with our offshore and client teams. You spot issues before they become problems, raise them, and solve them. Proactively, not reactively. When something is unclear, you create clarity. When something is broken ...

orientation, veteran status, or any basis prohibited by the laws that govern its operations. How does this role contribute to our collective success? Data and analytics are of critical importance for AXIS. Simply put, we want to turn data into information, that can be used … pairing, structured code reviews, and knowledge‐sharing sessions on emerging techniques and tools. Resource & Capacity Planning: Support the Head of in tracking the project pipeline, estimating costs (including cloud compute and API consumption), and managing resource allocation to ensure the team is effectively deployed against priorities. Technology Vision: Stay ...

services). Innovate Streaming: Develop streaming data ingestion and transformation solutions aligned with our digital-first streaming strategy. Automate Everything: Eliminate manual pipeline stages through advanced orchestration and test-driven development. Optimize & Protect: Ensure rock-solid security, data governance, and platform cost efficiency without sacrificing … pipeline speed. Upskill & Collaborate: Champion modern engineering practices, collaborate with cross-functional business stakeholders, and mentor junior team members. What You’ll Need to Succeed: Modern Data Stack: Strong hands-on experience designing ETL/ELT solutions with Snowflake or similar modern cloud data warehouses. ...

Will Work With Building and deploying AI and Machine Learning solutions Designing and implementing end-to-end AI and ML pipelines, from data acquisition and feature engineering through to deployment and optimisation Developing scalable ML pipelines and engineering frameworks AI model training, evaluation, optimisation and deployment Cloud-native … data platforms across Azure, AWS and GCP MLOps tools and best practices for deployment, monitoring and governance Structured and unstructured datasets Generative AI and advanced analytics solutions Designing and maintaining scalable data pipelines, datasets and workflows Collaborating directly with client stakeholders to understand business challenges ...

Lead Azure Data Engineering Architect – Insurance Domain (Lloyds Marketplace) London Onsite - Hybrid Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets. … Vendor to Watch’ by Gartner. Please visit Fractal | Intelligence for Imagination for more information about Fractal Responsibilities: Design and implement scalable data migration strategies and ETL/ELT data pipelines. Strong Insurance domain experience, preferably within the Lloyd’s marketplace Good understanding of tools and platforms ...

LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication to excellence in delivering the services our customers expect from us. With extensive experience, deep knowledge and worldwide presence across financial markets … Finance, Technology, and enterprise objectives.* Serve as the senior technology authority for all EPM capabilities—planning, consolidation, allocations, close automation, reporting, and data integration.* Partner with senior Finance stakeholders (CFO, Controllers, FP&A, Data Office) to shape future-state performance management processes.**Engineering & Platform Ownership*** Lead ...

vector database implementation, with practical experience using technologies such as OpenSearch, FAISS or similar to support scalable, production‐ready retrieval workflows. Data pipeline engineering, building and operating AI‐ready pipelines using AWS Glue, S3 and related services to support model training, inference and evaluation. Advanced observability ...

security frameworks. Deep understanding of cryptography, hashing algorithms, digital signatures, and encryption techniques. Knowledge of integration with enterprise systems, APIs, cloud services, and data pipelines. Hands‐on experience with DevOps, containerization, CI/CD pipelines, and cloud platforms (AWS, Azure, GCP) for blockchain deployment. Strong experience in solution ...

Snowflake. Responsibilities Use cloud‐native technologies and services to build scalable, reliable, and secure applications. Build, support, and integrate web applications, microservices, and data pipelines with high code quality. Write automated unit, integration, and deployment tests. Use CI/CD tooling (e.g., GitLab Runners) to build and deploy ...

myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Role Description As a Senior Data Engineer, you will play a key role in building and maintaining production‐ready data and machine‐learning systems that support critical business decisions. … work across the full lifecycle, from engaging with stakeholders and shaping data/model outputs, to deploying and maintaining real‐time services in a cloud environment. A significant part of this role involves developing and evolving our cloud‐based infrastructure, including containerised applications, automated deployment pipelines, and infrastructure ...