226 to 250 of 296 Data Pipeline Jobs in London

Inside IR35 Duration: 6 months Role Overview As an MLOps Engineer, you will support machine learning products from inception, working across the full data ecosystem. This includes developing application-specific data pipelines, building CI/CD pipelines that automate ML model training and deployment, publishing model … results for downstream consumption, and building APIs to serve model outputs on-demand. The role requires close collaboration with data scientists and other stakeholders to ensure ML models are production-ready, performant, secure, and compliant. Key Responsibilities Design, implement, and maintain scalable ML model deployment pipelines (CI/ ...

resident in the UK and eligible to work without visa sponsorship. What You'll Do: Design, build, and maintain backend services and data pipelines that underpin a large-scale cybersecurity platform. Architect and evolve scalable microservices and APIs capable of handling data from millions of client … assets. Build systems that ingest, process, and serve vulnerability and exposure data in near real time. Collaborate closely with frontend engineers and product teams to ensure seamless integration with user-facing features and reporting. Continuously improve reliability, performance, deployment, and monitoring as the platform scales. What ...

What You’ll Be Doing Research, train, and fine-tune large language models (LLMs) for real-world applications. Develop and optimise pipelines for data collection, preprocessing, and model evaluation. Collaborate with product engineers to deploy models into scalable production systems. Experiment with prompt engineering, RAG architectures, and multimodal … give you time and resources to explore, learn, and publish. What We’re Looking For 0–3 years of experience in Machine Learning, Data Science, or NLP/LLM. Strong Python skills; exposure to PyTorch/TensorFlow/Hugging Face. (Bonus) understand fundamentals of deep learning, LLMs ...

Security Delivery Assurance Lead is responsible for ensuring that digital products and platforms are designed, delivered, and operated in line with cyber security, data protection, and regulatory requirements. The role acts as a bridge between Cyber Security, Engineering, Architecture, and Product teams, providing assurance that security risks … understood and managed across the portfolio. Key Responsibilities Cyber Risk Discovery and Assessment Lead structured cyber risk discovery activities across digital products, including data flows, endpoints, pipelines, and integrations Identify gaps in security controls, data handling practices, and architectural documentation Assess risks related to PII, sensitive ...

high-impact role where you’ll work closely with traders and developers to build cutting-edge, high-performance trading systems - leveraging big data and algorithmic models to analyse and predict market behaviour in real time. They’re looking for switched-on engineers who can tackle complex problems … office environment. Key Responsibilities Design, develop, and support pricing, eTrading, and market-making systems. Collaborate with traders, sales, and quants to deliver performant, data-driven solutions. Enhance trading algorithms, data pipelines, and market connectivity. Integrate trading systems with upstream trade execution and regulatory platforms. Work within ...

time visibility into: Supply-chain and vendor risk Financial stress indicators Cyber exposure and shadow IT Surface, deep and dark-web intelligence Breach data, impersonation activity and industry-specific signals Our platform ingests and enriches large volumes of external intelligence to help security, procurement, CFO and resilience teams … infrastructure, ensuring it's secure, cost-effective and production-ready Work across the stack when needed, comfortable contributing to frontend, APIs and data layers Help define engineering practices, tooling and processes as the team grows Be a key voice in technical decisions and architectural direction Mentor and support ...

processes and testing pipelines to support quick iterative development and system stability. Work on ML model development with our team to build robust data pipelines and deploy ML models. Analyse large corpora of data and build real-time recommendation systems. Work with large amounts of data ...

frontend. We heavily leverage Postgres, Timescale and Redis for storage, and run across AWS, Azure and Terraform for infrastructure. Real-time data pipelines and edge computing are key pillars of the Ferry platform, where we augment Apache Flink and Kafka. Your Day to Day Build and scale … backend systems that power Ferry’s core platform Design and implement performant APIs, data pipelines and integrations Collaborate with frontend, platform and data engineers to deliver end-to-end features Lead projects from design through deployment, embedding engineering best practices along the way Work directly with ...

respond to third-party and supply-chain risks through advanced AI-driven analytics and intelligence . Their mission is to deliver continuous, data-backed visibility into the extended enterprise — enabling organizations to identify vulnerabilities, map their digital ecosystems, and make informed decisions about vendor and partner risk. … Product to lead a world-class technical team , shape the architectural vision , and drive execution across multiple product streams — including large-scale data pipelines and real-time risk intelligence systems . Role Overview: As Head of Product you will be responsible for owning the product roadmap and execution ...

central government space that is looking for an experienced Security Architect to support the design and assurance of secure digital, data, and cloud platforms. The role has a strong focus on modern cloud architecture and emerging AI-enabled services. This is a hands-on architecture role, working closely … with engineering, data, and programme teams to ensure security is embedded by design. Key Responsibilities Lead the design and assurance of secure cloud and hybrid architectures Define and maintain security and cloud architecture patterns, principles, and standards Provide security and cloud input into solution designs, technical reviews ...

Google Cloud, or Azure. Knowledge of containerization and orchestration tools like Docker and Kubernetes is a plus. Experience designing end to end ML data pipelines. Experience with database technologies such as PostgreSQL, MySQL, or MongoDB, Spark, Databricks and stream data processing such as Kafka, RedPanda … stay up-to-date with the state-of-the-art open source infrastructure solutions applicable to designing and improving large scale recommender systems, data engineering, and machine learning You have a Master’s or PhD in Computer Science, statistics, or an engineering field with 5+ years of experience ...

fintech) organisation to recruit a AI Engineer on a contract basis - Hybrid working - London based The AI Engineer will join a cross-functional data team to design, develop, and deploy AI/ML models that tackle real business problems - from prediction and automation to customer personalisation and decision … Role The AI Engineer will build and deploy scalable machine learning models in a cloud-native environment (AWS, GCP or Azure) Collaborate with data engineers, analysts, and product teams to translate business needs into AI-driven solutions Contribute to the development of data pipelines and feature ...

currently working with a London-based Investment Bank who are actively seeking a highly skilled Data Scientist/Developer to join a market-leading team in the Fixed Income space. What you'll need to succeed Extensive Data Science experience within Investment Banking - Mandatory. We will … consider candidates without this experience. Strong Data Engineering and Data analysis experience, with strong knowledge of Pandas, NumPy, and visualisation tools. Strong Python programming experience, with good experience building and maintaining Data Pipelines. Good knowledge of Fixed Income products. Strong experience in statistical analysis ...

quantitative research. This is a hands-on engineering role where you will work on scalable services, real-time risk calculations, and complex data pipelines that support high-volume trading activity. Key Responsibilities Design, build, and optimise Java-based risk platform components used for real-time … Equity Derivatives trading desks, quants, and risk managers to deliver robust, high-quality solutions. Develop low-latency, scalable services for pricing, market data, and risk aggregation. Implement new features to support regulatory changes, new trading strategies, and expanded product coverage. Collaborate on architectural improvements aimed at enhancing system ...

group can fit into their workflows. • Architect and scale document ingestion and processing pipelines to power fast, accurate search, summarisation and data extraction over large volumes of legal documents. • Design and implement intelligent, multi-step agent workflows that can autonomously handle complex legal tasks – from surfacing key testimony … . Frontend experience with modern TypeScript frameworks (Next.js/React) and an eye for building clean, intuitive product experiences. Experience designing and operating data pipelines or distributed systems that handle large volumes of text/documents. Comfort working with LLMs and applied AI – prompting, integrating model APIs ...

that power Locai Labs’ AI models and agentic platforms. You will work on a diverse range of challenges, from model-serving APIs and data pipelines to infrastructure for intelligent agents and automation frameworks. This is a hands-on engineering role for someone who enjoys solving complex technical problems … APIs, or AI-related products Proficiency in Python and JavaScript/TypeScript (Node.js) Strong understanding of backend architectures, REST/GraphQL APIs, and data modelling Experience with containerisation (Docker) and cloud platforms ( GCP , AWS , or similar) Familiarity with LLM or AI APIs Exposure to agentic frameworks (LangChain, LlamaIndex ...

Manchester - Salary up to £120k We’re hiring a Hands-On Engineering Manager with deep technical leadership experience across Python, large-scale data systems, and modern AWS infrastructure. You’ll lead a squad of 4 engineers, guiding them through complex technical decisions and helping them deliver high-performance … data-intensive systems operating over hundreds of millions to billions of rows. The product itself is an AI/ML-driven SaaS platform, and your contributions will train new models, enabling new features and having large greenfield elements to it. This role blends hands-on technical context with ...

applying digital technologies to real-world manufacturing and industrial challenges. The successful candidates will contribute to the development and deployment of simulation-driven, data-connected manufacturing solutions , working alongside experienced engineers on live industrial and R&D projects. The role offers structured development, mentoring, and hands-on project … industrial systems, including models built using NVIDIA Omniverse and related platforms. Apply Python and/or C++ scripting to support simulation workflows, data integration, automation, and tool development. Support the integration of digital models with real or simulated industrial data , gaining experience in connected and cyber ...

hire a Senior Software Engineer for an exciting AI startup. This is a core platform role with real ownership. You will work on data integrations, platform execution, and the systems that power AI-driven analytics. What You Will Be Doing Building core data integrations with common … SaaS platforms Designing data pipelines that ingest provider APIs into our analytics datastore Improving the agent platform and executor with better error handling, observability, and speed Making LLM interactions more efficient through prompts, snippets, and tooling Improving internal developer experience and platform tooling Helping take an early ...

maintain high-performance software used in quantitative research and trading Collaborate with quantitative researchers to productionise models and research tools Build and maintain data pipelines for large-scale market and reference data Develop backtesting, simulation, and analytics frameworks Contribute to trading, execution, and risk management systems … practices in software development, testing, and documentation Required Qualifications Strong programming skills in Python , C++ , or C# Solid foundations in computer science, including data structures and algorithms Experience working with large datasets and time-series data Familiarity with Linux/Unix environments and version control tools ...

pair on, and review the development work of other lead software developers. You’ll work on the entire company's backend code base: data models, algorithms, data pipelines, infrastructure, APIs, complex database queries, ML models. Learn, use, and improve best practices and processes for high-quality ...

resilient systems for high-impact environments. Key Responsibilities AI/ML Security Oversight: Evaluate and secure the entire AI lifecycle, including model governance, data pipelines, and deployment patterns. Threat Modeling: Conduct advanced security assessments and risk analysis across cloud, on-premise, and hybrid environments. Risk Mitigation: Advise clients … emerging AI risks such as prompt injection, model poisoning, data leakage, and adversarial attacks. Architecture Design: Recommend secure architectures for LLM-based systems, automation workflows, and decision-support platforms. Policy & Governance: Develop security standards and guidelines for responsible AI use, aligned with emerging regulatory frameworks. Collaboration: Partner with ...

Timeline Month 1: Onboard to existing ML codebase and infrastructure; identify technical debt and reliability gaps; ship incremental improvements to model serving latency or pipeline robustness. Month 3: Own and deliver a major infrastructure component (e.g., feature store, training orchestration, or model registry); improve system observability with logging, metrics … fundamentals (model training, evaluation, common architectures) Desired Skills (Bonus Points) Experience with MLOps tooling (MLflow, Kubeflow, Weights & Biases, or similar) Building data pipelines (real-time or batch) using tools like Apache Spark, Kafka, Airflow, or dbt Familiarity with recommender systems, transformers, or graph neural networks Exposure to model ...

will facilitate research and development within the healthcare sector! This company's diagnostics visualisation platform allows medical researchers to visualise and analyse clinical data in order to develop new treatments that will massively improve the lives of patients. Key to this is the creation of secure multi-tenant … multi-region storage solution that allows swift and secure access to various types of data. Data security and integrity is of paramount importance, and the solution needs to be compliant with healthcare industry software standards. This role calls for strong AWS skills, rapid application development, and software development ...

could get involved with: Backend development for Python-based web applications. Integration of AI/ML components with backend systems, data pipelines, and compute infrastructure. Delivering high-quality implementations following best practices, including automated testing and documentation. Participating in code reviews and collaborating with technical teams across disciplines. … disease with vaccines, specialty and general medicines. We focus on the science of the immune system and the use of new platform and data technologies, investing in four core therapeutic areas (infectious diseases, HIV, respiratory/immunology and oncology). Our success absolutely depends on our people. While ...