151 to 175 of 300 Data Pipeline Jobs in London

national security projects. Key responsibilities include: Designing and implementing deep learning models Developing computer vision and pattern recognition systems Building and refining synthetic data pipelines Supporting modelling and simulation environments Deploying models within secure production systems Required Experience Demonstrable experience delivering ML solutions within the defence sector Strong ...

judgement, scattered information and legacy systems. We are rebuilding everything from the ground up with intelligent agents, advanced LLM systems and real time data pipelines. Every line of code you ship will support live customers making high stakes decisions in real time. The team combines deep insurance ...

Data Engineer Ncounter are supporting a specialist technology consultancy delivering advanced data and AI platforms into highly secure Government and Defence environments. We are seeking a DV Cleared Consultant Engineer to join a growing engineering practice working at the sharp end of national security programmes. This … deeply technical, hands on role suited to engineers who enjoy solving complex data integration and workflow challenges within secure, mission critical settings. Core experience required: • Active DV clearance, with willingness to work onsite within secure UK locations • Strong software engineering capability in Python, SQL and TypeScript • Proven delivery ...

required to be eligible for clearance What Youll Do Design Ontologies: Develop and maintain ontologies using OWL/RDF to model enterprise data domains and relationships. Build Knowledge Graphs: Create and manage enterprise knowledge graphs that unify diverse data sources. Semantic Querying: Develop and optimise SPARQL … queries for advanced data retrieval and analytics. Ensure Data Quality: Implement semantic validation rules (e.g., SHACL, OWL constraints) for data integrity and interoperability. Integrate with Enterprise Systems: Embed semantic models into data pipelines, APIs, and enterprise workflows. Collaborate with AI Teams: Enable ...

DATA SCIENTIST (PRODUCT ANALYTICS) UP TO £65,000 HYBRID - 1X A WEEK IN LONDON *Please note, you must be a UK resident to apply and hold full right to work* JOB DESCRIPTION My client is looking for a Product Data Scientist to join a growing Insights … future of a consumer-facing product ecosystem. This position sits at the intersection of technical depth and strategic impact. You'll dive into data, pipelines, and experimentation frameworks while also influencing product direction, user experience, and commercial outcomes. WHAT YOU'LL DO Product Analytics Ownership ...

Back End Developer/Software Engineer (TypeScript Node AWS) Remote UK to £90k Are you a data savvy Software Engineer with strong backend development experience using TypeScript and Node? You could be progressing your career in a senior, hands-on Back End Developer role at a scaling Fintech … build a seamless digital experience that makes complex energy systems simple, powerful and intuitive. You'll be building resilient, modular backend services, data models, data flows between Postgres, Redshift, analytics layers and APIs that underpin complex trading, billing and analytics platforms. There's a collaborative team ...

investing heavily in next-generation BI technology, with Microsoft Fabric at the centre of its modern analytics strategy. This is a business where data truly influences decision-making, and where you'll play a major role shaping how BI is delivered across multiple regions. If you want … work with a mature BI function, contribute to enterprise data strategy, and build scalable solutions on a modern cloud stack this is an environment where your expertise will be recognised and valued. You'll have the chance to influence standards, mentor others, and work with large-scale, complex ...

engineering or applied research Experience training, fine-tuning, or deploying LLMs in production Strong Python and familiarity with modern ML tooling (PyTorch, data pipelines, evaluation frameworks) Track record of turning research work into production systems Compensation & Benefits £200K - £300K base Health coverage Flexible vacation Daily meals and office ...

delivery of performance management, quality assurance systems, and conduct research and analysis to enhance local strategies and plans. The role involves leading data quality initiatives, producing performance reports, performance scorecards and collaborating with various stakeholders to improve service outcomes. They will also be required to build data pipelines using available tools including Power Automate, to meet reporting needs and to develop Power BI dashboards that provide enable data driven decision making and provide actionable insights. This role is a temporary contract initially for 3 months with the possibility to extend. This role ...

standard financial services background screening. Atrium Global is supporting a client of ours within the banking sector who are delivering a large-scale data platform modernisation programme. This is a hands-on QA engineering role within a small team and is not a test lead or management position … Overview We are seeking an experienced QA Test Engineer to support testing and quality assurance across a strategic data platform transformation programme within a major financial services environment. The role will focus on validating the quality of data pipelines, APIs, matching and merge logic, deterministic ...

Lead Azure Databricks Engineer - Consulting (Lloyd's of London) Base Salary: £78,000-£95,000 Location: Hybrid - London Sector: Data Engineering/Cloud/Insurance Type: Permanent We are searching for an accomplished Lead Azure Databricks Engineer to join our consulting practice and take technical ownership of complex … cloud data engineering projects across the Lloyd's of London insurance market. This position is ideal for someone who is deeply hands-on, highly delivery-driven, and experienced in navigating the regulatory, operational and data challenges unique to the London Market. Working as part ...

client, a prominent entity in the Defence & Security sector, is seeking a meticulous Data Scientist with a strong understanding of Linux, Data Science, and AWS to join their team. This is a contract position located in London for a duration of 12 months, requiring a UKIC … clearance to undertake sensitive and impactful work. Key Responsibilities: Develop and deploy data science solutions to support national security missions. Build and optimise data pipelines for processing large, complex datasets. Apply machine learning and statistical techniques to extract actionable insights. Create clear visualisations to communicate findings ...

technology to trade a broad range of energy, metals, and agricultural commodities globally. Our success is driven by cutting-edge analytics, high-frequency data processing, and a commitment to innovation. We are now looking for a Senior Python Engineer to join our dynamic team in London and drive … Python Engineer, you will be at the heart of our technology platform, building robust systems that enhance our trading strategies, risk management, and data analysis. You will collaborate closely with quants, data scientists, and traders, providing Python-based solutions that directly impact the profitability ...

CVPR, or physics-specific AI journals). Systems Thinking: Experience with scalable training infrastructure, including distributed training across GPU clusters and data pipeline automation. Highly Desirable: Physics-ML Expertise: Experience with Physics-Informed Neural Networks (PINNs), Operator Learning (DeepONet/FNO), or Equivariant Neural Networks. Domain Knowledge ...

natural language processing tasks (entity recognition, tokenization etc) Strong knowledge of API/Microservices , Async programming, multithreading, performance, reliability, caching, event driven design, data pipelines, workflows, queues Hands-on with Amazon SageMaker for building, training, and deploying scalable machine learning models in cloud. Experience of Building rapid applications ...

/ML engineering or research ✅ Experience post-training and deploying LLMs in production ✅ Strong Python and modern ML tooling (training, evaluation, data pipelines) ✅ Track record shipping research from prototype to reliable production impact ✅ Ability to break down ambiguous research into clear milestones What makes this special ...

maintain end-to-end product features used by enterprise customers. Develop modern, responsive interfaces using React/Next.js . Design and optimize APIs, data pipelines, and integrations using Python (FastAPI/Django) . Collaborate with design, product, and AI teams to deliver new functionality quickly and reliably. Contribute ...

reduce admin, improve compliance, and spend more time on meaningful human work. What You’ll Do: Build and scale core backend systems, APIs, data pipelines, and integrations Collaborate with CTO, product, and design teams to deliver tools used by real frontline workers Write maintainable, tested, and secure code ...

fully-automated pipelines for dictionary building; including span identification, word sense distribution, and sense granularity decision Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries and train models … determine the difficulty of words, idioms, phrasal verbs etc. Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners ...

models, and integrating them with enterprise databases and cloud platforms. The candidate should be comfortable working across AI solution design, backend development, and data engineering. Key Responsibilities • Design and develop AI and Generative AI applications using Python. • Build backend services and APIs using Flask or Django … integrate GenAI capabilities such as LLM-powered workflows, AI assistants, or automation tools. • Design scalable architectures for AI solutions including model deployment and data pipelines. • Build REST APIs and microservices to integrate AI models with enterprise applications. • Work with cloud platforms (Azure preferred) to deploy and scale ...

Title: Data Science Engineer Client Location: Reading - hybrid Starting: ASAP Pay Comments: PAYE Maximum Pay (per hour): £56.00 Hours: 35-hour week Duration: until 30/10/2026 Job Description: The Data Science team is seeking a dedicated Data Science Engineer. This role … work with exceptionally skilled professionals and influence our sales strategy directly. You will be instrumental in driving business growth by successfully implementing data-driven models that identify and size potential opportunities. You will work with senior stakeholders and team members to explore various data sources, engineer ...

business, with the chance to make a visible impact from day one. ROLES AND RESPONSIBILITIES: The Credit Risk Analyst will: * Build and maintain data pipelines, data lakes, dashboards, and reports to support credit risk monitoring and performance analysis. * Collect, clean, and process customer data as new lending products launch, ensuring high data quality and consistency. * Identify trends, patterns, and insights across credit performance and customer behaviour to support strategy and decision making. * Present findings to stakeholders across Credit, Product, and wider business teams. * Contribute to a wide range of credit ...

support cutting-edge research in biotechnology and life sciences. You will play a key role in designing and developing platforms that enable scientists, data engineers, and bioinformaticians to analyze complex biological data, accelerate drug discovery, and improve clinical research workflows. This role combines strong backend engineering … cloud infrastructure and data engineering, with an interest in working alongside scientists and research teams. Key Responsibilities Design and develop scalable backend systems and APIs for scientific and clinical data platforms Build and maintain data pipelines for large biological and research datasets Collaborate with ...

real-world ML systems used at scale? We’re looking for a curious and motivated Junior Machine Learning Engineer to join a collaborative, data-driven technology team, working in a flexible hybrid setup based in London. This role is ideal for someone early in their career … learn from experienced engineers in a fast-moving environment. You’ll be part of a modern engineering function working on large-scale data and ML products, contributing to model development, data pipelines, and deployment workflows that power business-critical platforms. 🔍 In this role, you’ll: 🤖 Build ...

forecasting algorithm and time-series models are already built. What we need now is someone to make them run reliably—ingesting messy client data, maintaining our GCP/BigQuery infrastructure, and shipping outputs consistently as we scale from pilot to production. This role owns that. … Data/ML Engineer with strong software engineering instincts. You write clean Python, you're comfortable wrangling dataframes, and you know how to build pipelines that don't break at 2am. Required 🐍 1–3 years of commercial experience in data engineering, ML engineering, or a similar ...