476 to 500 of 554 Data Pipeline Jobs in England

week on site Existing SC or DV Clearance is required National Security Sector Tech: JAVA/C++/Python - or Devops/Data Background An exciting opportunity has arisen for a Software Engineer to join a cutting-edge team developing impactful, mission-driven technology. The role offers … chance to contribute to projects such as AI-powered tools for analysts and operators, secure data pipelines, and innovative prototypes that explore new frontiers in software capability. You'll become part of a tight-knit, highly capable engineering group that values independence, precision, and tangible outcomes. This ...

week on site Existing SC or DV Clearance is required National Security Sector Tech: JAVA/C++/Python - or Devops/Data Background An exciting opportunity has arisen for a Software Engineer to join a cutting-edge team developing impactful, mission-driven technology. The role offers … chance to contribute to projects such as AI-powered tools for analysts and operators, secure data pipelines, and innovative prototypes that explore new frontiers in software capability. You'll become part of a tight-knit, highly capable engineering group that values independence, precision, and tangible outcomes. This ...

production‐ready AI‐assisted workflows. Your duties: Acting as a hands‐on technical lead for priority AI initiatives, partnering closely with Product, Development, Data, Security, Knowledge Management and Learning & Development Designing, building and releasing incremental AI‐enabled solutions that are secure, auditable and operationally robust Productising AI capabilities … experience with Microsoft 365 Copilot, Copilot Agents or Microsoft‐aligned automation Strong system integration experience (API‐led integrations, events and/or data pipelines) Hands‐on software development skills in at least one mainstream enterprise language (e.g. C#/.NET, Python) Practical experience delivering AI‐assisted features into ...

production‐ready AI‐assisted workflows. Your duties: Acting as a hands‐on technical lead for priority AI initiatives, partnering closely with Product, Development, Data, Security, Knowledge Management and Learning & Development Designing, building and releasing incremental AI‐enabled solutions that are secure, auditable and operationally robust Productising AI capabilities … experience with Microsoft 365 Copilot, Copilot Agents or Microsoft‐aligned automation Strong system integration experience (API‐led integrations, events and/or data pipelines) Hands‐on software development skills in at least one mainstream enterprise language (e.g. C#/.NET, Python) Practical experience delivering AI‐assisted features into ...

Solution Architect & AI Manager will bridge the gap between complex data architecture and cutting-edge AI implementation. You will be responsible for the strategic delivery of the AIPX framework within the Balance Sheet Management (BSM) domain, ensuring that AI-driven insights are built on a foundation of robust … scalable, and high-performance engineering. Key Responsibilities: Lead cross-functional engineering teams to design, build, and deliver data-intensive platforms and AI-powered solutions aligned to strategic business needs. Oversee end-to-end delivery across the data and AI lifecycle for Balance Sheet Management (BSM)-from ...

Data Engineer 12 months Croydon - x1 day a week x4 remote Inside IR35 - Umbrella only Active SC clearance required Are you passionate about building reliable data pipelines and microservices? Our client, a leading organisation in the IT sector, is hiring for a talented Data ...

, microbiome sequencing, clinical and real-world outcomes. Our goal is to translate biological signals into actionable compound discovery and optimisation, powering a pipeline across: Discovery → Prediction → Design → Validation We are looking for a Senior Computational Biologist with ML Engineering background to help build, bridge, and functionalise … intelligent ingredient complexes o repurposed peptides o newly discovered natural peptides 4) Productionise the AI product launch ● Build end-to-end ML pipeline covering ingestion, training, evaluation and deployment ● Develop APIs/services to serve predictions and ranked candidates into internal tools and client outputs ● Create evaluation harnesses ...

optimised for performance and resilience, and mentoring support staff in network infrastructure best practice. The role combines hands-on support of the product pipeline whilst contributing to the improvement of key systems. Essential Skills: Knowledge of DevOps practices including: CI/CD pipeline design and automation Containerisation … tools Experience in the defence or advanced technology sector Experience with GPU based computer environments Experience with MLOps and associated tooling Experience with data pipelines Experience with Infrastructure as Code Experience with security integration in DevOps i.e. DevSecOps Service-oriented with effective communication skills Ability to prioritize workload ...

ongoing growth strategy we are looking for a Digital Strategy Manager to sit at the intersection of technology, strategy, product, and data, acting as a unifying strategic voice across Product, Technology, Data, and the Business Units. What if you read the description and don't meet … level platform strategy that enables shared capabilities and creates competitive advantage across business units. Work with Group and BU leaders across Product, Technology, Data, B2C and B2B to identify opportunities for platform leverage and reuse. Shape strategic initiatives focused on enhancing learning experiences, including (but not limited ...

activate and scale partnerships. Measure activation rate, moves per partner, integration velocity, and partner NPS. Integration quality. Own the reliability, speed, and data quality of partner data flowing into our platform. When a partner sends us a move, the experience should be seamless. B2B metrics. Partner … measurably increases moves from at least one partner. Build relationships with key partner stakeholders. Understand their pain points, not just ours. Map the integration pipeline and develop a prioritisation framework for new partner types (deposit schemes, mortgage software, conveyancing platforms). Establish your operating rhythm with Engineering ...

+ benefits Are you a Senior Backend Engineer who thrives on designing and scaling complex systems? Do you enjoy working on data-intensive platforms involving real-time pipelines, streaming architectures, and graph-based services? This is a hands-on role within a small, research-driven engineering team working … components from architecture through to production, while contributing to the overall technical direction. Key Responsibilities Design, build, and own backend services and data pipelines in Python Develop and operate streaming systems using Kafka or similar technologies Work with graph-based data structures and algorithms to support ...

sophisticated Retrieval-Augmented Generation (RAG) systems, leveraging advanced techniques like embeddings with Voyage AI, rerankers , and query enrichment . Designing and maintaining efficient data pipelines and vector storage solutions using MongoDB Atlas Vector Search. Fine-tuning LLMs on custom datasets to enhance performance for specialized tasks related … Proven experience building and deploying applications with LLM APIs such as OpenAI , Anthropic , Gemini , and DeepSeek . Hands-on experience with the full RAG pipeline, including vector embeddings , rerankers , and data indexing in databases like MongoDB. Practical knowledge of LLM fine-tuning, prompt engineering, and performance optimization. ...

consultancy building capabilities in decision intelligence, semantic data systems and operational AI. This role leads the capability that transforms data and models into real operational decisions and measurable business outcomes. Combining decision architecture, applied modelling and AI system integration, ensuring analytical work directly drives how organisations … systems. What you will do Client leadership - Lead high-value engagements in decision intelligence and AI-enabled operations, working directly with C-suite, data leaders, and operational heads. Translate complex business problems into decision systems with measurable outcomes across areas such as pricing optimisation, demand forecasting, risk ...

Senior Software Engineer | Sports Data London, UK | Remote Working Up to £80,000 + Company-wide benefits We’re partnered with a high-growth sports media network that operates a portfolio of market-leading brands and partnerships across the sports betting and tech space. Their mission … cutting-edge tools, all powered by modern, cloud-native technology. They are looking for an established Senior Software Engineer to join their expanding data team, where you will be working directly on key services that power a core part of the company's platform. While having essential responsibility ...

maintain momentum across several active research initiatives. You will take ownership of day‐to‐day technical work spanning research platform development, model evaluation, data management, and research operations. The role plays an important part in supporting human studies, community deployments, and evaluation workflows—ensuring that community input … while maintaining good engineering practices. Key Responsibilities: Develop and maintain a research platform supporting human‐in‐the‐loop evaluation, feedback tasks, and synthetic data workflows, including new experimental API and UI features (e.g. using FastAPI and React). Extend model evaluation pipelines, including quantitative metrics, qualitative review workflows ...

brand-new business-critical project. What you'll need to succeed : 5+ years' Java Development experience in financial services. Strong experience working on data heavy projects, with good understanding of data products, data pipelines, and Oracle. Strong experience in distributed programming. Extensive microservices development ...

research platform . This is not just another quant dev role youll be working on the core infrastructure that powers alpha generation , from data ingestion and processing through to model evaluation, reporting, and deployment . The team is focused on solving complex problems around execution quality, market impact … data-driven decision-making , using cutting-edge tools and large-scale datasets. Youll work closely with quants and researchers, influence architecture decisions, and play a key role in shaping how strategies are built and tested across the business. Required Skills: Strong experience with Python (5+ years ...

Cleared Data Engineer - Java, Spring Boot, Docker Hybrid - London (2-3 days onsite) £560 per day (Inside IR35) 12-Month Contract (Initial) We're currently looking for an experienced SC Cleared Data Engineer to join a high-profile programme based in London. Please note: Active Security … Clearance (SC) is essential Must have 5+ years continuous UK residency (required for clearance eligibility) Key Skills & Experience Strong experience as a Data Engineer Proficiency in Java Hands-on experience with Spring Boot Experience working with Docker/Containerisation Experience building and maintaining scalable Data Pipelines ...

threats. As a Senior Backend Engineer , youll play a key role in building scalable, high-performance backend systems that ingest, process, and serve data on millions of assetshelping global security teams uncover exposures before attackers do. What youll be doing: Designing and building backend services and data pipelines powering a cutting-edge cybersecurity platform Architecting scalable microservices and APIs to process massive volumes of security data Working closely with product and frontend teams to integrate backend services into the platform experience Continuously improving systems performance, deployment, and monitoring as the company scales globally ...

hands-on role in a small, high-impact team, focused on building and scaling the systems that directly support trading, decision-making, and data flow across the business. What you’ll be doing: Design and build core trading systems used in day-to-day trading activity Work closely … with traders to develop tools that improve execution, monitoring, and performance Develop real-time systems and data pipelines to capture and process trading activity across multiple venues Contribute to trade capture, reconciliation, and position-keeping systems Build internal tooling and infrastructure supporting data analysis ...

technology to guide architecture, development standards and infrastructure decisions. You will lead a capable in-house engineering team responsible for the platforms, data pipelines and infrastructure that power a high-volume digital environment. Alongside this, you will drive the adoption of AI, machine learning and advanced data … responsibilities - Define and deliver a scalable AI and technology roadmap aligned to business growth - Lead, mentor and grow a high-performing engineering and data team - Oversee platform architecture, infrastructure, security and operational resilience - Drive the development and deployment of AI and machine learning models into live business workflows ...

OAuth, including role-based access control Optimising application performance, improving page load times through code-splitting, caching, and backend tuning Building scalable data pipelines and prompt orchestration layers to improve AI response quality and reduce token usage Collaborating closely with product, design, and data teams …/CD pipelines and cloud infrastructure across AWS and Vercel Tech Stack Frontend: React, Next.js, TypeScript Backend: Node.js, Express APIs: REST, GraphQL Data: PostgreSQL, Redis Cloud/Infra: AWS (Lambda, S3), Vercel, Docker AI: Claude (Anthropic API) Auth: JWT, OAuth What we’re looking for Strong experience building ...

most complex organisations in the world. We’re assembling a small, exceptional engineering team to solve problems at the intersection of AI, data, and scale—turning messy, manual workflows into automated, reliable systems that operate globally, securely, and at speed. If you’ve always wanted your work … core systems that make advanced AI workflows production‐ready: High‐performance backend services and APIs that power complex AI‐driven platforms Large‐scale data pipelines handling sensitive, high‐value datasets Systems that deploy and monitor machine‐learning models in real-world environments Enterprise‐grade infrastructure where reliability, security ...

Design, build, and maintain Python-based trading and research infrastructure Develop bespoke analytics and visualisation tools in close partnership with investment teams Optimise data pipelines, automate complex workflows, and enhance system efficiency 🌟 Why This Role Stands Out 💼 Front-Office Exposure – Work side-by-side with PMs and Quants … clear progression ✅ What You Bring 🎓 Degree in Computer Science, Engineering, Mathematics, or a related field 💻 Strong Python experience in high-performance or data-intensive environments 📊 Understanding of financial markets (equities, fixed income, or derivatives is a plus) 🧠 Excellent problem-solving skills with the ability to communicate across technical ...

Company They are part of a large international media and advertising group operating across multiple markets. Their focus is on combining technology, data and creativity to deliver impactful advertising solutions across physical and digital environments. Technology and AI are becoming increasingly central to how the business operates internally … based AI services and modern LLM frameworks. Turning ambiguous business problems into clear, scalable technical solutions. Building APIs, backend services, automation workflows and data pipelines that support AI capabilities. Deploying, monitoring and iterating on AI solutions in live environments. Setting engineering best practice and mentoring other AI engineers ...