426 to 450 of 556 Data Pipeline Jobs in England

they work, with an open culture that values pragmatism, trust, and delivery over hierarchy. The Role You will sit within the Data Science function, reporting directly to the Head of Data Science and working closely with senior stakeholders across the business. Responsibilities include: Owning … delivery of an automated LAV and NAV calculation platform Automating the ingestion of structured and unstructured data from multiple sources including reports, internal systems, APIs, Excel files, and PDFs Designing and implementing robust data pipelines and workflows Building and maintaining SQL based data models ...

Security (NatSec) domain. This is a hands-on leadership role combining architecture, software engineering, and team leadership, with a focus on Software, AI, data platforms, and cloud-native systems. Key Responsibilities Lead and mentor Agile engineering teams, driving high-quality, rapid delivery (DevSecOps) Own solution architecture, designing … secure and constrained environments. Lead the implementation of the "underpinning tech" for AI, including data pipelines. Act as a trusted advisor to UK Government stakeholders. Define technical roadmaps and support cloud transformation (AWS/Azure) Core Skills Background in UK National Security/Defence/Government. Strong leadership ...

join a growing advanced analytics and AI capability. This is a hands-on engineering role building and deploying ML solutions in highly secure, data-rich environments , where work directly contributes to national-level outcomes. Why this role? This is an opportunity to work on real-world, high-impact … environments Working with large, complex datasets in secure infrastructures Supporting the development of AI-driven capabilities for mission-critical systems Collaborating with engineers, data scientists, and security specialists Contributing to the full ML lifecycle from data prep to deployment What you’ll be doing Develop ...

TERM- Permanent SALARY- £60,000 to £90,000 per annum (plus benefits) My client is a technology-focused organisation developing advanced AI and data-driven solutions across a range of industries. They are looking to expand their technical team by hiring a Machine Learning Engineer to support … their offices in Reading. The Machine Learning Engineer will ideally have the following attributes: Knowledge/experience in Machine Learning, Artificial Intelligence, or Data Science A degree qualification (BSc, MSc, PhD etc.) in Computer Science, Data Science, Mathematics, Statistics, Artificial Intelligence or similar Strong programming skills ...

pricing of Commercial Vehicles, including the following core activities: Be a key stakeholder influencing the direction & outcome of projects Advance the adoption of data science & statistical techniques Develop reporting structures to monitor pricing performance in an automated fashion Develop innovative solutions to improve rating accuracy/efficiency Working … maintain risk models, leveraging both traditional and machine learning techniques. Support delivery of the pricing & underwriting business plan across Motor. Work with the Data Science and Machine Learning teams to define and automate data ingestion, modelling, analysis, model monitoring and reporting. Advance the adoption ...

Principal AI/Data Engineer (Contract): Length: 3 months initally (extension is likely) Start Date: ASAP Location: London, Hybrid (1 day per week) Pay Rate/Determination: £525-575 p/d | Outside IR35 About: Opus is supporting a UK-based digital consultancy partnering with organisations to design … scale high-impact digital and AI-driven products, with a strong people-first culture. The role: A hands-on Principal AI/Data Engineer contract to assess, shape and deliver improvements to a live AI platform across two critical workstreams.You'll be responsible for: Assessing the current ...

role in a constantly evolving environment. We see this as a real opportunity to turbocharge your career. The Role We’re hiring a Data Engineer to help design and build intelligent systems that support live events, fan engagement, and race insights for teams. You’ll be hands … with Google Cloud Platform, data pipelines to supply AI models, and generative AI tools, working closely with technical and operational teams to turn ideas into production-ready solutions. This role requires a regular office presence in London and international travel to races around the world ...

growing technology-focused cyber security organisation is seeking a motivated Software Engineer with strong Python skills to contribute to the development of internal data-driven platforms. This role involves building and improving systems that gather, process, and analyse large datasets to support research and operational decision-making. … Responsibilities Develop and enhance a Python-based Cyber Security platform, ensuring it remains scalable, stable, and capable of handling high data volumes Build and maintain automated cyber event data pipelines to ingest and process information from multiple internal and external sources Refine existing systems and workflows ...

financial services firm operating within the hedge fund and asset management space is seeking an Applied AI/Automation Engineer to join its Data Science function. This role will focus on designing and building an intelligent reporting and automation platform to support fund operations and administration teams. … measurable efficiency gains and scalable automation solutions. The overall objective is to modernise reporting production and reconciliation processes through the application of modern data engineering practices, AI-enabled automation, and agent-based workflows. This is a hands-on engineering role focused on building reliable, production-grade systems within ...

design AI-driven architectures, and also contribute hands-on to development and deployment, particularly in AI MLOps environments. This is not a pure data scientist role or a pure BA role but a design + build + deploy role within Payments transformation programs. Key Responsibilities 1. Payments Domain … models/AI workflows using Python and relevant frameworks Build APIs and integration layers for embedding AI into payments systems Work with data pipelines (real-time + batch) Implement data preprocessing, feature engineering, and model evaluation 4. AI MLOps & Deployment Set up and manage ML lifecycle ...

Please send your CV to: ilana@omnamgroup.com ABOUT THE ROLE Your Impact Architect and implement core systems: cloud infrastructure, backend services, APIs, and data pipelines Build secure, scalable, and reliable components ready for real-world operational environments Lead integrations with external systems and support early data … tooling, documentation, and technical processes from the start Set up observability, monitoring, and performance systems Jump in wherever needed, from quick scripts and data cleaning to debugging production issues What You Bring 5+ years of engineering experience with strong architecture/complex backend systems experience Deep hands ...

Designing, building, and scaling full stack applications Owning system architecture, deployment, and engineering standards Integrating AI features into products using modern APIs and data-driven approaches Improving CI/CD, environments, and overall delivery capability Tech environment - Not set in Stone Frontend: React, Next.js, TypeScript (or similar) Backend … Node.js (Express, NestJS) or Python (FastAPI, Django) (or similar) APIs: REST, GraphQL (or similar) Databases: PostgreSQL, MongoDB (or similar) AI/Data: Experience integrating AI/ML features via APIs (e.g. OpenAI, Anthropic or similar) Exposure to data pipelines, inference workflows, or retrieval-based systems ...

Lead Data Engineer - Databricks - £75-82k + bonus + benefits - Basingstoke 3 days a week The Opportunity: We are looking for a Lead Data Engineer with good Databricks expeirence to join a Basingstoke based organisation who are investing heavily in their Digital Transformation Programme. … lead a small team whilst contributing personally - Be able to drive agile, modern engineering practises - Champion quality, observability and good engineering discipline, ensuring pipeline and models run cleanly and predictably If you would like to learn more, please apply through the advert and we will be in contact ...

zero and own the entire technical build. You'll work across the stack — frontend, backend, infrastructure — while embedding clinical-grade reliability, data privacy, and AI capabilities from the ground up. What you'll own: Build end-to-end product features across the full stack (frontend, backend, infra) Integrate … shipped and scaled full stack products Strong backend (Node.js, Python/Flask, FastAPI) and frontend (React, Next.js, Vue) fundamentals ML/data science proficiency: Python, SQL, pandas, scikit-learn, PyTorch/TensorFlow Experience with cloud platforms (AWS, GCP, Azure) and containerisation (Docker, Kubernetes) Proven ability to build data ...

/ML solutions aligned to organisational strategy and operational objectives. Define scalable, secure, and maintainable AI architectures, covering data pipelines, model lifecycle management, deployment, and monitoring. Establish architectural standards, design patterns, and engineering best practices. Provide technical oversight across the full AI lifecycle: concept, prototyping, production deployment … when performance, compliance, or operational risks arise. Embed ethical AI principles, including fairness, explainability, auditability, and transparency, into solution design. Ensure compliance with data governance, security, and regulatory requirements. Support accreditation and assurance activities within regulated or defence environments. Identify, assess, and mitigate technical risks associated with ...

communicator across technical teams and stakeholders Effective problem-solver who takes initiative in complex production settings Experience with scientific computing, deep learning, big data, or health IT ontologies (e.g., PyTorch, JAX, Spark, HL7, FHIR) (desirable) Familiarity with cloud infrastructure (Azure/AWS), infrastructure as code, Kubernetes, Linux, Docker … data pipelines, and MLOps tools (desirable) Passion for biomedical topics and startup experience (desirable) What’s on offer Competitive salary, bonus scheme, and strong benefits package Pension, enhanced sick pay, private medical insurance, and medical cash pay A high-impact role with visibility and growth potential where performance ...

will be involved in: Design, build, and optimise machine learning models, including NLP, computer vision, and predictive analytics Own the ML lifecycle from data preparation through training, evaluation, and deployment Implement and maintain MLOps workflows for continuous integration and delivery of ML models Collaborate with Data Engineers and DevOps teams to ensure production readiness and scalability Contribute to architecture decisions for ML pipelines and data flows Apply secure coding and configuration practices in line with compliance standards Mentor junior engineers and share best practices across the team Support innovation by researching emerging ...

pipelines, vector search solutions, and agent-based workflows Creating robust evaluation frameworks to measure accuracy, reliability, and performance Building scalable APIs, services, and data pipelines Implementing observability, monitoring, and feedback loops to continuously improve outputs Optimising models and prompts for latency, cost, and quality across different providers What … production systems Solid understanding of cloud environments (AWS, GCP, or Azure) Experience with distributed systems, CI/CD, testing, and deployment pipelines Strong data handling skills (SQL, pandas) and an understanding of evaluation strategies for AI systems Comfortable working in ambiguous environments and iterating on non-deterministic systems ...

Data Engineer | London (Hybrid) | Financial Services | £80,000-£100,000 💸 I’m currently partnering with a well-established UK Financial Services provider that supports hundreds of thousands of customers with accessible credit products and has an excellent reputation in the market. They’re looking for an experienced Data … Role You’ll design, modernise and optimise scalable database solutions, with a focus on: AWS RDS (SQL Server & Aurora PostgreSQL) Building and operating data pipelines (incl. Snowflake integration) Leading SQL Server migrations to AWS Performance tuning, monitoring & optimisation You’ll work closely with cloud, engineering and application teams ...

handling, autoscaling - Ensure graceful handling of failovers, deployments, and edge cases across all services Data Pipelines & Warehouse - Manage the Airbyte replication pipeline from production database to data warehouse - Configure incremental replication for new tables as the product evolves - Maintain the data warehouse (PostgreSQL … autovacuum tuning, memory parameters, capacity planning - Manage RudderStack for event streaming to analytics (Amplitude) and attribution (AppsFlyer) CI/CD & Deployment - Own CircleCI pipeline configuration and reliability - Manage ECS deployment strategies, health checks, and rollout verification - Maintain test environments and cleanup automation WHAT WE'RE LOOKING FOR Must Have ...

systems that transform how the pharmaceutical industry processes critical information. You will help design and build the core platform that ingests global pharma data, applies AI reasoning, and turns raw information into actionable insight and automated workflows for enterprise customers. Working directly with the founders, you will shape … build their own agents. LLM orchestration and prompt engineering, building and optimising AI-driven workflows in production Vector databases and modern AI data pipelines, including embedding strategies and retrieval systems Data ingestion pipelines including APIs, RSS feeds, and web scraping Python development, TypeScript development React frontend ...

heavy modelling and more about building robust, production-grade systems that people rely on every day. Think: decision-support tools, performance analytics, and data pipelines that turn raw information into actionable insight. You’ll get London-level compensation, but with a Madrid lifestyle - and a high degree … autonomy in how you build and ship. What you’ll do Design and build end-to-end applications that support strategy, from data ingestion through to front-end dashboards and visualisation tools. Work directly with PMs and analysts to understand problems, define requirements, and deliver practical solutions that ...

Senior Data Scientist – Applied AI (Commercial Insurance) London/Hybrid £85-95k Our client is a fast-growing AI startup building next-generation decision intelligence tools for the commercial insurance market. Their flagship platform analyses complex claims to identify leakage, litigation risk, fraud indicators, coverage issues … reports, adjuster notes) Building evaluation frameworks to validate AI outputs against real evidence Identifying hallucinations, bias and gaps in reasoning Writing Python for data pipelines, orchestration and evaluation Querying Postgres, working in Azure environments, using GitHub Supporting client pilots and translating feedback into product improvements Using AI coding ...

days Location: London, England Job Summary: We are looking for a hands-on Senior Software Engineer to own and accelerate our product delivery pipeline — from back-end database optimization to client-facing interactive dashboards and reporting platforms. This is a builder role. You will work directly alongside the Head … Data & Customer Analytics to identify bottlenecks, design improvements, and push products from backlog to production. You will be embedded in a small, high-output team where your contributions are immediately visible and impactful. Responsibilities: Optimize and maintain a Treasury Dashboard hosted in client Azure environments (currently Streamlit-based ...

tools that enable dynamic pricing, improve governance, and enhance competitiveness in the annuity market. Key Responsibilities: Design and develop Python-based models and data pipelines to support end-to-end annuity pricing processes Convert complex Excel-based profit testing models into efficient, maintainable Python solutions Build calibration tools … align customer-facing quotation models with internal pricing models Develop data-driven methodologies to optimise pricing competitiveness using large and varied datasets Improve performance and scalability of pricing models for portfolio-level execution Establish best practices for model governance, including version control, testing, and documentation Define and implement ...