476 to 500 of 648 Data Pipeline Jobs in the UK

site role, and candidates for this role are required to hold an active DV security clearance. Hexegic are looking for technically minded data and software engineers to work on an intriguing and exciting project, building and maintaining data pipelines and platforms for our customers … with similar languages API awareness for data retrieval and integration into processing pipelines Experience of stakeholder management and requirements capture Understanding of pipeline scheduling and health checks What’s in it for you? Base salary of £50,000-£70,000 £5000 a year professional development budget Wellness ...

develop, test and maintain all code for client applications. Responsibilities will include : Gather and translate business requirements into technical solutions for market data and analytics applications Design, develop, test and maintain kdb+ applications and supporting services Support full project delivery lifecycle, including debugging, optimisation and production support Perform … data analysis and build reporting/analytics outputs for stakeholders Mentor junior developers and contribute to code quality, standards and team delivery Technical Skills needed : Hands-on experience with kdb+ and strong proficiency in q for time-series data processing Experience building real-time and historical ...

Role In this role, you will define the architectural blueprint and technology foundations for AI driven solutions that transform how customers in dynamic, data intensive industries operate, scale, and innovate. You will design robust, future ready AI architectures that enable automation, advanced analytics, and intelligent decision making across … complex digital transformation programmes. With access to cutting edge AI frameworks, high performance computing environments, and modern data platforms, you will guide engineering and data science teams in building secure, scalable, and ethical AI systems. This role empowers you to shape end to end AI ecosystems ...

NATO. Key skills Dynamics 365 Finance & Operations (F&O) - customisation, configuration, and support X and C# development for extensions and integrations Data Entities and Data Management Framework (DMF) Power Platform - Power Automate, Power Apps, Dataverse Integration design - RESTful APIs, virtual tables, external systems Finance and procurement … build integrations between F&O and external systems Develop automated workflows and approval processes to support compliance and efficiency Manage and optimise data entities and data pipelines for reporting and synchronisation Extend system functionality using X and C# following best practices Support full life cycle implementations ...

scalability, and security best practices Collaborate cross-functionally with Product, Design, and Frontend teams Contribute to architectural decisions and mentor other engineers Develop data-driven backend services and pipelines Support production systems and deployments within a small, high-performing team Qualifications 5+ years of professional software engineering experience … Experience with LLM APIs (e.g., OpenAI, Anthropic, Gemini) and LangChain Background in AI/ML (e.g., generative models, GANs, diffusion, regression) Experience building data pipelines and data-driven systems Familiarity with workflow orchestration tools (e.g., Temporal, Prefect) Why Join Be part of a fast-growing company ...

Role We are partnering with a global tech and media giant to hire a Senior Data Engineer. You will build and scale the massive data pipelines that track how millions of users interact with the platform across smart TVs, gaming consoles, and major social media apps. … What You'll Do Architect, build, and maintain complex, high-volume data pipelines. Act as a technical leader to set engineering standards and best practices. Partner with Product Managers and Data Scientists to turn business requests into reliable data models. Mentor junior engineers ...

they work, with an open culture that values pragmatism, trust, and delivery over hierarchy. The Role You will sit within the Data Science function, reporting directly to the Head of Data Science and working closely with senior stakeholders across the business. Responsibilities include: Owning … delivery of an automated LAV and NAV calculation platform Automating the ingestion of structured and unstructured data from multiple sources including reports, internal systems, APIs, Excel files, and PDFs Designing and implementing robust data pipelines and workflows Building and maintaining SQL based data models ...

Security (NatSec) domain. This is a hands-on leadership role combining architecture, software engineering, and team leadership, with a focus on Software, AI, data platforms, and cloud-native systems. Key Responsibilities Lead and mentor Agile engineering teams, driving high-quality, rapid delivery (DevSecOps) Own solution architecture, designing … secure and constrained environments. Lead the implementation of the "underpinning tech" for AI, including data pipelines. Act as a trusted advisor to UK Government stakeholders. Define technical roadmaps and support cloud transformation (AWS/Azure) Core Skills Background in UK National Security/Defence/Government. Strong leadership ...

join a growing advanced analytics and AI capability. This is a hands-on engineering role building and deploying ML solutions in highly secure, data-rich environments , where work directly contributes to national-level outcomes. Why this role? This is an opportunity to work on real-world, high-impact … environments Working with large, complex datasets in secure infrastructures Supporting the development of AI-driven capabilities for mission-critical systems Collaborating with engineers, data scientists, and security specialists Contributing to the full ML lifecycle from data prep to deployment What you'll be doing Develop ...

pricing of Commercial Vehicles, including the following core activities: Be a key stakeholder influencing the direction & outcome of projects Advance the adoption of data science & statistical techniques Develop reporting structures to monitor pricing performance in an automated fashion Develop innovative solutions to improve rating accuracy/efficiency Working … maintain risk models, leveraging both traditional and machine learning techniques. Support delivery of the pricing & underwriting business plan across Motor. Work with the Data Science and Machine Learning teams to define and automate data ingestion, modelling, analysis, model monitoring and reporting. Advance the adoption ...

Principal AI/Data Engineer (Contract): Length: 3 months initally (extension is likely) Start Date: ASAP Location: London, Hybrid (1 day per week) Pay Rate/Determination: £525-575 p/d | Outside IR35 About: Opus is supporting a UK-based digital consultancy partnering with organisations to design … scale high-impact digital and AI-driven products, with a strong people-first culture. The role: A hands-on Principal AI/Data Engineer contract to assess, shape and deliver improvements to a live AI platform across two critical workstreams.You'll be responsible for: Assessing the current ...

quality, security, testing, and deployment. Lead key technical initiatives, contributing code and architecture reviews. Drive integration of software with hardware systems, sensors, and data pipelines. Management & Team Leadership Build, lead, and mentor a multidisciplinary engineering team. Establish effective workflows for development, QA, deployment, and iteration. Foster a collaborative … Docker, Cloudformation, Pulumi, CI/CD with GitHub Actions ML/AI: PyTorch, TensorFlow, scikit‐learn, MLflow for experiment tracking, Zenml for ML pipelines Data: PostgreSQL, DynamoDB, data pipelines with Zenml (We’re open to evolving the stack and expect you to influence technical decisions ...

DevOps Engineer (Data/BioTech)Oxford (1 day per month in office).£60-80k + Benefits. This role cannot offer Visa Sponsorship. Your new company I am exclusively recruiting an AWS DevOps Engineer for a fast-growing, clinical-stage life sciences organisation developing a first … technology to tackle diseases, including cancer and autoimmune conditions.The business is privately funded, entering a critical growth phase, and investing heavily into its data and cloud capability to support scientific discovery and clinical delivery. With active clinical programmes underway, technology is a core enabler rather than a support ...

optimisation of transaction monitoring systems. The successful candidate will play a key role in delivering strategic change across financial crime systems, supporting data analysis, system enhancements, and regulatory-driven initiatives. You will work closely with Compliance, Operations, and Technology teams to ensure systems are robust, scalable, and aligned … with evolving regulatory expectations. Key Responsibilities Support delivery of Financial Crime transaction monitoring transformation initiatives Perform advanced data analysis across payment, client, and screening data sets Support audit requests, regulatory reviews, and remediation activities Assist with system upgrades, regression testing, and new technology evaluations (RFPs/ ...

Augmented Generation (RAG) AI agents and orchestration workflows Designing and maintaining backend services and APIs (primarily Python, FastAPI/Flask) Building and scaling data pipelines and search systems using: ElasticSearch, Weaviate, Pinecone, and other vector databases Engineering secure, containerised architectures using Docker and Kubernetes Ensuring high availability, fault … Experience in defence, government, healthcare, or other regulated domains Familiarity with DevOps practices, CI/CD pipelines, and infrastructure as code Exposure to data engineering, ETL pipelines, or high-volume data processing Experience working in SME or start-up environments , comfortable wearing multiple hats Salary ...

across architecture, infrastructure, integrations, and backend systems. ABOUT THE ROLE Your Impact Architect and implement core systems: cloud infrastructure, backend services, APIs, and data pipelines Build secure, scalable, and reliable components ready for real-world operational environments Lead integrations with external systems and support early data … tooling, documentation, and technical processes from the start Set up observability, monitoring, and performance systems Jump in wherever needed, from quick scripts and data cleaning to debugging production issues What You Bring 5+ years of engineering experience with strong architecture/complex backend systems experience Deep hands ...

Designing, building, and scaling full stack applications Owning system architecture, deployment, and engineering standards Integrating AI features into products using modern APIs and data-driven approaches Improving CI/CD, environments, and overall delivery capability Tech environment - Not set in Stone Frontend: React, Next.js, TypeScript (or similar) Backend … Node.js (Express, NestJS) or Python (FastAPI, Django) (or similar) APIs: REST, GraphQL (or similar) Databases: PostgreSQL, MongoDB (or similar) AI/Data: Experience integrating AI/ML features via APIs (e.g. OpenAI, Anthropic or similar) Exposure to data pipelines, inference workflows, or retrieval-based systems ...

Title: Data Scientist (Generative AI & LLMs) Location: London(Hybrid role) Employment Type: 12 months contract Role Overview We are seeking a versatile Data Scientist to lead the end-to-end development of AI solutions, with a heavy focus on Generative AI and Large Language Models (LLMs … . You will bridge the gap between business requirements and technical execution, overseeing the entire lifecycle from initial scoping and data engineering to model deployment and prompt optimization. Key Responsibilities Business Alignment: Partner with stakeholders to define project scope, translate business problems into technical specs, and establish clear ...

what they build and P&L. Around 30 hires into Technology are planned for 2026, with a particular focus on discretionary trading tech, data, and early AI‐driven tooling. The Role – High‐Ownership Trading Tech You will be a senior, hands‐on engineer embedded with discretionary trading teams … risk, P&L and pricing tools that directly support trade sizing and execution. Build and evolve scalable market and reference data pipelines, integrating vendor feeds and internal systems. Work directly with Portfolio Managers, quants and Risk to shape requirements, prioritise projects and iterate quickly on desk tools. Example ...

communicator across technical teams and stakeholders Effective problem-solver who takes initiative in complex production settings Experience with scientific computing, deep learning, big data, or health IT ontologies (e.g., PyTorch, JAX, Spark, HL7, FHIR) (desirable) Familiarity with cloud infrastructure (Azure/AWS), infrastructure as code, Kubernetes, Linux, Docker … data pipelines, and MLOps tools (desirable) Passion for biomedical topics and startup experience (desirable) What’s on offer Competitive salary, bonus scheme, and strong benefits package Pension, enhanced sick pay, private medical insurance, and medical cash pay A high-impact role with visibility and growth potential where performance ...

FTSE100 retailer, building cutting-edge, enterprise-grade algorithmic platforms for global institutions. Our mission is to harness the power of AI to transform data into actionable insights, driving smarter decisions in capital markets, asset management, and fintech innovation. As we expand our core engineering team, we are seeking … concurrency, and performance tuning. Key Responsibilities Lead the design and development of backend services using Python and the Django Rest Framework (DRF) Optimize data processing and I/O-heavy operations, with advanced understanding of Global Interpreter Lock (GIL) and Threading Implement clean, type-safe code using Python ...

pipelines, vector search solutions, and agent-based workflows Creating robust evaluation frameworks to measure accuracy, reliability, and performance Building scalable APIs, services, and data pipelines Implementing observability, monitoring, and feedback loops to continuously improve outputs Optimising models and prompts for latency, cost, and quality across different providers What … production systems Solid understanding of cloud environments (AWS, GCP, or Azure) Experience with distributed systems, CI/CD, testing, and deployment pipelines Strong data handling skills (SQL, pandas) and an understanding of evaluation strategies for AI systems Comfortable working in ambiguous environments and iterating on non-deterministic systems ...

week in our Waterloo office Experience level: At least five years in commercial software engineering 🚀 About Orchestra Orchestra is an AI-native data pipelining platform building the future of data orchestration and observability . We have built a declarative framework allowing data engineers … explicitly declare how their data pipelines behave. Think CI/CD but for data teams! Backed by VCs from San Francisco, New York and London with angels from across the data space and beyond. 👷 Engineering at Orchestra We care deeply about our users—their ...

Overview You’re passionate about modern data science, staying abreast of the latest news and implementing recent discoveries into your day to day work. You’re an innovator; can we do this better? How can we do things differently? Could we solve this quicker? Your mind is always … occupied by these questions, what can be improved with data science. A company scaling on the back of success, expanding across Europe, needs you. They want your thirst for knowledge, the desire to be better and the confidence to try something new, get it wrong and try again. ...

alongside industry‐recognised qualifications. Role To maintain consistent and documented compliance with all relevant Safety, Health and Environmental (SHE), Good Manufacturing Practice (GMP), Data Integrity (DI), quality and best practice requirements To plan and prioritise tasks, review and evaluate progress against objectives and investigate alternative scenarios To identify … customers and use creative thinking and problem solving to challenge assumptions, innovate, make new proposals and build on existing ideas To analyse scientific data from various sources to improve understanding of the underlying processes To assist other technical staff in the acquisition, visualisation and analysis of scientific data ...