376 to 400 of 583 Data Pipeline Jobs in the UK

leadership teams on future platform improvements. What you will do Build and improve backend services running in Azure Develop APIs, integrations, and data pipelines Work across 60 percent greenfield development and 40 percent core system improvement Contribute to architecture and technical discussions Support code reviews, testing, and engineering ...

with fine tuning approaches such as supervised fine tuning, prompt or instruction tuning Strong Python skills and experience with modern LLM tooling and data pipelines Confidence defining and tracking generation quality using both quantitative and qualitative evaluation methods Exposure to speech to text or text to speech tools ...

Splunk (Enterprise and ES), including tuning and optimisation Expertise in detection engineering, including MITRE ATT and risk-based alerting Experience building and maintaining data pipelines, log ingestion and schema standardisation Advanced knowledge of SPL, KQL or EQL Experience with SIEM operations, including scalability, high availability and performance Automation ...

customer-facing platform from the ground up, timelines, task-based views and embedded AI assistance Owning backend automation workflows, AI agent orchestration and data pipelines Building internal tooling to support the team in reviewing and approving AI-generated work Setting engineering patterns and architecture that future hires will ...

etc.) with libraries/frameworks such as PyTorch, TensorFlow etc.) Experience with RAG and LLM-based solutions Solid understanding of AI architectures and data pipelines Knowledge of security, compliance, and governance principles from a development perspective Proven mentoring and team development capabilities Excellent communication and stakeholder management skills ...

models, and integrating them with enterprise databases and cloud platforms. The candidate should be comfortable working across AI solution design, backend development, and data engineering. Key Responsibilities • Design and develop AI and Generative AI applications using Python. • Build backend services and APIs using Flask or Django … integrate GenAI capabilities such as LLM-powered workflows, AI assistants, or automation tools. • Design scalable architectures for AI solutions including model deployment and data pipelines. • Build REST APIs and microservices to integrate AI models with enterprise applications. • Work with cloud platforms (Azure preferred) to deploy and scale ...

senior stakeholders, procurement teams, and decision-making committees. Navigate procurement processes, vendor registration, framework agreements, NDA/commercial approvals, and compliance with regional data protection and information security standards. Collaborate with global solution … teams, delivery, legal, and marketing to design tailored proposals and ensure successful implementation and client satisfaction. Maintain up-to-date client data, pipeline forecasts, and sales activities using CRM. Achieve and exceed revenue, retention, and growth targets. Requirements: 7+ years of account management/business development/ ...

Engineer to join our growing team in Nottingham. You will be responsible for designing, building, and deploying scalable machine learning models that drive data-driven decision-making across the business. This role bridges the gap between data science and software engineering, turning prototypes into production-ready … systems. Key Responsibilities Design, develop, and deploy machine learning models and pipelines in production environments Collaborate with data scientists, software engineers, and stakeholders to translate business requirements into ML solutions Optimize model performance, scalability, and reliability Build and maintain data pipelines and feature engineering workflows Monitor ...

Compensation £40,000 - £70,000 Base + Benefits TL;DR Senior or engineer level full-stack software engineer role Fast growing data and AI startup specialising in the energy sector, based in the UK Hybrid/remote available must be UK based, Glasgow or Edinburgh preferred Must have … someone that has a lot of front-end experience but is comfortable building in the back-end too. Work with our expert data and AI team to build Cairn and help our users deliver more value from their data.This will be a key role in the technical ...

Senior Market Data Engineer Our client is a global quantitative and systematic investment firm operating across all liquid asset classes worldwide. The organisation is highly technology- and data-driven, applying a scientific approach to investing. By combining data, research, technology, and trading expertise … delivering consistent, high-quality returns. The role You will work closely with researchers and quantitative developers to unlock insights from high-frequency market data and help power large-scale research and trading workflows. Key responsibilities include: Partnering with research and quant teams to deliver insights from tick ...

Full Stack Data Scientist - AI & Knowledge Systems About the Role We are seeking an exceptional Full Stack Data Scientist to join our clients innovation team. This role combines traditional data science expertise with software engineering capabilities to build end-to-end AI solutions. … models to address complex business problems Scale AI solutions from proof-of-concept to MVP and full production Collaborate with backend engineers on data pipelines and infrastructure Work within solution architecture frameworks to ensure AI integration Contribute to solution design and technical decision-making Translate business requirements into ...

Responsibilities Multi-Engine Management: Administer a hybrid database environment, ensuring seamless data flow between PostgreSQL (Live Trading) and ClickHouse/Snowflake (Analytics). Data Movement & ETL: Own the reliability of CDC pipelines that stream data from production Postgres instances into the analytical layer. Schema … Evolution: Manage schema changes across different engines, ensuring that transactional data models translate effectively into columnar formats for analytics. Monitoring & Cost Governance: Implement unified observability for the entire stack. Specifically, monitor Snowflake credit usage and ClickHouse resource utilization to ensure peak ROI. Automation: Use Python, Bash and/ ...

Data Engineer (Denodo) - SC Cleared Sanderson Government & Defence Sanderson Government & Defence is supporting a major UK public sector programme and is seeking an experienced Data Engineer with strong Denodo expertise to join a high-performing delivery team. This is a client-facing role within a dynamic … data services environment, requiring excellent communication skills, a proactive mindset, and strong commercial awareness. You will play a key role in delivering data integration solutions across multiple connected systems, supporting large-scale migration and transformation initiatives. Key Responsibilities Work within a client-facing team to deliver ...

domain specialised architecture position focused on Programme Management, PMO systems, Project Controls processes and EPPM technology ecosystems. Working within the Digital and Data Solutions Group under the Programme Controls Technology capability, you will collaborate closely with project management, project controls teams, programme delivery leadership, enterprise architects and technology … partners to define scalable, secure and integrated solutions for: Cost Management Schedule Management Risk, Change and Contingency Performance Reporting Data Governance and Integrated Analytics You will act as a technical authority for project controls platforms, ensuring solutions align with enterprise architecture principles, programme delivery strategy and best practice ...

domain specialised architecture position focused on Programme Management, PMO systems, Project Controls processes and EPPM technology ecosystems. Working within the Digital and Data Solutions Group under the Programme Controls Technology capability, you will collaborate closely with project management, project controls teams, programme delivery leadership, enterprise architects and technology … partners to define scalable, secure and integrated solutions for: Cost Management Schedule Management Risk, Change and Contingency Performance Reporting Data Governance and Integrated Analytics You will act as a technical authority for project controls platforms, ensuring solutions align with enterprise architecture principles, programme delivery strategy and best practice ...

business with millions of active users worldwide. Known for creating immersive experiences and building strong communities, the company continues to invest heavily in data-driven marketing. You’ll be joining a dedicated Analytics, Data Science & Engineering hub that shapes strategy across marketing, customer lifecycle, and product. … across multiple channels. Alongside delivering hands-on analysis, you’ll mentor a small team, partner with senior stakeholders, and ensure best practice in data-driven marketing decisions. Key Responsibilities Lead and mentor a small marketing analytics team, setting best practices and ways of working. Own full-funnel, cross ...

Consulting Engineer London (Hybrid) SC Cleared £50 - 55,000 Overview: Anson McCade are working with a cutting‐edge data analytics consultancy that partners with major public and private sector organisations to solve complex, real‐world problems using advanced data and AI platforms. This is an opportunity … join a high‐impact engineering team operating at the intersection of data engineering, analytics, cloud platforms, and client delivery . You’ll work directly with customers, building and deploying solutions that drive meaningful outcomes. The Role As a Consulting Engineer, you’ll take ownership of solution delivery ...

workflows across the group Experimenting with large language models (LLMs), APIs, and emerging AI platforms to solve real business challenges Developing internal dashboards, data pipelines, and reporting tools to support commercial decision-making Researching and evaluating new AI technologies, tools, and vendors relevant to talent acquisition and professional … services Collaborating with consultants, managers, and clients to understand pain points and translate them into technical solutions Supporting data quality, CRM optimisation, and systems integration projects across the business Contributing to the company’s broader technology strategy and AI roadmap What We’re Looking For: A qualification ...

team. Key Responsibilities Project Ownership Lead the design and delivery of AI/ML initiatives across the full lifecycle Build and deploy models, data pipelines, and production systems Cross-Functional Collaboration Work closely with Engineering, Product, and DevOps teams Support integration of AI capabilities into wider platforms Technical … Optimisation Identify and resolve challenges in AI/ML systems Improve performance, scalability, and reliability Governance & Quality Ensure high standards around model performance, data quality, and compliance Documentation & Knowledge Sharing Maintain clear documentation and contribute to internal best practices Skills & Experience 7+ years’ experience in AI/ ...

join a team modernising our platforms, strengthening cyber and operational resilience, and advancing a product-led way of working that brings engineers, data specialists and business experts together to deliver meaningful outcomes at pace. We're scaling automation and AI from proof-of-concept into real … into production, developing reliable, scalable and responsible AI services that can be embedded into products and platforms. Working closely with product, engineering and data teams, the AI Engineer applies modern machine learning and generative AI techniques to solve real problems, improve decision making and automate complex tasks, while ...

work on cutting-edge AI technologies and contribute to transformative projects across multiple domains. In this role, youll help design and build modern data pipelines that bring together information from a variety of systemsmaking data accessible, trustworthy, and ready for intelligent analytics and AI solutions. … Applyreinforcement learningtechniques includingQ-learning,policy gradients, andRLlib. Collaborate with cross-functional teams to integrate AI solutions into scalable products. Ensure best practices in data engineering and contribute to architectural decisions. Contribute to the mentoring and development of junior team members. Support senior team members in identifying and addressing ...

Title: Data Engineer (Talend & Unix Specialist) Location: Telford (Hybrid - occasional onsite workshops, ~2 days/month in Telford) Rate: Up to £450/day inside IR35 Security Clearance: Active SC Role Overview We are seeking an experienced Data Engineer to design, build, and support robust data integration and ETL solutions within a secure government environment. The role focuses on delivering scalable, performant data pipelines and ensuring high service reliability across critical data platforms. Key Responsibilities Design and implement secure, scalable data integration and ETL solutions using Talend ...

improvement, consolidation, or modernisation. Ensure solutions are scalable, maintainable, and aligned with best practice. Support integrations with other systems, including CRM and data platforms where applicable. Key Requirements Strong commercial experience with Umbraco CMS . Solid background in C# and .NET development. Experience supporting and enhancing both modern … . Exposure to Power BI and Power Apps , particularly where used to support reporting, internal tools, or digital workflows. Experience working with data platforms , such as data warehousing, ETL processes, or data pipelines, and an appreciation for how data underpins digital products ...

placement and account growth Deliver permanent, contract, or SoW recruitment solutions based on client demand Build talent pools across digital, technology, transformation, data, change, and project delivery skill sets Leverage frameworks such as PSR, DOS, CCS and wider procurement channels to identify hiring demand Manage … candidate attraction, qualification, interview process, offer management, and onboarding Build long term strategic relationships with clients and candidates Maintain accurate CRM data, pipeline reporting, and activity metrics using best in class recruitment technology What We’re Looking For: Proven experience in 360 recruitment with strong business development ...

where teams sit together and ideas are encouraged at all levels. The Role As an Applied AI Engineer, you will sit within the Data Science function, partnering closely with operational stakeholders across the business. The focus of the role is to design and deliver … calculation platform, reducing manual effort across complex financial processes. Key responsibilities include: Owning the design and build of a scalable automation platform covering data ingestion, validation and reporting. Automating complex financial calculations including NAV and LAV across multiple data sources and formats. Designing robust data ...