801 to 825 of 931 Data Pipeline Jobs in the UK excluding London

ICAP Group is seeking a Data Ops Engineer to design and maintain data pipelines for market surveillance. You will ensure data completeness, quality and timeliness across Tra de and communications data, collaborating with upstream teams and analysts. The role emphasises data ...

sector organisations and academic collaborators at Oxford and UCLA. The goal is a privacy-preserving generative AI ecosystem that protects personal and sensitive data by design, through data residency, anonymisation, secure deployment, and privacy techniques that hold up at both training and inference time. … What you'll do Lead the ML engineering and MLOps direction for assigned CODAS workstreams. Design, build, test, and maintain the ML services, data pipelines, evaluation tooling, and deployment-ready applications that make up the programme's technical deliverables. Translate research outputs into systems that are actually robust ...

Noir Consulting is seeking a talented Data Engineer in Newcastle to build and optimize systems handling complex datasets. You will develop high-quality data pipelines and enhance the central data platform to support investment decision-making. The ideal candidate should have experience ...

build secure production code, review peers, and drive AI-assisted engineering practices to improve quality and delivery speed. The role emphasizes containerized deployments, data pipelines, and collaboration across teams to enforce secure coding standards and automated testing. #J-18808-Ljbffr ...

delivering a wide range of measurement and control system technologies. The team have just completed the design, installation, and commissioning of all the data systems on Test Bed 80 from concept to first engine run and helped complete the first run on the UltraFan (our most instrumented engine … hardware) and associated software Experience in requirements capture/analysis methods, such as Systems Engineering Experience in the development of Azure build and release pipeline Experience of software testing, including automated test of user interfaces In addition, the following role specific skills are preferred: Experience of software vulnerability scanning ...

APIs, orchestration frameworks, RAG and retrieval patterns Making informed decisions between different models, platforms, low-code solutions and custom development Designing integrations, APIs, data pipelines and the underlying data architecture required by AI applications Working extensively across Microsoft technologies including Copilot Studio, Power Platform, Azure … Microsoft 365 Establishing reusable architectural patterns and engineering standards Considering security, governance, performance, resilience, data residency and cost throughout solution design Providing technical direction and mentorship to engineers Supporting client conversations, technical discovery, proposals and pre-sales activity Presenting complex technical concepts credibly to both technical ...

DataCareers is recruiting an SC Cleared Data Engineer to join a leading technology consultancy on a central government programme delivering Defence digital transformation. The role is hybrid, with on-site work in Malvern three days a week. You will work hands-on across AWS, with a planned migration … Google Secure Cloud, building and maintaining data pipelines, performing data transformation and integration, and handling large, complex datasets in a secure government environment. #J-18808-Ljbffr ...

CreateFuture is delivering the migration of an ML estate from Databricks to an AWS SageMaker-based MLOps platform. The Senior Data Engineer (ML) will build and migrate data pipelines feeding model training and inference, ensuring parity with the old Databricks setup. This hands-on role operates ...

CreateFuture is delivering the migration of an ML estate from Databricks to an AWS SageMaker-based MLOps platform. The Senior Data Engineer (ML) will build and migrate data pipelines feeding model training and inference, ensuring parity with the old Databricks setup. This hands-on role operates ...

CreateFuture is delivering the migration of an ML estate from Databricks to an AWS SageMaker-based MLOps platform. The Senior Data Engineer (ML) will build and migrate data pipelines feeding model training and inference, ensuring parity with the old Databricks setup. This hands-on role operates ...

focused organisation with a strong track record of managing sophisticated portfolios. The business fosters a collaborative and forward-thinking culture, where technology and data are central to operational excellence. With a focus on innovation and continuous improvement, they are investing heavily in modern data … creativity, and cross-functional collaboration. The Role Design and deliver a fully automated, end-to-end reporting platform Build intelligent workflows to automate data ingestion, validation, and reconciliation processes Develop scalable systems that replace manual operational tasks with robust, observable solutions Implement exception handling and human ...

colleagues to understand requirements and priorities Share knowledge, contribute ideas and support a collaborative team culture Good understanding of computer science fundamentals, including data structures, algorithms and software design Practical experience with classical machine learning techniques and an awareness of modern approaches such as natural language processing … deep learning Strong Python skills and experience with common libraries such as Pandas, scikit-learn and Jupyter Experience working with SQL and data pipelines to prepare and transform data for model training Understanding of model evaluation, monitoring and improving performance in a production environment Familiarity with ...

become the best and biggest player in the UK market. As a company, we’ve made huge investments in our technology, pricing, data and analytics capabilities over the past few years, along with nurturing our 4Cs culture and substantial investment in our people. And as a Finance team … sure, we would love to hear from you. Overview Our mission is to build the strongest suite of technical and data products in the industry – enabling our pricing, data and analytics teams to move faster, deliver more, and create meaningful commercial impact. What ...

Foodbuy, part of Compass Group UK & Ireland, is seeking a Data & Insight Analyst to lead a small team and own key insight delivery. You will translate complex data into actionable business outcomes, mentor analysts, and collaborate with senior leaders to drive decision making. The role combines … hands-on analytics with leadership, focusing on BI dashboards, data pipelines, and predictive insights to shape commercial strategy. Hybrid work with two onsite days is offered. #J-18808-Ljbffr ...

Electronics, Bedlington , are hiring for a Lead Digitisation Engineer to lead the strategy, architecture, and implementation of automated data pipelines, IoT integration, smart manufacturing systems, and advanced analytics. Working directly to drive yield optimisation, predictive maintenance, and lights-out automation across our cleanroom and assembly lines … infrastructure. Key Responsibilities Include: Designing and owning the Industry 4.0 Strategy & Roadmap. Driving the integration of legacy and modern microelectronics equipment. Architecting robust data pipelines to collect, store, and analyse process data. Collaborating with process engineers to implement advanced process control (APC), statistical process control (SPC), and machine ...

McGregor Recruitment is recruiting a Data Engineer for a major Financial Services client. Location options include Bristol, Leeds, Manchester or Edinburgh, with an initial 3-month duration and potential extension. The role focuses on building scalable data pipelines and knowledge solutions to support an Enterprise Knowledge … Base. You will handle data ingestion, enrichment, indexing and knowledge graphs, transforming enterprise data into searchable, governed formats for AI consumption. #J-18808-Ljbffr ...

deployment, and incident response. Build and maintain RESTful and event-driven APIs, ensuring performance, reliability, and security best practices. Manage and optimise DynamoDB data models and S3-based data pipelines to support scalable and cost-effective storage patterns. Infrastructure as Code & CI/CD Define, deploy … Store. Work in an Agile team environment, participating in sprint planning, stand-ups, retrospectives, and technical design sessions. Collaborate with stakeholders across product, data, and infrastructure to deliver end-to-end platform capabilities. Contribute to internal documentation, runbooks, and architectural decision records (ADRs). Required Skills & Experience Strong ...

Searchability NS&D is seeking a Data Engineer in Manchester to design and operate data pipelines and ETL workflows for national security projects. You will transform diverse data sources into actionable insights while ensuring strict data governance and security compliance. The role … active eDV clearance (West), a willingness to work on-site in Manchester when needed, and collaboration with cross-functional teams to deliver scalable data solutions. #J-18808-Ljbffr ...

Akkodis is launching a new technical delivery team to transform the public sector's data analytics capabilities in the UK. You will join a data-driven program focusing on DOMO dashboards, data pipelines, and AI-enabled insights to support government decision making. The role … emphasizes building scalable analytics platforms, extracting data from diverse sources, and partnering with cross-functional teams to define KPIs and governance standards. #J-18808-Ljbffr ...

ownership of CreatePay's cloud infrastructure: provisioning and hardening AWS environments, building and maintaining CI/CD pipelines, keeping the serverless and data estate — API Gateway, Lambda, Aurora PostgreSQL — reliable, observable, and cost-efficient, and acting as first responder when something breaks. You will work closely with Engineering … Data Engineering, the Information Security Officer, and outsourced delivery partners to make sure the platform is resilient by design, not patched together after the fact. This is a genuine opportunity to define a discipline — to own the infrastructure behind a real, regulated, in-production payments environment ...

technical design through production deployment and ongoing operation with limited supervision Hands-on experience with cloud-native technologies, serverless applications, event-driven architectures, data pipelines, relational and NoSQL databases, vector databases, observability tooling, and automated deployment pipelines Solid understanding of algorithms, data structures, scalability, reliability, performance … related discipline, or equivalent professional experience Responsibilities Designs, builds, and operates the services and AI-powered features behind Moody's intelligent data products as a senior contributor within the Digital Content and Innovation organization. Design, code, test, and operate backend services, application programming interfaces, data pipelines ...

will develop our framework for describing ion transport constraints and, in combination with an electromagnetic model of the ion trap, synthesise voltage waveform data to drive hundreds to thousands of independent DAC channels, with runtime parametrisation to enable closed-loop calibration and mid-circuit feedforward. You will have … opportunity to accelerate the design and analysis of transport waveforms for trapped-ion quantum computers, and to develop the high-performance data pipelines required to control ion traps of this size and complexity, contributing directly to our roadmap for utility-scale quantum computing. Key Responsibilities Include Building ...

Work closely with product and engineering teams, validating releases, triaging issues, and representing customer technical needs with precision. Read and reason about configurations, data structures, integration patterns, and API behaviour well enough to scope work accurately and challenge estimates. Feed structured, prioritised insight back into the product roadmap …/C-level sponsors, with the gravitas to hold difficult conversations and the empathy to keep relationships strong. Technical fluency, comfortable reading configurations, data mappings, logs, and API documentation, and able to converse credibly with engineers and challenge technical assumptions. Clear, structured written and verbal communication, including executive ...

Rates Swap Derivative products and Options products . You will be responsible for developing scalable, performant code that handles large volumes of market data and complex financial calculations. This includes implementing risk metrics, PnL attribution frameworks, and data pipelines that connect trading systems with downstream consumers. … rates products including Swaps, Securities, Options, and Repo Familiarity with risk methodologies and PnL calculation frameworks Experience with distributed systems and real-time data processing Proficiency with relational and NoSQL databases Knowledge of modern development practices including CI/CD pipelines and containerization Exposure to quantitative finance concepts ...

team, you will build and maintain services and pipelines that power our code intelligence platform. You will connect semantic-tree and code-index data to engineering and controls workflows, implementing integrations and automated checks under the guidance of senior engineers. You will take ownership of your components, ensuring … functional teams to shape the platform's evolution. Job Responsibilities: Build and maintain scalable services and pipelines for semantic-tree and code-index data Implement integration points with CI/CD pipelines, PR checks, policy engines, and developer tooling Translate compliance and control requirements into automated checks against ...