151 to 175 of 187 Data Pipeline Jobs in the UK excluding London

Data Engineer Pay of up to £75,664, 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. DWP. Digital with Purpose. Are you an experienced Senior Data Engineer with strong skills in Azure and data pipelines and experience leading technical … teams? Join DWP's Data Engineering community and help build the data platforms and services that support millions of click apply for full job details ...

Data Engineer Pay of up to £75,664, 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. DWP. Digital with Purpose. Are you an experienced Senior Data Engineer with strong skills in Azure and data pipelines and experience leading technical … teams? Join DWP's Data Engineering community and help build the data platforms and services that support millions of click apply for full job details ...

Data Engineer Pay of up to £75,664, 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. DWP. Digital with Purpose. Are you an experienced Senior Data Engineer with strong skills in Azure and data pipelines and experience leading technical … teams? Join DWP's Data Engineering community and help build the data platforms and services that support millions of click apply for full job details ...

business units. Experience with vector databases, prompt engineering, fine-tuning, understanding of when to apply different AI approaches to business problems. Knowledge of data engineering, analytics, and visualisation tools to support end-to-end solution delivery including data pipelines and user interfaces. Experience with React/… organizations technology communities to foster a culture of technical excellence and growth. Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions. Implementation of effective unit testing practices to ensure proper code design, readability, and reliability. Assistant Vice President Expectations To advise ...

Senior Data Engineer - Azure/SQL/Python Hampshire - Hybrid We are looking for an experienced Senior Data Engineer to join a growing data and analytics function, taking technical ownership of complex data pipelines and platform components from initial design through ...

Operations Analyst who is passionate about our mission of Money Without Borders. You will partner with our Payment Operations organisation to help drive data-driven decisions that would evaluate the current risks the organisation faces, interpret risk appetite and monitor and control for these risks. The Payment Operations … thresholds that support the organisations risk appetite and build control assurance models around our risky payment processing flows. You will also own the data behind the reconciliation of bank balances and customer funds to ensure that there are no material financial discrepancies. You will own the relationship with ...

compliant and aligned to Responsible AI principles. Shape technical direction, standards and best practice for AI engineering across the Group. Work with architecture, data, technology and business teams to identify and prioritise AI opportunities. Define the right build, buy and partner approach for AI solutions and services. Provide … Generative AI solutions in production environments. Work with modern AI frameworks, LLMs, RAG, prompt engineering and vector databases. Ensure robust MLOps practices, APIs, data pipelines and modern software engineering disciplines are in place. Strategic & Stakeholder Engagement Act as a thought leader, willing to challenge the business and drive ...

Data Engineer Trading Platform Remote Up to £200k Plexus is working with a client in the DeFi trading space. They are a permission less, on-chain trading protocol allowing anyone to trade stocks, commodities, currencies and crypto through a fully transparent, auditable stack. They have raised $30M+ from … strong group of institutional and strategic backers. They are looking for a Data Engineer to own their monitoring, parameter systems and data infrastructure as the protocol scales. Role: Architecture and maintaining ingestion and transformation pipelines for on-chain events and market data. Implementing parameter models ...

Description: Data Engineer - SC Cleared 6 Months Hybrid working - 2 days on site in Telford Up to £475 inside IR35 We are seeking an experienced Data Engineer with strong live support capabilities and deep expertise in data platform observability to join our engineering team. … this role, you will be pivotal in maintaining and enhancing the reliability of critical data infrastructure. A major focus of this position will be evolving our operational monitoring ecosystemtransitioning service-level views into unified dashboards and implementing robust alerting for legacy environments. Key Responsibilities Live Support and Platform ...

global technology business operating at significant scale, processing billions of transactions and interactions each year. The business is continuing to invest heavily in Data Science, Machine Learning, and automation, with a particular focus on building intelligent products that improve operational efficiency and customer outcomes. Their teams combine strong … solutions used worldwide. The Role Build and deploy production machine learning models that support large-scale automation and decision-making Design and optimise data pipelines, backend services, and ML infrastructure Develop and maintain feature stores and model-serving capabilities for real-time and batch use cases Take ownership ...

Azure Data Engineer - 1/2 days onsite 18 month FTC Summary: Join a team building a modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse … Logic Apps. You'll work across the full data lifecycle - from ingestion to transformation and delivery - enabling smarter, faster click apply for full job details ...

Working alongside specialist engineering, research and technical teams, you will design and develop data solutions that support analysis, testing and informed decision-making, which will be critical to secure, national securtiy infrastructures. This role offers the opportunity to work with large and complex datasets, develop scalable data pipelines and contribute to projects supporting critical technologies and infrastructure. Key Responsibilities Design, develop and maintain end-to-end data pipelines to support the processing and analysis of complex datasets. Transform and manage data to produce meaningful insights that support technical investigations and decision ...

daily operations. This is a hands on role with variety and ownership. Python development will be central to your work, alongside APIs, data pipelines, systems integration and automation. You will also contribute to an internal web platform and help identify useful applications for AI. The role Working closely … with technical colleagues and business stakeholders, you will: Develop and maintain Python applications, APIs and integrations using technologies including FastAPI. Improve data pipelines, scheduled workflows and SQL models to support reliable reporting and business operations. Connect internal platforms with ERP systems, reducing manual processes and improving data ...

Duration: 6 months contract Total cost to Capgemini: £570 MUST BE PAYE THROUGH UMBRELLA We are seeking experienced engineers who have experience of Data, API and Batch support and working within a Devops environment to join an existing team which is expanding. Design and implement robust, secure … performant data integration solutions (batch and/or near-real-time). Build, operate and improve data pipelines (ingestion, transformation, curation) with monitoring, alerting and SLAs. Collaborate with product teams and client stakeholders to refine requirements and align decisions to NFRs (cost, performance, security). Support ...

hiring an AI Engineer to design and build the embedded software, data pipelines and machine learning systems behind our sensing and communications technology. You will take ideas from a clean sheet through to efficient, tested code running in live deployments. Because of the nature of our work … subsystems. Implement and optimize communication protocols. Build automated CI/CD pipelines for machine learning, manage model versioning, and monitor live models for data drift and performance degradation. Develop generative AI and large language model (LLM) systems, including retrieval augmented generation (RAG) and fine-tuning. Build scalable ...

infrastructure across cloud and on-premise environments. Develop scalable architectures for AI workloads, including model hosting, vector databases, orchestration layers, APIs, and data pipelines. Integrate AI platforms with business-critical systems, data platforms, collaboration tools, and operational applications. Produce and maintain architecture documentation, operational procedures … optimise AI solution performance, reliability, security, and cost efficiency. Governance & Compliance Ensure AI solutions align with security, governance, and compliance requirements. Support data governance, privacy, risk management, and lifecycle policies for AI-enabled systems. Maintain standards and documentation relating to AI usage, access control, and governance frameworks. Contribute ...

Title: Data Analysis Specialist Location: Chertsey, UK (Onsite) Contract Type: 12-Month Contract (with potential extension) About the Role: We are seeking a detail-oriented Data Analysis Specialist to support data analytics initiatives, run reporting workflows, and deliver actionable insights to senior management. … will work closely with the core analytics team to gather requirements, build data pipelines, and analyze datasets from key enterprise systems. Key Responsibilities: Support analytics task-streams and ensure successful delivery of reporting initiatives. Gather requirements and assist in designing data pipelines for extraction, transformation ...

building, and operating production-grade ML systems from the ground up. Responsibilities include: Building and owning end-to-end machine learning solutions, from data ingestion through to deployment and monitoring Developing scalable data pipelines that process large volumes of real-time and batch data … environments Working with Databricks, AWS, Python, Kafka, and modern MLOps tooling Leveraging machine learning, LLMs, and multimodal AI techniques across structured and unstructured data sources Collaborating with engineering, product, and business stakeholders to deliver impactful solutions Contributing to system architecture, platform design, and technical best practices Driving measurable ...

areas, depending on your skills and interests. Each track offers a different way to build your career in technology: Data Engineer: In this role, you’ll work with data to help organisations make better decisions. You’ll learn how to organise, analyse, and present data in ways that are easy to understand. You may: Build data pipelines and work with cloud platforms Create dashboards and reports Support data analysis and real-time insights Software Engineer: On this track, you’ll help design, develop, test and build software such ...

into European markets, there's plenty to get involved in. You'll work closely with engineers and traders, building reliable backend services and data pipelines that support forecasting, trading and day to day business operations. You don't need previous energy or trading experience: curiosity, sound engineering judgement … willingness to take ownership matter most. The role Sitting between backend software engineering and data engineering, this position gives you the chance to understand how your work connects to the wider business, including cash management and financial workflows. You'll: Build and maintain data ingestion services ...

product whilst tackling key pain points our customers experience in dealing with our servicing teams. WHAT YOULL BE DOING Derive actionable insights from data to drive the team's strategy and inform product decisions. Establish clear goals, define measurable KPIs, and develop compelling narratives to help your team … understand their progress. Ensure accurate, impactful, fast decision making with high quality analysis, helping us to iterate faster. Build automated data pipelines and dashboards to minimise repetitive tasks and allow data self-serve. Identify & evaluate high impact opportunities, find ways to support & accelerate or identify ...

Description: Develop and maintain scalable data pipelines and infrastructure to support data-intensive applications. Collaborate with data scientists and analysts to ensure data availability and reliability. £475.00/day Talent International UK and it's subsidiaries, Digital Gurus, Infinite Talent and Rethink ...

Description: Develop and maintain scalable data pipelines and infrastructure to support data-intensive applications. Collaborate with data scientists and analysts to ensure data availability and reliability. £475.00/day Talent International UK and it's subsidiaries, Digital Gurus, Infinite Talent and Rethink ...

Engineer, you'll work across the full solution lifecycle, helping to design, build and deploy AI-powered applications whilst ensuring the underlying integrations, data and processes are robust and scalable. You'll be involved in: Building AI-enabled solutions such as conversational assistants, workflow automation and intelligent document … Generation (RAG) and agent-based approaches Taking solutions from prototype through to deployment, monitoring and continuous improvement Building and maintaining APIs, integrations and data pipelines that support AI applications Working closely with business stakeholders to understand operational challenges and translate them into practical technical solutions Supporting user testing ...

combine structured study from Sheffield Hallam University with practical consulting experience, working alongside Capgemini Invent colleagues to help our clients address real business, data, AI and technology challenges. Role As a Digital & Technology Solutions Degree Apprentice, you’ll work as part of a team delivering and improving digital … help organisations run more effectively. When you join, you’ll start on one of the below pathways, depending on your skills and interests: Data Analyst In this pathway, you’ll learn how to use data to help organisations understand performance and make informed decisions. ...