251 to 275 of 294 Data Pipeline Jobs in the UK excluding London

working within a product engineering team building and maintaining the server-side systems that power high-traffic digital commerce experiences - APIs, integrations, data pipelines, and the backend logic that sits behind omnichannel customer journeys. You will be expected to take ownership of meaningful parts of the codebase, contribute … building scalable Node.js backend services and APIs in a cloud-native, microservices environment Integrating with headless commerce platforms, content systems, and third-party data providers via REST and GraphQL APIs Building and maintaining event-driven pipelines that support real-time commerce operations across multiple markets Working closely with ...

machine learning initiatives. * Establish best practices for AI development, deployment, governance, and ongoing optimisation. * Troubleshoot and resolve issues relating to AI applications, data pipelines, and production environments. * Stay up to date with developments in Generative AI and identify opportunities to leverage emerging technologies across the organisation. Profile … qualifications and training. If you wish to apply, please read our Privacy Notice describing how we may process, disclose and store your personal data ...

onsite at least once per week in Swindon (we could consider twice per fortnight etc). Required Skills & Experience Strong experience testing data pipelines/ETL processes Hands-on experience with Apache Spark Experience working with Databricks and/or AWS Glue Proven ability to build automation … testing frameworks (Python preferred) Experience with large-scale data generation and validation Solid understanding of data transformations, joins, and data quality principles Familiarity with cloud platforms (AWS preferred) For this position we are able to wait up to 2 weeks for the right candidate. ...

Your new role As part of the Data Analytics & AI team, you'll help build and evolve a Snowflake-based data platform. You will design and maintain robust data pipelines and models that transform data from operational systems into trusted, analytics-ready ...

working with a leading global organisation that is investing heavily in its digital and data capability across multiple international regions, including the UK, Australia, UAE, and Canada. As part of this transformation, they are expanding their testing function and looking to appoint a Test Engineer to play … role in driving quality across applications and data platforms. This is a hands-on role focused on improving the reliability, stability, and consistency of outputs across both application and data engineering teams. The successful candidate will act as a proactive quality assurance layer, working closely with ...

asset management within energy and utility infrastructure. You will work at the interface of research and industry, translating advanced AI, computer vision, and data-driven methods into scalable solutions deployed within live engineering environments. You will take ownership of the end-to-end system lifecycle, integrating multi-source … data, including BIM, LiDAR, point cloud, and operational datasets, to develop solutions for automated inspection, anomaly detection, predictive maintenance, and intelligent decision support. Crucially, you will ensure that solutions are commercially viable, aligned with client requirements, and deliver measurable operational value. Working closely with design, construction, and operational ...

eligible to obtain it. Your future duties and responsibilities As a Python Developer, you will contribute to the delivery of cloud-based, data-intensive systems. Your responsibilities will include: Designing, developing, and maintaining robust Python applications Building scalable APIs and backend services Working with large datasets and data … e.g. Lambda, EC2, S3, RDS) CI/CD tools such as Jenkins or GitLab CI/CD Infrastructure as Code (e.g. Terraform) Data & Integration: Working with large datasets and data pipelines Tools such as Apache NiFi or similar integration frameworks Scripting & Automation: Bash, Ansible Monitoring & Logging ...

balancing innovation with risk, compliance, and resilience. Define and evolve secure architecture patterns for AI and GenAI systems, covering platforms, APIs, data pipelines, and model environments Embed security into the design of AI solutions by identifying and mitigating risks such as data leakage, prompt injection … Lead Secure by Design (SbD) assessments for AI initiatives, ensuring the right level of review and controls based on risk Collaborate with Cloud, Data, Networks, and Digital teams to ensure secure configuration of AI infrastructure, including MLOps and compute environments Guide programmes and product teams with clear, practical ...

under 10), early-stage startup building sustainable, environmentally-focused financial services. The focus of the solution is understanding where capital flows, and the data behind those decisions needs to be accurate, traceable, and built with care. This is a true end-to-end data focused role. … Youll own data wrangling from ingestion through to delivery, no hand-offs, no downstream dumping. Full responsibility, real impact. The company is profitable and revenue focused, with clients that include the likes of, JP Morgan, Goldman Sachs and some of the biggest Fund & Asset management companies. What youll ...

seeking a Business Analyst to join their FinOps product team, a newly created role sitting at the intersection of finance, operations and data engineering. Responsibilities: Gather and translate international business requirements into clear technical specifications and user stories for the FinOps product team Write and maintain SQL queries … extract, analyse and validate data across financial and operational databases Support data pipelines including bordereaux ingestion, data transformation and downstream reporting Provide hands-on technical product support, triaging issues and investigating data discrepancies Define acceptance criteria, lead UAT and validate delivered functionality ...

within Birketts’ core ecosystem, including Microsoft 365 (Copilot), iManage (Document Management), Aderant Expert (Practice Management), Intapp Intake (new client onboarding) and Microsoft Fabric (data platform). Azure is a likely hosting platform for any future ‘Birketts-approved AI environment’, subject to requirements and build vs buy decisions. … repeatable AI-enabled workflows. This role is delivery-oriented: you will design, build and ship incremental improvements, partnering with colleagues across Development, Data, Security, Knowledge Management and Learning & Development to drive adoption, skills sharing and effective change management. You will also support evidence-based build vs buy decisions ...

design, secure, and optimise Azure environments at scale. You'll play a key role in cloud transformation, migrating Legacy systems, and driving modern data, AI, and automation capabilities. What You'll Be Doing Design and manage Azure infrastructure (compute, storage, networking, Microsoft Fabric) Lead on-prem - Azure migrations … with minimal downtime Own identity & access (Microsoft Entra ID/Azure AD, hybrid environments) Implement API integrations using Azure API Management (APIM) Deliver data & analytics solutions (Microsoft Fabric, Power BI, AI services) Drive security best practice (Defender suite, Zero Trust, Purview) Build automation & IaC (PowerShell, Azure CLI, Terraform ...

performance, and real-world application. What youll be doing Youll design and develop AI agent systems that can interact with tools, APIs, and data sources to complete complex tasks autonomously. Youll work closely with product and engineering teams to translate clinical and operational requirements into scalable AI-driven … agent frameworks (e.g. LangChain, LlamaIndex, AutoGen or similar) Understanding of prompt engineering, RAG pipelines, and tool-using AI systems Experience working with APIs, data pipelines, and cloud platforms (AWS, Azure or GCP) Strong software engineering fundamentals (testing, version control, scalable design) Bonus experience: Background in healthcare, life sciences ...

play a key role in supporting the plant's digital transformation journey. Working closely with Plant IT, Ford Production System teams, Global IT, Data Science and AI teams, you will help develop, deploy and maintain digital tools that improve manufacturing processes across the site. You will support … dashboards. Work with key stakeholders to develop and support a digital transformation roadmap focused on efficiency, waste reduction and process improvement. Partner with Data Science and AI teams to explore how predictive analytics can support production processes. Identify opportunities to improve manufacturing performance through digital tools, automation, data ...

Contract Job alert** Seeking 2x Data Scientist 6 months+ on-going contract - 3 days on site near Heathrow - Inside IR35 Please note that UK-based candidates only - 5 years of UK residency and, ideally, a British citizen is required. 1x Data Scientist (Supply Chain)Must have … inventoryo How to balance cost and service levels (fill rates and cycle service levels)o Developing analytical solutions using the core packages for data science, optimisation and simulation.o Creating data pipelines (even though we will have a data engineer) and to get these into ...

Role: Test Engineer (Apps/SharePoint/Data)Location: London - Hybrid (3 days onsite)Salary: Up to £55,000 Sponsorship is not available for this role An organisation undergoing digital transformation is hiring a Test Engineer to drive quality across Power Platform, SharePoint and Data. This … hands-on role with real ownership, working end-to-end and coordinating across multiple teams. Role overview: Own testing across apps, SharePoint and data platformsDeliver end-to-end testing (front-end, back-end, integrations)Partner with developers and BAs on test planning and executionRun manual and automated testing ...

tackle diseases, including cancer and autoimmune conditions. The business is privately funded, entering a critical growth phase, and investing heavily into its data and cloud capability to support scientific discovery and clinical delivery. With active clinical programmes underway, technology is a core enabler rather than a support function. … faster without breaking things. It's impact plus ownership at the point of scale. You will join a small, highly collaborative IT and data function, working closely with bioinformaticians and scientists to design and build a scalable, secure and reproducible AWS platform. This role sits at the intersection ...

Data Platform Architect Our client now requires a talented Data Architect for long-term well-known client of theirs. They are a growing consultancy that has a vast number of long-term projects with major brands. The role needs a seasoned Data Platform architect … Streaming/Messaging: Hands-on experience with Kafka . Programming Language: Proficiency in Python . Domain: Platform Engineering is highly desired over standard data pipelining. They are building the platform foundation, not data pipelines/lakes. The ideal candidate will be able to execute highly technical ...

work within a large-scale environment, helping to connect systems, partners, and ecommerce platforms through robust, scalable integrations. If you enjoy solving complex data challenges and building reliable integration solutions using Microsoft technologies, this role offers the chance to make a real impact. What You'll Be Doing … Build and enhance integrations that connect systems, platforms, and partners Develop reliable data pipelines to support seamless data flow across the business Work with APIs and modern integration technologies Troubleshoot issues and collaborate with cross-functional teams to deliver scalable solutions What You'll Bring Strong ...

home. What you’ll be doing Building and evolving customer-facing platforms, internal tools, and operational systems Working across APIs, services, frontends, and data pipelines Pairing, reviewing code, and solving problems as a team Shipping fast, learning quickly, and improving continuously What we’re looking … Cloud-native – AWS or Azure in real production environments Polyglot engineer – comfortable picking up and switching languages Full-stack capability – frontend, backend, APIs, data Hands-on builder – scripts, CLIs, background workers, not just web apps Modern architecture – serverless, event-driven systems, or breaking apart monoliths Data ...

proofs of concept, leveraging AI/Gen AI tooling to accelerate delivery ("vibe coding"). Build and integrate AI, Generative AI and Data-driven features into products. Work within an Agile environment, contributing to sprint planning, stand-ups and iterative delivery. Collaborate closely with product, design and data … DynamoDB, etc.). Demonstrable experience in rapid prototyping and AI-assisted/"vibe coding" workflows. Exposure to AI, Generative AI and/or Data projects and tooling. Experience working in Agile delivery environments. Excellent communication skills and proven stakeholder management ability. Ability to work hybrid from Bristol. Desirable ...

systems using Python? Do you thrive on solving complex engineering challenges? About the team: You will join an Agile squad within Elsevier's Data Engineering. The squad builds and operates multiple systems that support many internal-facing systems and customer-facing workflows. Our focus is on building scalable … reliable services and data pipelines that improve productivity for authors, users, and customers About the role: We are looking for a motivated and skilled Software Engineer III to build and maintain software systems in a distributed environment. You will contribute to technical delivery across multiple components, collaborate with ...

London. This is a hands-on platform engineering role, focused on owning the software, tooling, web UI, and infrastructure layer used by data operators, ML engineers, and robotics engineers. You will be responsible for building and improving the internal applications and orchestration tooling that support robot data … collection, dataset workflows, model training infrastructure, and on-robot deployment. The Role You will: * Own and extend internal web applications used for robot data collection, review, QA, and dataset publishing* Build and maintain FastAPI backends, vanilla JavaScript frontends, CLI tooling, and supporting services* Improve recording workflows, state machines ...

doing You’ll play a key role in maintaining and evolving our core engineering platforms, including: Backstage and internal developer portal capabilities Engineering data platforms, including ELT workflows, DBT and SQL-based data pipelines Observability and monitoring Grafana platforms Internal automation and workflow platforms that support … Supporting integration across internal platforms and tooling Improving the developer experience through self-service tooling, templates and golden paths Using engineering insights and data to drive continuous improvement Providing technical guidance and support to engineering teams Driving adoption of modern platform tools and practices Mentoring Platform Engineers ...

Senior Robotics Software Engineer (C++/Data Systems) Location: Cambridge (Hybrid) Salary: £40,000 - £65,000 (Profit Share & Share Options) Job Type: Full-Time, Permanent We're seeking a Robotics Software Engineer to develop the software systems responsible for collecting, processing and analysing data from distributed … robotic platforms. This is an ideal opportunity for a Robotics Software Engineer who enjoys modern C++, data systems and real-world engineering challenges. What You'll Be Doing Developing modern C++ software Building data acquisition systems Creating data pipelines and monitoring tools Working with ...