1,026 to 1,050 of 1,208 Data Pipeline Jobs in the UK excluding London

experienced Java Developer to join their growing technology team on a permanent basis. This role offers the opportunity to work on cutting-edge enterprise systems that power critical data-driven processes across the business. You’ll play a key role in developing and maintaining high-performance applications using Java 17, Spring Batch, Spring Integration, and GridGain Database, while … contributing to complex data workflow and integration projects. Key Responsibilities Design, develop, and maintain scalable Java 17 applications supporting enterprise data operations. Build, optimise, and manage batch processing solutions using Spring Batch. Design and implement integration flows with Spring Integration. Develop efficient SQL queries, stored procedures, and scripts to support data pipelines. Work with … GridGain Database to deliver distributed, high-performance data solutions. Support the transition and optimisation of data workflows from MongoDB to GridGain. Automate deployment and operational processes within Unix/Linux environments. Collaborate closely with cross-functional teams to deliver robust, secure, and scalable solutions. Skills & Experience Required Strong proficiency in Java 17 and familiarity with the More ❯

Senior Data Engineer – Azure - Birmingham/Flexible 1 day a week in the Birmingham office expected, the rest from home Up to 62k per annum plus excellent benefits and flexibility Senior Data Engineer with Azure experience required for an a organisation that is progressing through an exciting period of growth & transformation, where you will play a … key role in developing and maintaining data systems within the organisation, empowering users to create quality data to serve growing business needs. Within the role you will lead in the design and development of robust data pipelines across batch (and streaming environments). Ideally you will have experience working with Azure, SQL and data modelling techniques. If you’re interested in finding out more, please apply and your application will be reviewed by Ian Tittley at Investigo! Senior Data Engineer – Azure - Birmingham/Flexible More ❯

SR2 are seeking a Technical Business Analyst to support the discovery, definition, and migration planning for a cloud adoption roadmap, with a particular focus on modern data platform capabilities. The role centres on capturing business-aligned cloud requirements, shaping Databricks-led data platform needs, and supporting a phased migration strategy across critical services and data workloads. Key Responsibilities Requirements Discovery Lead workshops with Architecture, Data, Engineering, Product, and Cyber to capture Cloud + Databricks needs. Define security, compliance, downtime tolerance, RPO/RTO, SLAs, and cost requirements. Capture data platform requirements across ingestion, transformation, governance, and analytics (Databricks, Delta Lake, Unity Catalog, Workflows). Map service and data … Core Cloud capability catalogue. Produce a clear, endorsed baseline of Core Cloud + Databricks requirements. Migration Strategy Support Support creation of a risk-based migration plan for services, data pipelines, and analytics workloads. Assess current landscape, identify gaps for Databricks enablement, and outline sequencing options. Prepare core artefacts (requirements packs, dependency maps, current vs target state, migration considerations More ❯

Automation Specialists x 3 + 6 month initial contract + £470 to £483 per day - Inside IR35 + Hybrid working form Telford Key Sklills: + Test automation for data and analytics platforms + SC Clearable Key Responsibilities: Working as part of an Agile team participate in ceremonies and contribute to sprint planning, retrospectives, demos and reporting. Utilise strong … implement automation test strategies and plans for SAS Viya 4 applications, for UI based Visual Analytics (VA) and Intelligent Decisioning (ID), as well as for integration testing of data pipelines. Develop and maintain test scripts using appropriate automation frameworks (e.g., Selenium, PyTest, JUnit) and integrate them into CI/CD pipelines. Confirm the test data strategy … CI/CD pipelines (e.g., Jenkins, GitLab CI). Troubleshoot and resolve issues in test environments, including SAS Viya containerized deployments (e.g., OpenShift, Kubernetes). Contribute to test data management and environment provisioning strategies Ensure that appropriate defect management is undertaken Ensure results and progress are clearly articulated to relevant stakeholders. Essential Skills & Experience: Proven experience in: Working More ❯

Automation Specialists x 3 + 6 month initial contract + 470 to 483 per day - Inside IR35 + Hybrid working form Telford Key Sklills: + Test automation for data and analytics platforms + SC Clearable Key Responsibilities: Working as part of an Agile team participate in ceremonies and contribute to sprint planning, retrospectives, demos and reporting. Utilise strong … implement automation test strategies and plans for SAS Viya 4 applications, for UI based Visual Analytics (VA) and Intelligent Decisioning (ID), as well as for integration testing of data pipelines. Develop and maintain test scripts using appropriate automation frameworks (e.g., Selenium, PyTest, JUnit) and integrate them into CI/CD pipelines. Confirm the test data strategy … CI/CD pipelines (e.g., Jenkins, GitLab CI). Troubleshoot and resolve issues in test environments, including SAS Viya containerized deployments (e.g., OpenShift, Kubernetes). Contribute to test data management and environment provisioning strategies Ensure that appropriate defect management is undertaken Ensure results and progress are clearly articulated to relevant stakeholders. Essential Skills & Experience: Proven experience in: Working More ❯

can review and challenge technical designs for privacy compliance, embed non-functional requirements (NFRs) into agile workflows, and support teams in adopting privacy-preserving engineering practices such as data minimization and consent management. The successful candidate will collaborate closely with Product, Solution Management, and Architecture teams, act as the subject matter expert for privacy incidents, and ensure that … privacy risks and ensuring NFRs are included; validate delivery outputs. Act as on-point privacy Incident SME for delivery and platform. Coach teams in privacy-preserving technical patterns (data minimization, anonymization, consent management). Eligibility Requirements Technical Skills Technical engineering background – data pipelines, APIs, SDKs, client/server tracking, consent tooling. Regulatory awareness – enough legal literacy … and partnership skills Strong business acumen with a focus on delivering solutions that drive business value. Preferred Qualifications Bachelor's or Master's degree in Computer Science, Engineering, Data Science, Business Analytics or a related field. Proficiency in applying problem-solving frameworks (such as root cause analysis, Six Sigma, or Design Thinking) to address complex business challenges. Certifications More ❯

growth in a world-class technology environment Key Responsibilities Define and implement AI/ML security strategies, policies, and architectures. Design secure AI/ML models, systems, and data pipelines. Conduct AI risk assessments and develop mitigation strategies. Ensure data security, privacy, and compliance with GDPR, ISO 27001, and the EU AI Act. Lead AI/ More ❯

do This is a senior, strategic consulting role — driving AI/ML security architecture, influencing C-suite direction, and ensuring security-by-design across complex AI systems and data pipelines. You’ll define and deliver AI security strategies, develop reference architectures, and provide expert guidance on risk management, data protection, and ethical AI governance. You’ll … advisory. Deep understanding of AI/ML security architecture, adversarial ML mitigation, and model governance. Current security certifications such as CISSP or CISM. Proven experience across cloud security, data privacy, and DevSecOps. Familiarity with frameworks including NIST, ISO 27001, TOGAF, SABSA. Excellent communication and stakeholder influence skills. Eligible for UK Security Clearance (SC). If you’re an More ❯

do This is a senior, strategic consulting role — driving AI/ML security architecture, influencing C-suite direction, and ensuring security-by-design across complex AI systems and data pipelines. You’ll define and deliver AI security strategies, develop reference architectures, and provide expert guidance on risk management, data protection, and ethical AI governance. You’ll … advisory. Deep understanding of AI/ML security architecture, adversarial ML mitigation, and model governance. Current security certifications such as CISSP or CISM. Proven experience across cloud security, data privacy, and DevSecOps. Familiarity with frameworks including NIST, ISO 27001, TOGAF, SABSA. Excellent communication and stakeholder influence skills. Eligible for UK Security Clearance (SC). If you’re an More ❯

do This is a senior, strategic consulting role — driving AI/ML security architecture, influencing C-suite direction, and ensuring security-by-design across complex AI systems and data pipelines. You’ll define and deliver AI security strategies, develop reference architectures, and provide expert guidance on risk management, data protection, and ethical AI governance. You’ll … advisory. Deep understanding of AI/ML security architecture, adversarial ML mitigation, and model governance. Current security certifications such as CISSP or CISM. Proven experience across cloud security, data privacy, and DevSecOps. Familiarity with frameworks including NIST, ISO 27001, TOGAF, SABSA. Excellent communication and stakeholder influence skills. Eligible for UK Security Clearance (SC). If you’re an More ❯

Engineering Manager to lead and inspire a team of talented software engineers. In this pivotal role, you will be responsible for guiding the development and delivery of robust data pipelines and critical system integrations. You will play a key part in shaping our technical strategy, ensuring the high quality and efficient delivery of software solutions, particularly within a … audiences. The Person: Proven experience in an Engineering Manager or a senior technical leadership role, leading software development teams. Strong expertise in ETL (Extract, Transform, Load) processes and data integration patterns. Demonstrable experience with designing, building, and maintaining robust integrations between disparate systems. Solid understanding of the software development lifecycle (SDLC) and delivery methodologies (Agile, Scrum). Deep … technical proficiency in C#.NET development, including relevant frameworks and technologies. Experience with relational databases (e.g., SQL Server, PostgreSQL) and data warehousing concepts. Excellent communication, interpersonal, and leadership skills. Ability to inspire, motivate, and develop engineering talent. Desired Skills: A strong background in software testing, including experience with various testing methodologies (unit, integration, system, performance) and automation frameworks. Experience More ❯

them into technical requirements Research emerging AI technologies to propose the most effective solutions Design scalable, practical AI architectures to solve complex client problems Collaborate with engineers and data specialists to turn concepts into reality Produce technical documentation and present solutions to both technical and non-technical stakeholders Keep pace with new developments across AI, ML, and automation … Required Skills and Experience Strong understanding of AI and machine learning technologies, including LLMs, NLP, and data pipelines Proven experience in solution design, technical consulting, or pre-sales Ability to communicate complex concepts clearly to varied audiences Familiarity with cloud AI environments such as Azure AI, AWS Sagemaker, or GCP Vertex A natural problem solver with curiosity for … cutting-edge tools and frameworks Desirable Experience Experience delivering AI or ML solutions in a commercial or consultancy setting Knowledge of data engineering, MLOps, or automation workflows Previous experience engaging directly with clients and senior stakeholders Why Join This is an opportunity to join a fast-scaling AI business at a defining stage of its growth. You’ll More ❯

them into technical requirements Research emerging AI technologies to propose the most effective solutions Design scalable, practical AI architectures to solve complex client problems Collaborate with engineers and data specialists to turn concepts into reality Produce technical documentation and present solutions to both technical and non-technical stakeholders Keep pace with new developments across AI, ML, and automation … Required Skills and Experience Strong understanding of AI and machine learning technologies, including LLMs, NLP, and data pipelines Proven experience in solution design, technical consulting, or pre-sales Ability to communicate complex concepts clearly to varied audiences Familiarity with cloud AI environments such as Azure AI, AWS Sagemaker, or GCP Vertex A natural problem solver with curiosity for … cutting-edge tools and frameworks Desirable Experience Experience delivering AI or ML solutions in a commercial or consultancy setting Knowledge of data engineering, MLOps, or automation workflows Previous experience engaging directly with clients and senior stakeholders Why Join This is an opportunity to join a fast-scaling AI business at a defining stage of its growth. You’ll More ❯

them into technical requirements Research emerging AI technologies to propose the most effective solutions Design scalable, practical AI architectures to solve complex client problems Collaborate with engineers and data specialists to turn concepts into reality Produce technical documentation and present solutions to both technical and non-technical stakeholders Keep pace with new developments across AI, ML, and automation … Required Skills and Experience Strong understanding of AI and machine learning technologies, including LLMs, NLP, and data pipelines Proven experience in solution design, technical consulting, or pre-sales Ability to communicate complex concepts clearly to varied audiences Familiarity with cloud AI environments such as Azure AI, AWS Sagemaker, or GCP Vertex A natural problem solver with curiosity for … cutting-edge tools and frameworks Desirable Experience Experience delivering AI or ML solutions in a commercial or consultancy setting Knowledge of data engineering, MLOps, or automation workflows Previous experience engaging directly with clients and senior stakeholders Why Join This is an opportunity to join a fast-scaling AI business at a defining stage of its growth. You’ll More ❯

scalable and interconnected platform services. These services range from engagement tools such as polling and prediction to services such as push notification systems and high throughput analytics and data pipelines. The successful candidate will have the opportunity to work on a wide variety of projects across the sports sector. They will also be able to assist with maintaining … way from the requirements analysis stage to the delivery of the feature. Maintaining and improving all existing backend Symfony services. Maintaining and improving our first party analytics and data pipelines and ensuring integration of new features with these pipelines, for example tracking poll votes and failed push notification sends. Working with specialist Drupal, Magento, Frontend, iOS and Android … teams on API contracts to connect platforms, for example poll choice management APIs, sports data APIs, ticketing APIs. Participating in team code review practices, reviewing code from other teams and working with them to review your own code. Leading end-to-end testing to ensure high quality delivery to the product and project teams, involving automated unit and More ❯

scalable and interconnected platform services. These services range from engagement tools such as polling and prediction to services such as push notification systems and high throughput analytics and data pipelines. The successful candidate will have the opportunity to work on a wide variety of projects across the sports sector. They will also be able to assist with maintaining … way from the requirements analysis stage to the delivery of the feature. Maintaining and improving all existing backend Symfony services. Maintaining and improving our first party analytics and data pipelines and ensuring integration of new features with these pipelines, for example tracking poll votes and failed push notification sends. Working with specialist Drupal, Magento, Frontend, iOS and Android … teams on API contracts to connect platforms, for example poll choice management APIs, sports data APIs, ticketing APIs. Participating in team code review practices, reviewing code from other teams and working with them to review your own code. Leading end-to-end testing to ensure high quality delivery to the product and project teams, involving automated unit and More ❯

scalable and interconnected platform services. These services range from engagement tools such as polling and prediction to services such as push notification systems and high throughput analytics and data pipelines. The successful candidate will have the opportunity to work on a wide variety of projects across the sports sector. They will also be able to assist with maintaining … way from the requirements analysis stage to the delivery of the feature. Maintaining and improving all existing backend Symfony services. Maintaining and improving our first party analytics and data pipelines and ensuring integration of new features with these pipelines, for example tracking poll votes and failed push notification sends. Working with specialist Drupal, Magento, Frontend, iOS and Android … teams on API contracts to connect platforms, for example poll choice management APIs, sports data APIs, ticketing APIs. Participating in team code review practices, reviewing code from other teams and working with them to review your own code. Leading end-to-end testing to ensure high quality delivery to the product and project teams, involving automated unit and More ❯

to success. Key Responsibilities: Architect and develop scalable, high-performance backend services using Python (FastAPI, Flask) and Node.js. Design, build, and maintain an AWS-based platform supporting AI, data, and web products. Manage and optimise Kubernetes clusters for availability, performance, and cost efficiency. Develop and maintain CI/CD pipelines with GitHub Actions for automated testing and deployment. … Bachelor’s degree in Computer Science or related field. 5+ years’ experience in backend development with Python. Proven experience in start-up or scaling SaaS environments. Familiarity with data pipelines, vector databases, and prompt engineering. Strong problem-solving skills and ability to work autonomously in a fast-paced, high-performing environment. More ❯

to success. Key Responsibilities: Architect and develop scalable, high-performance backend services using Python (FastAPI, Flask) and Node.js. Design, build, and maintain an AWS-based platform supporting AI, data, and web products. Manage and optimise Kubernetes clusters for availability, performance, and cost efficiency. Develop and maintain CI/CD pipelines with GitHub Actions for automated testing and deployment. … Bachelor’s degree in Computer Science or related field. 5+ years’ experience in backend development with Python. Proven experience in start-up or scaling SaaS environments. Familiarity with data pipelines, vector databases, and prompt engineering. Strong problem-solving skills and ability to work autonomously in a fast-paced, high-performing environment. More ❯

to success. Key Responsibilities: Architect and develop scalable, high-performance backend services using Python (FastAPI, Flask) and Node.js. Design, build, and maintain an AWS-based platform supporting AI, data, and web products. Manage and optimise Kubernetes clusters for availability, performance, and cost efficiency. Develop and maintain CI/CD pipelines with GitHub Actions for automated testing and deployment. … Bachelor’s degree in Computer Science or related field. 5+ years’ experience in backend development with Python. Proven experience in start-up or scaling SaaS environments. Familiarity with data pipelines, vector databases, and prompt engineering. Strong problem-solving skills and ability to work autonomously in a fast-paced, high-performing environment. More ❯

backend systems, APIs, and tools that power Locai Labs’ AI models and agentic platforms. You will work on a diverse range of challenges, from model-serving APIs and data pipelines to infrastructure for intelligent agents and automation frameworks. This is a hands-on engineering role for someone who enjoys solving complex technical problems and shipping impactful products. You … ideally working on backend systems, APIs, or AI-related products Proficiency in Python and JavaScript/TypeScript (Node.js) Strong understanding of backend architectures, REST/GraphQL APIs, and data modelling Experience with containerisation (Docker) and cloud platforms ( GCP , AWS , or similar) Familiarity with LLM or AI APIs Exposure to agentic frameworks (LangChain, LlamaIndex, Semantic Kernel, etc.) Practical experience More ❯

backend systems, APIs, and tools that power Locai Labs’ AI models and agentic platforms. You will work on a diverse range of challenges, from model-serving APIs and data pipelines to infrastructure for intelligent agents and automation frameworks. This is a hands-on engineering role for someone who enjoys solving complex technical problems and shipping impactful products. You … ideally working on backend systems, APIs, or AI-related products Proficiency in Python and JavaScript/TypeScript (Node.js) Strong understanding of backend architectures, REST/GraphQL APIs, and data modelling Experience with containerisation (Docker) and cloud platforms ( GCP , AWS , or similar) Familiarity with LLM or AI APIs Exposure to agentic frameworks (LangChain, LlamaIndex, Semantic Kernel, etc.) Practical experience More ❯

backend systems, APIs, and tools that power Locai Labs’ AI models and agentic platforms. You will work on a diverse range of challenges, from model-serving APIs and data pipelines to infrastructure for intelligent agents and automation frameworks. This is a hands-on engineering role for someone who enjoys solving complex technical problems and shipping impactful products. You … ideally working on backend systems, APIs, or AI-related products Proficiency in Python and JavaScript/TypeScript (Node.js) Strong understanding of backend architectures, REST/GraphQL APIs, and data modelling Experience with containerisation (Docker) and cloud platforms ( GCP , AWS , or similar) Familiarity with LLM or AI APIs Exposure to agentic frameworks (LangChain, LlamaIndex, Semantic Kernel, etc.) Practical experience More ❯

services such as Logic Apps, Function Apps, Service Bus, Event Grid, and Event Hub. Collaborate with architects to define patterns for event-driven and API-based integrations. Develop data pipelines and orchestrations using Azure Data Factory and Abinitio to support batch and near-Real Time data integration scenarios. Implement automated deployment and testing of More ❯

We’re partnered with a tier 1 consumer electronics business to hire a Data Analytics specialist (Korean Speaking). This position focuses on running, extending, and enhancing data analytics operations. The successful candidate will generate data reports, provide insights to senior management through digitalised documents, and gather information from various systems, including SCM and … ERP platforms. Key Responsibilities: Support data analytics tasks and initiatives for successful delivery Design and implement data pipelines for extraction, transformation, and loading Source and acquire data from relevant systems Analyse datasets to extract insights and share findings with stakeholders Transform raw data into structured formats for internal use Generate reports providing … stakeholders What We're Looking For: Degree-level education or equivalent Proficiency in the MS Office suite (Word, Excel, PowerPoint) Strong numerical background (mathematics, statistics, etc.) Experience in data gathering and proposal writing Analytical thinking and quick learning ability Excellent relationship building and interpersonal skills 1+ years MS Office experience Ability to evaluate large unstructured datasets Fluent in More ❯