901 to 925 of 1,061 Data Pipeline Jobs in England

to success. Key Responsibilities: Architect and develop scalable, high-performance backend services using Python (FastAPI, Flask) and Node.js. Design, build, and maintain an AWS-based platform supporting AI, data, and web products. Manage and optimise Kubernetes clusters for availability, performance, and cost efficiency. Develop and maintain CI/CD pipelines with GitHub Actions for automated testing and deployment. … Bachelor’s degree in Computer Science or related field. 5+ years’ experience in backend development with Python. Proven experience in start-up or scaling SaaS environments. Familiarity with data pipelines, vector databases, and prompt engineering. Strong problem-solving skills and ability to work autonomously in a fast-paced, high-performing environment. More ❯

to success. Key Responsibilities: Architect and develop scalable, high-performance backend services using Python (FastAPI, Flask) and Node.js. Design, build, and maintain an AWS-based platform supporting AI, data, and web products. Manage and optimise Kubernetes clusters for availability, performance, and cost efficiency. Develop and maintain CI/CD pipelines with GitHub Actions for automated testing and deployment. … Bachelor’s degree in Computer Science or related field. 5+ years’ experience in backend development with Python. Proven experience in start-up or scaling SaaS environments. Familiarity with data pipelines, vector databases, and prompt engineering. Strong problem-solving skills and ability to work autonomously in a fast-paced, high-performing environment. More ❯

the potential (or ambition) to lead technology at a company-defining level. 🔍 What You'll Do Build and own core infrastructure and backend systems Design and implement APIs, data models, and scalable services Collaborate closely with founders on product direction and technical architecture Ship code fast, validate assumptions, and iterate Lay the groundwork for the future engineering team … doesn’t scare you; in fact, you prefer it Experienced with cloud infrastructure — AWS, GCP, or similar; IaC (Terraform, Pulumi, etc.) is a plus Competent with databases and data modeling — SQL and NoSQL, designing schema for scale Comfortable writing tests and deploying production systems — you care about code quality and reliability ⭐ Bonus Experience (Not Required, but Valuable) Worked … enterprise customers Experience with applied machine learning or MLOps (not just academic or notebook-based work) Exposure to event-driven architectures, streaming systems (Kafka, etc.), or real-time data pipelines Frontend experience in React, TypeScript, or similar modern frameworks 📈 What We Offer Early-stage equity and the opportunity to shape foundational decisions High ownership, zero bureaucracy — build what More ❯

backend systems, APIs, and tools that power Locai Labs’ AI models and agentic platforms. You will work on a diverse range of challenges, from model-serving APIs and data pipelines to infrastructure for intelligent agents and automation frameworks. This is a hands-on engineering role for someone who enjoys solving complex technical problems and shipping impactful products. You … ideally working on backend systems, APIs, or AI-related products Proficiency in Python and JavaScript/TypeScript (Node.js) Strong understanding of backend architectures, REST/GraphQL APIs, and data modelling Experience with containerisation (Docker) and cloud platforms ( GCP , AWS , or similar) Familiarity with LLM or AI APIs Exposure to agentic frameworks (LangChain, LlamaIndex, Semantic Kernel, etc.) Practical experience More ❯

backend systems, APIs, and tools that power Locai Labs’ AI models and agentic platforms. You will work on a diverse range of challenges, from model-serving APIs and data pipelines to infrastructure for intelligent agents and automation frameworks. This is a hands-on engineering role for someone who enjoys solving complex technical problems and shipping impactful products. You … ideally working on backend systems, APIs, or AI-related products Proficiency in Python and JavaScript/TypeScript (Node.js) Strong understanding of backend architectures, REST/GraphQL APIs, and data modelling Experience with containerisation (Docker) and cloud platforms ( GCP , AWS , or similar) Familiarity with LLM or AI APIs Exposure to agentic frameworks (LangChain, LlamaIndex, Semantic Kernel, etc.) Practical experience More ❯

AI solutions, and bring models into production. What You’ll Do Design and deploy AI systems across areas like personalisation, forecasting, and information retrieval Build and maintain robust data pipelines, model training workflows, and monitoring systems Collaborate cross-functionally to apply ML/AI to real-world business problems Develop tooling and automation for CI/CD, model … Experience with retrieval-augmented generation (RAG) or foundation models Exposure to NLP, recommendation systems, or time series forecasting Familiarity with streaming architectures and experimentation platforms Understanding of healthcare data standards (HIPAA, FHIR) Interest in ethical AI and explainability More ❯

AI solutions, and bring models into production. What You’ll Do Design and deploy AI systems across areas like personalisation, forecasting, and information retrieval Build and maintain robust data pipelines, model training workflows, and monitoring systems Collaborate cross-functionally to apply ML/AI to real-world business problems Develop tooling and automation for CI/CD, model … Experience with retrieval-augmented generation (RAG) or foundation models Exposure to NLP, recommendation systems, or time series forecasting Familiarity with streaming architectures and experimentation platforms Understanding of healthcare data standards (HIPAA, FHIR) Interest in ethical AI and explainability More ❯

engineering quality, and building platform leverage. You’ll lead teams deploying generative agents, ML-powered decisioning, and predictive pricing engines in production — at scale. The platform ingests 100M+ data points/month and is built for extensibility across products and geos. What you’ll do Lead and scale a high-performing engineering team across time zones Own the … to build them. You lead 50–100+ engineers, but still have the technical range to challenge Staff+ Engineers on architecture. You’re fluent in distributed systems, real-time data pipelines, and modern CI/CD. You care about clean abstractions, performance, and craft. You’ve built in high-velocity, product-led environments — not command/control bureaucracies. You More ❯

engineering quality, and building platform leverage. You’ll lead teams deploying generative agents, ML-powered decisioning, and predictive pricing engines in production — at scale. The platform ingests 100M+ data points/month and is built for extensibility across products and geos. What you’ll do Lead and scale a high-performing engineering team across time zones Own the … to build them. You lead 50–100+ engineers, but still have the technical range to challenge Staff+ Engineers on architecture. You’re fluent in distributed systems, real-time data pipelines, and modern CI/CD. You care about clean abstractions, performance, and craft. You’ve built in high-velocity, product-led environments — not command/control bureaucracies. You More ❯

DOE An exciting opportunity for a Software Engineer to join a growing tech company developing a cloud platform used to manage autonomous robotic inspections and transform sensor data into actionable insights for industrial clients. The Role: Youll work across backend, frontend, and data services, contributing to new features, improving existing systems, and supporting integrations with robotics … years experience who wants to develop full-stack skills and work with cutting-edge technologies. Key Responsibilities: Develop features across backend and frontend systems Build and maintain APIs, data pipelines, and UI components Write clean, maintainable code following best practices Support cloud deployment (AWS experience beneficial) Build dashboards and tools for processing inspection data Collaborate with … engineering fundamentals Ability to learn new technologies quickly Good communication and teamwork skills Desirable: AWS or cloud deployment familiarity Interest in robotics, embedded systems, or IoT Experience with data visualisation or real-time data Exposure to AI/ML or computer vision More ❯

DOE An exciting opportunity for a Software Engineer to join a growing tech company developing a cloud platform used to manage autonomous robotic inspections and transform sensor data into actionable insights for industrial clients. The Role: You’ll work across backend, frontend, and data services, contributing to new features, improving existing systems, and supporting integrations with … years’ experience who wants to develop full-stack skills and work with cutting-edge technologies. Key Responsibilities: Develop features across backend and frontend systems Build and maintain APIs, data pipelines, and UI components Write clean, maintainable code following best practices Support cloud deployment (AWS experience beneficial) Build dashboards and tools for processing inspection data Collaborate with … engineering fundamentals Ability to learn new technologies quickly Good communication and teamwork skills Desirable: AWS or cloud deployment familiarity Interest in robotics, embedded systems, or IoT Experience with data visualisation or real-time data Exposure to AI/ML or computer vision More ❯

UK’s largest independent recruitment agency, is looking for a confident and capable Senior SQL Database Administrator to take ownership of our SQL Server estate and Azure SQL Data Warehouse environment. It’s a brilliant opportunity for someone who loves improving performance, solving tricky problems, and keeping everything in top shape.What you’ll be doing as a Senior … to keep systems running at their best Advising on and reworking existing databases to boost efficiency and cut costs Overseeing database access and security patch management Migrating SQL data from on-premise SQL Server to Azure SQL using Data Migration tools Creating and maintaining scripts using SQLCMD and PowerShell What we’re looking for: Solid experience … working as a Senior SQL Database Administrator or in a similar senior-level role Hands-on experience with database server security patching Strong knowledge of Azure SQL Data Warehouse and ETL or data pipelines (ADF) Good understanding of database access management Confident with SQL Server Administration, performance tuning and optimisation Experience with backups, restores, and recovery More ❯

AI to automate workflows, enhance decision-making, and unlock productivity across business functions like Finance, HR, and Operations. This is a client-facing delivery role within a leading Data & AI transformation consultancy, working alongside world-class data scientists, engineers, and strategists to move ideas from concept to production. 🔍 The Role Lead the definition and delivery of … Partner with business and technical stakeholders to identify high-value AI opportunities and shape product roadmaps. Translate requirements into actionable user stories and acceptance criteria for engineering and data teams. Collaborate closely with teams building solutions using RAG pipelines, LLMs, embeddings, and API integrations. Define and track KPIs such as accuracy, latency, adoption, and ROI — iterating based on … governance, and responsible AI. Foster agile, transparent, and outcome-driven ways of working across mixed client-consultancy teams. 💡 About You Proven experience as a Product Manager in AI, data, or enterprise technology environments. Hands-on exposure to AI MVPs, LLM applications, or applied ML use cases (e.g. RAG, copilots, generative search). Strong technical grounding in vector search More ❯

and Responsibilities: Design, build, and deploy Large Language Model (LLM)-driven applications into production Develop retrieval-augmented generation (RAG) systems for real-time insights from performance and wearable data Optimise and fine-tune LLMs for efficiency, scalability, and accuracy in production environments Build and maintain robust data pipelines and scalable backend components in Python Collaborate cross … functionally with engineers, data scientists, designers, and product managers to ship AI-first features Requirements: 2+ years of hands-on AI Engineering experience, with strong software engineering fundamentals Proven experience working with LLMs in production (fine-tuning, prompt engineering, or API integrations) Proficiency in Python Experience designing and deploying RAG pipelines (vector databases, embeddings, retrieval optimisation) Academic Excellence … BSc or MSc in Computer Science, AI, Data Science, or related technical field from a top university Familiarity with frameworks such as PyTorch, Hugging Face, LangChain, or LlamaIndex Passionate about sports, health, or fitness – you’ll feel right at home here Bonus points if you: Have worked with unstructured data (text, documents, time-series) and applied More ❯

and Responsibilities: Design, build, and deploy Large Language Model (LLM)-driven applications into production Develop retrieval-augmented generation (RAG) systems for real-time insights from performance and wearable data Optimise and fine-tune LLMs for efficiency, scalability, and accuracy in production environments Build and maintain robust data pipelines and scalable backend components in Python Collaborate cross … functionally with engineers, data scientists, designers, and product managers to ship AI-first features Requirements: 2+ years of hands-on AI Engineering experience, with strong software engineering fundamentals Proven experience working with LLMs in production (fine-tuning, prompt engineering, or API integrations) Proficiency in Python Experience designing and deploying RAG pipelines (vector databases, embeddings, retrieval optimisation) Academic Excellence … BSc or MSc in Computer Science, AI, Data Science, or related technical field from a top university Familiarity with frameworks such as PyTorch, Hugging Face, LangChain, or LlamaIndex Passionate about sports, health, or fitness – you’ll feel right at home here Bonus points if you: Have worked with unstructured data (text, documents, time-series) and applied More ❯

Job Title: Data Engineer Location: Manchester (hybrid) Type: Permanent Must have skills Working with AWS cloud services to manage and process data. Using AWS Glue for building and running data pipelines. Writing PySpark code in Python, along with SQL, to handle big data processing. Creating and running SQL queries to analyze and manage data More ❯

Software Engineer- Python- Data Science and Machine Learning Team The RJC Group is looking for an experienced Software Engineer to join a growing Data Science & Machine Learning team within a global energy and commodities company. This is a hands-on role building the tools, pipelines, and infrastructure that power real-world ML applications across commercial and … operational areas. What You’ll Do Work with data scientists to deliver scalable ML solutions Build and maintain clean, reliable data pipelines and internal tools Collaborate with technical and non-technical stakeholders What You Bring 3–5+ years of experience in software engineering (Python) Experience with fastAPI, cloud platforms (AWS, Azure, or GCP), Docker. Bonus: experience More ❯

Software Engineer- Python- Data Science and Machine Learning Team The RJC Group is looking for an experienced Software Engineer to join a growing Data Science & Machine Learning team within a global energy and commodities company. This is a hands-on role building the tools, pipelines, and infrastructure that power real-world ML applications across commercial and … operational areas. What You’ll Do Work with data scientists to deliver scalable ML solutions Build and maintain clean, reliable data pipelines and internal tools Collaborate with technical and non-technical stakeholders What You Bring 3–5+ years of experience in software engineering (Python) Experience with fastAPI, cloud platforms (AWS, Azure, or GCP), Docker. Bonus: experience More ❯

West England (Manchester/Liverpool corridor – hybrid, UK citizenship required) About the Company: My client is a UK sovereign AI company developing secure, mission-critical artificial intelligence and data platforms for defence, national security, and strategic industry partners. Our systems operate at the intersection of real-time data, autonomous decision support, and cloud-native infrastructure , with … engineers) delivering secure, scalable, and high-availability AI systems. Own AWS-based infrastructure : Lambda, EC2, S3, CloudFormation/Terraform, CloudWatch, and VPC security. Oversee JSON-based API integrations , data pipelines, and serverless event-driven architectures. Implement continuous integration and deployment (CI/CD) pipelines for code, models, and infrastructure. Ensure DevSecOps best practices — patching, logging, monitoring, and compliance … with UK MoD or ISO27001 frameworks. Manage incident response, uptime SLAs , and operational dashboards. Collaborate with software engineers, AI researchers, and data scientists to optimise cloud performance. Maintain documentation and enforce secure coding and deployment standards . Support accreditation, audits, and readiness for UK sovereign hosting environments (IL2–IL5). Report directly to the Head of Engineering/ More ❯

React) Desirable: AWS familiarity We are a growing technology company building a platform that supports fleets of autonomous inspection robots and turns large volumes of sensor and image data into clear, actionable intelligence. Our software helps major industrial and energy organisations monitor critical infrastructure safely and efficiently. This role sits in the team developing the cloud platform and … user interfaces that operators use to run missions, view inspection data, manage alerts, and interact with AI analysis tools. The Opportunity We’re looking for a software engineer with solid foundations and roughly 2–3 years of professional experience. You’ll join a small, experienced team and work across back end, front end, and robotics-related data services. You’ll help deliver new platform features, improve our existing services, and have the chance to broaden your skills across multiple domains: cloud, data processing, UI development, and embedded/robotics integration. This is a role for someone curious, adaptable, and willing to learn. Why Join Us? Work at the intersection of cloud software, robotics More ❯

non-functional requirements. Co-design, pair on, and review the development work of other lead software developers. You’ll work on the entire company's backend code base: data models, algorithms, data pipelines, infrastructure, APIs, complex database queries, ML models. Learn, use, and improve best practices and processes for high-quality software development. Our technology stack More ❯

non-functional requirements. Co-design, pair on, and review the development work of other lead software developers. You’ll work on the entire company's backend code base: data models, algorithms, data pipelines, infrastructure, APIs, complex database queries, ML models. Learn, use, and improve best practices and processes for high-quality software development. Our technology stack More ❯

You'll Do Design, build, and deploy end-to-end solutions that solve critical business needs. This includes everything from quick scripts and internal web apps to robust data pipelines and dashboards. Collaborate closely with non-technical experts to deeply understand their workflows, identify pain points, and develop innovative technical solutions. Integrate with external APIs from key partners … like Google (YouTube) and others to connect our internal infrastructure with the platforms at the heart of our business. Develop data and reporting pipelines, primarily using SQL and Google BigQuery, to provide the data that drives our product strategy. Build and maintain AI-powered tools using LLM APIs and modern frameworks to pioneer new levels of More ❯

design, build, and scale intelligent systems that make a genuine difference across healthcare, mobility, and retail. You’ll work across the full machine learning lifecycle, from experimentation and data pipelines through to deployment and monitoring. This role is ideal for someone who wants to take cutting-edge ML research and turn it into production systems that reach millions … of users. Key Responsibilities: Design, build, and optimise ML models for large-scale behavioural and temporal datasets Develop and maintain scalable, cloud-based data and model pipelines Deploy, monitor, and improve production ML systems (forecasting, classification, behavioural modelling) Collaborate with data scientists, software engineers, and product teams to deliver scalable, explainable AI solutions Contribute to MLOps … in Computer Science, Machine Learning, or a related field (Master’s or PhD preferred) Proven experience developing and deploying ML models in real-world applications Solid coding and data skills (Python, SQL, Databricks, cloud platforms) Deep understanding of the full ML lifecycle and productionisation of models Passion for applying AI to solve real-world problems Why Join: Work More ❯

SAST/SCA findings, fuzzing results) in a scalable, tool-agnostic fashion. Develop and maintain ETL pipelinesand database schemas for high-throughput ingestion and historical trend analysis. Expose data via well-documented REST APIsfor dashboards, automation, and downstream integrations. Collaborate with security and engineering teamsto define metrics, alerts, and dashboard views that surface critical trends and anomalies. Instrument … observabilityand performance monitoring (metrics, dashboards) to ensure maximum throughput and reliability. Develop custom solutionsfor aggregating BOMs into hierarchical system views and conducting searches across products. Documentprocesses, data models, and operational runbooks to enable smooth adoption. Required Skills and Experience Strong coding ability inPythonand comfortable in scripting (e.g. bash). Shown experience building backend services and data … SAST and SCA tools (e.g., Coverity, Black Duck) and experience understanding their findings. Experience defining and visualizing key security and performance metrics within dashboard solutions. Experience with security data formats (e.g. SARIF) Join us to build the foundational security platform that elevates visibility across Arm-apply today! Accommodations at Arm At Arm, we want to build extraordinary teams. More ❯