26 to 49 of 49 Data Pipeline Jobs in the South West

Consulting is hiring a Principal GCP Data Engineer in Bristol to lead data engineering efforts for complex client programmes. You will own end-to-end data solutions, guide architecture, and drive best practices across teams with a focus on production-grade pipelines and cloud … native patterns. You will mentor teammates, influence client stakeholders, and contribute to design discussions beyond data processing, shaping the overall data strategy for large-scale engagements. #J-18808-Ljbffr ...

design and deliver scalable data processing solutions … customers operating in highly sensitive, demanding environments. This is hands-on technical work: you'll architect cloud-native systems, lead data pipeline development, and work directly with technical stakeholders to solve complex, real-world problems. Essential requirements British national only, active SC, and eligible for higher le... ...

design and deliver scalable data processing solutions … customers operating in highly sensitive, demanding environments. This is hands-on technical work: you'll architect cloud-native systems, lead data pipeline development, and work directly with technical stakeholders to solve complex, real-world problems. Essential requirements British national only, active SC, and eligible for higher ...

practical AI products that can operate in real healthcare environments under strict reliability, security, and compliance standards. Their backend platform powers orchestration layers, data pipelines, knowledge systems, and AI agents operating across clinical environments. Reliability, safety, and scalability are central to everything they build. The engineering team ...

Senior Data Platform Engineer – Elastic Stack/Apache NiFi | Defence | Bristol Inside IR35 | On-site We're supporting a major defence technology programme looking for an experienced Senior Data Engineer to join a secure enterprise platform team. This role is focused on building and maintaining secure … scalable data pipelines rather than traditional analytics or reporting. You'll work with technologies including Apache NiFi and the Elastic Stack (Elasticsearch, Logstash & Kibana) to deliver resilient data integration platforms supporting mission-critical environments. You'll be involved in: Designing and maintaining enterprise data ...

architectural leadership by leading through example. Your responsibilities will include: Lead the development and implementation of a modern cloud foundation and data platform that is robust, scalable, fully automated, secure, and can support the growth of the business. Build Scalable Architectures: Leverage modern technologies to design and implement … build secure RESTful and GraphQL APIs, ensuring seamless integration with core banking systems (e.g., Mambu) and external services like Open Banking platforms. Data Engineering and Analytics: Work closely with data teams to define robust data pipelines and scalable cloud-based data platforms ...

deep technical engine behind their internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … storage supporting current and future AI deployments Troubleshoot integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft ...

area. Device & Embedded Software Systems Embedded Linux, C++/Python, embedded systems, multi-sensor and camera-based devices (including thermal and line-scan), data acquisition and edge processing, device-to-cloud pipelines, networking, system integration, hardware/software collaboration, field diagnostics, performance optimisation, secure and robust systems, Linux … build systems (e.g. Yocto), media pipelines (e.g. GStreamer), FFMPEG, IoT devices, sensor data processing, signal conditioning, computer vision, FPGA exposure, electronics fundamentals. Platform Engineering Cloud infrastructure, AWS, distributed systems, backend services, RESTful APIs, microservices architecture, service integration, data pipelines, storage systems, relational databases (MySQL), scalability, system ...

Data Scientist - Contract - 6 Months Rate : £500 per day IR35 : Inside Duration : 6 Months (extendable) Location : Remote/Occasional travel to Southwest England The role : A large organisation is seeking a Data Scientist to support the delivery of AI and machine learning solutions across an evolving … enterprise data environment. This is a hands-on role working across the full ML lifecycle, from prototype through to production, focused on delivering scalable, value-driven outcomes. Experience requirements & Responsibilities : Develop and deploy machine learning models to solve business problems. Translate prototypes into production-ready solutions. Build ...

Space, Defence and Intelligence sector. As an AI Developer/Engineer, you will build and deploy intelligent applications that unlock the value of data, enhance decision-making, and drive operational impact. Working with cutting-edge technologies and expert teams, you will take ownership of complex challenges, contribute innovative … within secure, often disconnected environments. You will take ownership of developing machine learning and AI solutions, including large language models, retrieval systems and data pipelines, ensuring they are scalable, reliable and optimised for performance. Working closely with multidisciplinary teams, you will integrate AI capabilities into existing systems ...

fast-paced environment. The Role You'll play a key role in designing and developing modern backend systems that process live data, integrate with external platforms and support business-critical applications. Responsibilities include: Designing and developing scalable backend services using Python and Java Building cloud-native, event-driven … applications Developing integrations with third-party platforms and APIs Designing and optimising real-time data processing pipelines Improving application performance, resilience and scalability Working closely with technical stakeholders to deliver high-quality software Contributing to infrastructure, deployment and continuous improvement initiatives Technology You'll be working with ...

reports. Work Experience Required Qualifications & Experience: Bachelors degree (minimum) in Engineering , Software, IT or a closely related discipline. Knowledge and awareness of assessing data and producing summary reports. Able to develop a project specification with colleagues, often including those from other engineering disciplines. Able to produce details … needs. Solution orientated mindset and the ability to consider the bigger picture. Experience with the Microsoft Office Suite (Intermediate+) Comfortable working with unstructured data and building data pipelines . A good awareness of data quality and structure. An eye for detail. ...

applications on AWS . Integrate Large Language Models (LLMs), vector databases, and modern AI frameworks into production systems. Build secure, reliable, and performant data pipelines to power AI applications. Collaborate with product managers, engineers, and stakeholders throughout the deployment lifecycle. Optimize AI solutions for performance, reliability, and cost. … developing Generative AI applications using modern LLMs. Strong understanding of AI application architecture, APIs, and distributed systems. Experience working with structured and unstructured data . Ability to rapidly prototype solutions and iterate in fast-moving customer environments. Excellent problem-solving and debugging skills. Strong communication skills with ...

creating automated financial crime quality controls in just a few weeks, our engineering projects are varied. Youll collaborate on a product team with Data Scientists, Analysts, Engineers, Product Owners, and Operations Managers to deliver the most value to our customers. Up to shape what's next in finance … touch. What youll be doing Building APIs and jobs and data pipelines, making sure they're properly designed and scaled according to business needs Writing event consumers to build data models for new flows and processes What you'll need 5+ years of experience ...

proofs of concept, leveraging AI/Gen AI tooling to accelerate delivery ("vibe coding"). Build and integrate AI, Generative AI and Data-driven features into products. Work within an Agile environment, contributing to sprint planning, stand-ups and iterative delivery. Collaborate closely with product, design and data … DynamoDB, etc.). Demonstrable experience in rapid prototyping and AI-assisted/"vibe coding" workflows. Exposure to AI, Generative AI and/or Data projects and tooling. Experience working in Agile delivery environments. Excellent communication skills and proven stakeholder management ability. Ability to work hybrid from Bristol. Desirable ...

proofs of concept, leveraging AI/Gen AI tooling to accelerate delivery ("vibe coding"). Build and integrate AI, Generative AI and Data-driven features into products. Work within an Agile environment, contributing to sprint planning, stand-ups and iterative delivery. Collaborate closely with product, design and data … DynamoDB, etc.). Demonstrable experience in rapid prototyping and AI-assisted/"vibe coding" workflows. Exposure to AI, Generative AI and/or Data projects and tooling. Experience working in Agile delivery environments. Excellent communication skills and proven stakeholder management ability. Ability to work hybrid from Bristol. Desirable ...

proofs of concept, leveraging AI/Gen AI tooling to accelerate delivery ("vibe coding"). Build and integrate AI, Generative AI and Data-driven features into products. Work within an Agile environment, contributing to sprint planning, stand-ups and iterative delivery. Collaborate closely with product, design and data … DynamoDB, etc.). Demonstrable experience in rapid prototyping and AI-assisted/"vibe coding" workflows. Exposure to AI, Generative AI and/or Data projects and tooling. Experience working in Agile delivery environments. Excellent communication skills and proven stakeholder management ability. Ability to work hybrid from Bristol. Desirable ...

communications * Build solutions using OpenAI APIs, large language models, RAG, embeddings, vector search and tool calling * Implement permissions, monitoring, escalation processes and data-privacy controls * Integrate third-party systems using APIs, webhooks and data pipelines * Automate repetitive commercial and operational processes * Create dashboards and reporting tools … Practical experience with OpenAI APIs, LLMs, RAG and agentic workflows * Experience integrating CRM platforms, WhatsApp Business, webhooks and third-party APIs * Strong SQL, data-integration and dashboard-development skills * Knowledge of technical SEO, GA4, Google Tag Manager, Google Ads tracking and conversion optimisation * Experience with Opera Cloud ...

communications * Build solutions using OpenAI APIs, large language models, RAG, embeddings, vector search and tool calling * Implement permissions, monitoring, escalation processes and data-privacy controls * Integrate third-party systems using APIs, webhooks and data pipelines * Automate repetitive commercial and operational processes * Create dashboards and reporting tools … Practical experience with OpenAI APIs, LLMs, RAG and agentic workflows * Experience integrating CRM platforms, WhatsApp Business, webhooks and third-party APIs * Strong SQL, data-integration and dashboard-development skills * Knowledge of technical SEO, GA4, Google Tag Manager, Google Ads tracking and conversion optimisation * Experience with Opera Cloud ...

hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier ...

Inside IR35) We are seeking an experienced Senior .NET C# Engineer to join a fast-paced project focused on building and enhancing data ingestion and search capabilities using Elasticsearch. Role Overview You will play a key role in designing and developing index ingestion processes that populate Elasticsearch indices. … This includes working with event-driven architectures and translating incoming data into a consistent canonical model. Key responsibilities include: Building ingestion pipelines consuming data from Azure Event Hub and Kafka streams. Mapping incoming data (largely 1:1) into a canonical model, with additional metadata ...

critical solutions for National Security customers - building products that protect people, platforms, missions and information against evolving threats. You’ll help customers use data to improve mission outcomes, lead teams hands-on, and mentor others while working at the forefront of innovation. What you’ll be doing … patterns across established and emerging technologies. Convert designs into working implementations and document to required standards. Develop and maintain APIs, UI components and data pipelines within existing data infrastructure. Lead and contribute to agile ceremonies (stand‐ups, refinement, planning, demos). Keep the team aligned ...

native integration solutions in Bristol. You will work closely with stakeholders and cross-functional teams to translate business objectives into scalable APIs and data pipelines on AWS, using Terraform for infrastructure as code and a contract-driven testing approach. You will own and mentor the engineering delivery, ensure … production readiness, and help shape architectural standards across integration, data, and platform teams. #J-18808-Ljbffr ...

Role You will join our Platform Team, reporting to our Platform Team Lead, and work across our entire cloud platform - backend services, APIs, data pipelines, and the clinician-facing web application through which NHS clinicians manage diagnostic pathways, review automated results, and coordinate patient care. This … team. If you have an opinion, it will be heard. What You Will Work On Our cloud platform - the backend services, APIs, and data pipelines that power end-to-end diagnostic pathways running at national scale across NHS Trusts The clinician-facing web application through which NHS clinicians ...