24 of 24 Data Pipeline Jobs in Bristol

from the landing zone into the Bronze layer, working in partnership with the Development and Application Management team. Design and optimise ETL/ELT pipeline frameworks using Databricks, Delta Lake and Azure Data Factory. Ensure Silver and Gold layer data products are fit for purpose … modelling — conceptual, logical and physical. Data warehousing and data lake architecture for high‐performance analytics. ETL/ELT pipeline development and optimisation to support large‐scale data processing. Data integration across structured and unstructured sources, ensuring high availability. Metadata ...

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London; Bristol; Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London | Manchester | Bristol | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised … environments. Due to the nature of these programmes, active SC clearance is required for this role . This opportunity sits within a growing Data & AI Architecture capability , focused on delivering complex, high-impact programmes at the heart of government. The role combines deep technical architecture expertise with leadership ...

medical cover, digital GP services, enhanced family‐friendly policies, employee assistance programmes, and reimbursement for professional development. Key Responsibilities Define and maintain enterprise data architecture, including principles, policies, standards, and reference models aligned with JSP453 and Defence‐wide integration frameworks. Develop architecture artefacts including conceptual, logical, and physical … data models, data flows, and architecture blueprints. Translate business and operational needs into data architecture designs, ensuring alignment between enterprise strategy and system‐level implementation. Design data integration patterns and approaches (e.g. APIs, data pipelines, event‐driven architectures) to enable ...

strategic expertise we develop solutions that address our client’s critical challenges supporting digitalisation and security. Key Responsibilities Define and maintain enterprise data architecture, including principles, policies, standards, and reference models aligned with JSP 453 and Defence‐wide integration frameworks. Develop architecture artefacts including conceptual, logical, and physical … data models, data flows, and architecture blueprints. Translate business and operational needs into data architecture designs, ensuring alignment between enterprise strategy and system‐level implementation. Design data integration patterns and approaches (e.g. APIs, data pipelines, event‐driven architectures) to enable ...

Data Engineer - Defence ££60,000 - £90,000 GBP Hybrid WORKING Location: Manchester;Bristol;London;Newcaslte , Manchester, North West - United Kingdom Type: Permanent Data Engineer Newcastle | Manchester | Bristol | London | Hybrid | Permanent Our client is a specialist technology consultancy delivering high-impact engineering across defence and complex environments … engineering within defence and secure environments Modern cloud-based data platforms and distributed systems End-to-end data pipeline design and optimisation High-assurance, real-world engineering challenges Embedded delivery within client environments Why Join: Work on mission-critical data systems ...

Senior Data Engineer Location: Bristol Contract: Outside IR35 Rate: £68 per hour Security Clearance: DV Cleared Working Pattern: 5 Days On Site Nationality Requirement: Sole British Nationals Only THE ROLE We are recruiting on behalf of a highly secure engineering and technology programme seeking an experienced Senior Data … ensuring compliance with strict governance and security standards. KEY RESPONSIBILITIES Data Architecture & Engineering - Design and implement scalable, resilient data pipeline architectures using Elastic Stack and Apache NiFi - Develop secure frameworks for data ingestion, transformation and integration - Build and maintain batch and real-time ...

Data Platform Engineer -Contract - Outside IR35 -Remote first -ASAP Start Currently recruiting for seasoned Data Platform Engineer to join our market-leading client, through a period of growth and innovation. They are seeking a seasoned Data Platform Engineer with a blend … data retention policies/data management AWS experience (core AWS platform) Ability to automate processes Appreciation of Python software engineering (pipeline patterns + ingestion frameworks) Terraform/Infrastructure as Code beneficial Comfortable working in fast-moving squads Collaborative in nature The above is not exhaustive. ...

Lead QA Engineer | Backend | Data | ETL | Agile | Automation Our insurance client in Leicester are looking for a Lead Quality Engineer focused on testing backend systems/data migration/ETL/data quality. If interested, please see the details below: Overview of role … Lead Quality Engineer, you’ll lead testing efforts within an Agile team, ensuring the quality of data pipelines and ETL processes. You’ll define test strategies, mentor a high-performing team, and collaborate with stakeholders to align testing with business goals. Responsibilities include hands-on data ...

party customers. Job Summary We are looking for experienced Data Quality Engineers at all levels with strong Data and ETL pipeline testing. With Python and SQL skills to join our team. An understanding of Databricks and Azure ADF is also desirable. The successful candidate will … form part of the Enterprise Data Platform team (NOVA) responsible for delivering on the product roadmap and enhancing automation practices. As a part of a Nova team, you will be working at every stage of a product lifecycle from conception, design, data engineering, testing and through ...

Product Owner to join their growing team in Bristol.This is a unique opportunity for someone who enjoys working at the intersection of technology, data and business operations within a fast-paced, collaborative environment. The role sits across multiple teams and stakeholders, offering the chance to make a genuine … cross-functional teams of up to 50 people across Data Science, Engineering and UnderwritingOversee end-to-end product and data pipeline workflowsWork closely with senior stakeholders and business leadership teamsDrive delivery priorities, sprint planning and workflow managementProduce and interpret analytical and operational reports using tools ...

Product Owner to join their growing team in Bristol.This is a unique opportunity for someone who enjoys working at the intersection of technology, data and business operations within a fast-paced, collaborative environment. The role sits across multiple teams and stakeholders, offering the chance to make a genuine … cross-functional teams of up to 50 people across Data Science, Engineering and UnderwritingOversee end-to-end product and data pipeline workflowsWork closely with senior stakeholders and business leadership teamsDrive delivery priorities, sprint planning and workflow managementProduce and interpret analytical and operational reports using tools ...

Product Owner to join their growing team in Bristol.This is a unique opportunity for someone who enjoys working at the intersection of technology, data and business operations within a fast-paced, collaborative environment. The role sits across multiple teams and stakeholders, offering the chance to make a genuine … cross-functional teams of up to 50 people across Data Science, Engineering and UnderwritingOversee end-to-end product and data pipeline workflowsWork closely with senior stakeholders and business leadership teamsDrive delivery priorities, sprint planning and workflow managementProduce and interpret analytical and operational reports using tools ...

Owner to join their growing team in Bristol. This is a unique opportunity for someone who enjoys working at the intersection of technology, data and business operations within a fast-paced, collaborative environment. The role sits across multiple teams and stakeholders, offering the chance to make a genuine … functional teams of up to 50 people across Data Science, Engineering and Underwriting Oversee end-to-end product and data pipeline workflows Work closely with senior stakeholders and business leadership teams Drive delivery priorities, sprint planning and workflow management Produce and interpret analytical and operational ...

Remote) UK Job Description Your role: As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming … distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) · Strong proficiency in Java, Python, or Scala · Solid understanding of event-driven architecture and data streaming patterns · Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure · Familiarity with Docker, Kubernetes, and CI/CD pipelines · Excellent problem ...

This is a hands-on technical and analytical role where your work will directly support commercial pricing decisions through the development of robust data pipelines, workflow automation and production-ready model deployment. You'll work closely with pricing analysts and stakeholders across the business to ensure pricing models … data processes are scalable, accurate and operationally effective. We're looking for someone who enjoys solving complex technical challenges, working with data and building automated solutions that drive real commercial value within a fast-paced pricing environment. Responsibilities include: Support the successful delivery of Consumer pricing ...

using Terraform, ECS, and Lambda while maintaining multi-tenant security and ISO 27001 standards. Develop and optimize hybrid search capabilities and data pipelines, integrating LLMs to automate complex research tasks for dealmakers. The ideal candidate: 7+ years of experience building and shipping production-grade systems in startup ...

deep technical engine behind their internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … storage supporting current and future AI deployments Troubleshoot integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft ...

executing the migration to AWS Bedrock. Utilise your strong C# background to ensure AI agents integrate seamlessly with core enterprise systems, APIs, and data pipelines. Refine prompt engineering, agent autonomy, and guardrails to ensure high performance, security, and accuracy. Proven experience building Agentic AI systems (autonomous agents, multi ...

workflows across the group Experimenting with large language models (LLMs), APIs, and emerging AI platforms to solve real business challenges Developing internal dashboards, data pipelines, and reporting tools to support commercial decision-making Researching and evaluating new AI technologies, tools, and vendors relevant to talent acquisition and professional … services Collaborating with consultants, managers, and clients to understand pain points and translate them into technical solutions Supporting data quality, CRM optimisation, and systems integration projects across the business Contributing to the company’s broader technology strategy and AI roadmap What We’re Looking For: A qualification ...

/ML-powered features and applications using Python and modern frameworks. Build, integrate, and maintain machine learning models/solutions—from data pipelines to API deployment and user-facing delivery. Collaborate with product managers, compliance experts, and engineers to translate business needs into intelligent technologies. Build robust backend … agentic workflows), ensuring security and compliance standards are met. Implement best practices for MLOps, including CI/CD, automated testing, model versioning, and data validation. Architect integrations with vector databases, cloud platforms, and retrieval-augmented generation systems. Qualifications: 3+ years of production experience delivering fullstack AI/ ...

proofs of concept, leveraging AI/Gen AI tooling to accelerate delivery ("vibe coding"). Build and integrate AI, Generative AI and Data-driven features into products. Work within an Agile environment, contributing to sprint planning, stand-ups and iterative delivery. Collaborate closely with product, design and data … DynamoDB, etc.). Demonstrable experience in rapid prototyping and AI-assisted/"vibe coding" workflows. Exposure to AI, Generative AI and/or Data projects and tooling. Experience working in Agile delivery environments. Excellent communication skills and proven stakeholder management ability. Ability to work hybrid from Bristol. Desirable ...

month fixed term contract Sanderson are partnered with a leading real estate provider who are seeking a skilled Tableau Developer to join their Data & Insight team for a six-month fixed-term contract. This is a fantastic opportunity to contribute to a major data transformation initiative … that drive commercial performance and strategic decision-making, working closely with stakeholders across the business to translate requirements into actionable insights and ensure data solutions are robust, accurate, and user-friendly. Key Responsibilities Design, build, and enhance Tableau dashboards to support commercial and operational teams. Collaborate with stakeholders ...

specialist technology consultancy based in Bristol. We help large organisations banks, energy companies, airports, investment platforms get real value from the data that flows through their IT infrastructure. That means helping them monitor their systems, protect their networks, and make sense of the information their technology generates every … consultants, and building skills that have a clear path to progression. The Opportunity Were looking for a Graduate Consultant to join our Data practice. Youll work alongside senior colleagues on the design, deployment, and optimisation of monitoring and observability platforms primarily Splunk and Cribl helping enterprise clients ...

Customer Support (not exhaustive): Technical Leadership & System Expertise Become the CST technical authority on the MDA system GeoVS software architecture and functionality System data sources, Sensor integration (AIS, radar, satellite, cameras, radio, etc.) Network infrastructure, server environments, virtualisation, interfaces, and data pipelines Translate complex technical concepts … across tickets, events, and sensor/system performance to identify recurring patterns and systemic weaknesses Drive initiatives to improve System uptime and reliability, Data quality, Installation and configuration standards along with recommend and initiate improvements in process, documentation, and training Skills & Experience Strong understanding of IT infrastructure: networks ...