22 of 22 Data Pipeline Jobs in Bristol

Title: Data Engineer Location: UK Job Type: Full-time About Scrumconnect: Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services … Science, Architecture, etc.) to identify emerging and cross-community issues affecting your role and escalate as necessary. Describe technical, data, pipeline, and production issues to colleagues of different specialisms. Communicate within the team and across teams to monitor expectations around delivery of data ...

from the landing zone into the Bronze layer, working in partnership with the Development and Application Management team. Design and optimise ETL/ELT pipeline frameworks using Databricks, Delta Lake and Azure Data Factory. Ensure Silver and Gold layer data products are fit for purpose … modelling — conceptual, logical and physical. Data warehousing and data lake architecture for high‐performance analytics. ETL/ELT pipeline development and optimisation to support large‐scale data processing. Data integration across structured and unstructured sources, ensuring high availability. Metadata ...

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London; Bristol; Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London | Manchester | Bristol | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised … environments. Due to the nature of these programmes, active SC clearance is required for this role . This opportunity sits within a growing Data & AI Architecture capability , focused on delivering complex, high-impact programmes at the heart of government. The role combines deep technical architecture expertise with leadership ...

medical cover, digital GP services, enhanced family‐friendly policies, employee assistance programmes, and reimbursement for professional development. Key Responsibilities Define and maintain enterprise data architecture, including principles, policies, standards, and reference models aligned with JSP453 and Defence‐wide integration frameworks. Develop architecture artefacts including conceptual, logical, and physical … data models, data flows, and architecture blueprints. Translate business and operational needs into data architecture designs, ensuring alignment between enterprise strategy and system‐level implementation. Design data integration patterns and approaches (e.g. APIs, data pipelines, event‐driven architectures) to enable ...

strategic expertise we develop solutions that address our client’s critical challenges supporting digitalisation and security. Key Responsibilities Define and maintain enterprise data architecture, including principles, policies, standards, and reference models aligned with JSP 453 and Defence‐wide integration frameworks. Develop architecture artefacts including conceptual, logical, and physical … data models, data flows, and architecture blueprints. Translate business and operational needs into data architecture designs, ensuring alignment between enterprise strategy and system‐level implementation. Design data integration patterns and approaches (e.g. APIs, data pipelines, event‐driven architectures) to enable ...

Data Engineer - Defence ££60,000 - £90,000 GBP Hybrid WORKING Location: Manchester;Bristol;London;Newcaslte , Manchester, North West - United Kingdom Type: Permanent Data Engineer Newcastle | Manchester | Bristol | London | Hybrid | Permanent Our client is a specialist technology consultancy delivering high-impact engineering across defence and complex environments … engineering within defence and secure environments Modern cloud-based data platforms and distributed systems End-to-end data pipeline design and optimisation High-assurance, real-world engineering challenges Embedded delivery within client environments Why Join: Work on mission-critical data systems ...

Senior Data Engineer Location: Bristol Contract: Outside IR35 Rate: £68 per hour Security Clearance: DV Cleared Working Pattern: 5 Days On Site Nationality Requirement: Sole British Nationals Only THE ROLE We are recruiting on behalf of a highly secure engineering and technology programme seeking an experienced Senior Data … ensuring compliance with strict governance and security standards. KEY RESPONSIBILITIES Data Architecture & Engineering - Design and implement scalable, resilient data pipeline architectures using Elastic Stack and Apache NiFi - Develop secure frameworks for data ingestion, transformation and integration - Build and maintain batch and real-time ...

Data Platform Engineer -Contract - Outside IR35 -Remote first -ASAP Start Currently recruiting for seasoned Data Platform Engineer to join our market-leading client, through a period of growth and innovation. They are seeking a seasoned Data Platform Engineer with a blend … data retention policies/data management AWS experience (core AWS platform) Ability to automate processes Appreciation of Python software engineering (pipeline patterns + ingestion frameworks) Terraform/Infrastructure as Code beneficial Comfortable working in fast-moving squads Collaborative in nature The above is not exhaustive. ...

thrive in fast-moving environments where you can shape meaningful outcomes - keep reading. Not your grandad’s bookie. The Role Title: Senior Data Engineer Team: Data Location: Remote UK Salary bands: £85,000 - £100,000 As Senior Data Engineer, you’ll help scale … data platform that powers decision making across Midnite. You’ll work on core platform improvements, reliable data pipelines, modern data tooling, and lower-latency analytics foundations that support the next stage of company growth. This is a high-ownership role for someone who brings ...

party customers. Job Summary We are looking for experienced Data Quality Engineers at all levels with strong Data and ETL pipeline testing. With Python and SQL skills to join our team. An understanding of Databricks and Azure ADF is also desirable. The successful candidate will … form part of the Enterprise Data Platform team (NOVA) responsible for delivering on the product roadmap and enhancing automation practices. As a part of a Nova team, you will be working at every stage of a product lifecycle from conception, design, data engineering, testing and through ...

Product Owner to join their growing team in Bristol.This is a unique opportunity for someone who enjoys working at the intersection of technology, data and business operations within a fast-paced, collaborative environment. The role sits across multiple teams and stakeholders, offering the chance to make a genuine … cross-functional teams of up to 50 people across Data Science, Engineering and UnderwritingOversee end-to-end product and data pipeline workflowsWork closely with senior stakeholders and business leadership teamsDrive delivery priorities, sprint planning and workflow managementProduce and interpret analytical and operational reports using tools ...

Product Owner to join their growing team in Bristol.This is a unique opportunity for someone who enjoys working at the intersection of technology, data and business operations within a fast-paced, collaborative environment. The role sits across multiple teams and stakeholders, offering the chance to make a genuine … cross-functional teams of up to 50 people across Data Science, Engineering and UnderwritingOversee end-to-end product and data pipeline workflowsWork closely with senior stakeholders and business leadership teamsDrive delivery priorities, sprint planning and workflow managementProduce and interpret analytical and operational reports using tools ...

Product Owner to join their growing team in Bristol.This is a unique opportunity for someone who enjoys working at the intersection of technology, data and business operations within a fast-paced, collaborative environment. The role sits across multiple teams and stakeholders, offering the chance to make a genuine … cross-functional teams of up to 50 people across Data Science, Engineering and UnderwritingOversee end-to-end product and data pipeline workflowsWork closely with senior stakeholders and business leadership teamsDrive delivery priorities, sprint planning and workflow managementProduce and interpret analytical and operational reports using tools ...

Owner to join their growing team in Bristol. This is a unique opportunity for someone who enjoys working at the intersection of technology, data and business operations within a fast-paced, collaborative environment. The role sits across multiple teams and stakeholders, offering the chance to make a genuine … functional teams of up to 50 people across Data Science, Engineering and Underwriting Oversee end-to-end product and data pipeline workflows Work closely with senior stakeholders and business leadership teams Drive delivery priorities, sprint planning and workflow management Produce and interpret analytical and operational ...

This is a hands-on technical and analytical role where your work will directly support commercial pricing decisions through the development of robust data pipelines, workflow automation and production-ready model deployment. You'll work closely with pricing analysts and stakeholders across the business to ensure pricing models … data processes are scalable, accurate and operationally effective. We're looking for someone who enjoys solving complex technical challenges, working with data and building automated solutions that drive real commercial value within a fast-paced pricing environment. Responsibilities include: Support the successful delivery of Consumer pricing ...

deep technical engine behind their internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … storage supporting current and future AI deployments Troubleshoot integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft ...

executing the migration to AWS Bedrock. Utilise your strong C# background to ensure AI agents integrate seamlessly with core enterprise systems, APIs, and data pipelines. Refine prompt engineering, agent autonomy, and guardrails to ensure high performance, security, and accuracy. Proven experience building Agentic AI systems (autonomous agents, multi ...

workflows across the group Experimenting with large language models (LLMs), APIs, and emerging AI platforms to solve real business challenges Developing internal dashboards, data pipelines, and reporting tools to support commercial decision-making Researching and evaluating new AI technologies, tools, and vendors relevant to talent acquisition and professional … services Collaborating with consultants, managers, and clients to understand pain points and translate them into technical solutions Supporting data quality, CRM optimisation, and systems integration projects across the business Contributing to the company’s broader technology strategy and AI roadmap What We’re Looking For: A qualification ...

rapidly growing company that specialises in delivering high-intent, high-quality leads while maintaining strict compliance with Financial Conduct Authority (FCA) and General Data Protection Regulation (GDPR) standards. Leveraging advanced APIs, their platform focuses on enhancing eligibility criteria and creating frictionless customer journeys to maximise conversion rates … generation platforms. The successful candidate will be passionate about automation, API integrations, and building conversion-focused user experiences, with a strong awareness of data privacy, security, and compliance. Responsibilities: Develop and maintain full-stack web applications focused on lead generation workflows. Optimise and scale platform performance to manage ...

proofs of concept, leveraging AI/Gen AI tooling to accelerate delivery ("vibe coding"). Build and integrate AI, Generative AI and Data-driven features into products. Work within an Agile environment, contributing to sprint planning, stand-ups and iterative delivery. Collaborate closely with product, design and data … DynamoDB, etc.). Demonstrable experience in rapid prototyping and AI-assisted/"vibe coding" workflows. Exposure to AI, Generative AI and/or Data projects and tooling. Experience working in Agile delivery environments. Excellent communication skills and proven stakeholder management ability. Ability to work hybrid from Bristol. Desirable ...

specialist technology consultancy based in Bristol. We help large organisations banks, energy companies, airports, investment platforms get real value from the data that flows through their IT infrastructure. That means helping them monitor their systems, protect their networks, and make sense of the information their technology generates every … consultants, and building skills that have a clear path to progression. The Opportunity Were looking for a Graduate Consultant to join our Data practice. Youll work alongside senior colleagues on the design, deployment, and optimisation of monitoring and observability platforms primarily Splunk and Cribl helping enterprise clients ...

Customer Support (not exhaustive): Technical Leadership & System Expertise Become the CST technical authority on the MDA system GeoVS software architecture and functionality System data sources, Sensor integration (AIS, radar, satellite, cameras, radio, etc.) Network infrastructure, server environments, virtualisation, interfaces, and data pipelines Translate complex technical concepts … across tickets, events, and sensor/system performance to identify recurring patterns and systemic weaknesses Drive initiatives to improve System uptime and reliability, Data quality, Installation and configuration standards along with recommend and initiate improvements in process, documentation, and training Skills & Experience Strong understanding of IT infrastructure: networks ...