17 of 17 Data Pipeline Jobs in Gloucestershire

Overview Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this … looking to expand our multi‐disciplinary team with people from diverse backgrounds who bring data architecture expertise to the digital transformation of our stakeholders' technology landscapes and ways of working. You may currently be a data architect, data engineer, analytics consultant, solution architect ...

business expands, we are looking for ambitious, talented people to join us. We are looking for a technically proficient Senior Data Engineer to join our growing Data team. Your primary focus will be on ensuring data quality, stability, and reliability — from the moment data arrives in its rawest form to when it is used in decision-making dashboards and customer-facing reports. You will optimise the transformation pipeline from start to finish, guaranteeing that datasets are robust, tested, secure, and business-ready. Our data platform is built using Databricks, with ...

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. We build and operate ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary … following essential criteria and additionally have some experience (or a genuine interest in learning) from the preferred criteria. Essential Data pipeline development using data processing technologies and frameworks Agile or other rapid application development methods Data modelling and understanding of different data ...

Senior Data Engineer Location: Bristol Contract: Outside IR35 Rate: £68 per hour Security Clearance: DV Cleared Working Pattern: 5 Days On Site Nationality Requirement: Sole British Nationals Only THE ROLE We are recruiting on behalf of a highly secure engineering and technology programme seeking an experienced Senior Data … ensuring compliance with strict governance and security standards. KEY RESPONSIBILITIES Data Architecture & Engineering - Design and implement scalable, resilient data pipeline architectures using Elastic Stack and Apache NiFi - Develop secure frameworks for data ingestion, transformation and integration - Build and maintain batch and real-time ...

Data and AI Engineers & Architects | Cheltenham | £80,000 - £140,000 About the Opportunity Sanderson G&D are partnering exclusively with a fast-growing data consultancy specialising in designing, building, and operating AI-ready data infrastructure for some of the UK's most complex … maintain secure batch and real-time data pipelines for government clients. You'll work across data ingestion, modelling, and pipeline development, ensuring data is available, reliable, and aligned to target architectures. What We're Looking For Across all three roles, the following experience ...

will be joining a fast growing consultancy at the forefront of secure data and cloud infrastructure, building AI-ready platforms for high-impact projects. As a Data Engineer, you'll help build and maintain a secure batch and real-time data platform … government client. You'll work with modern commercial and open-source tools to ingest, transform, and deliver data to support analytics and decision-making. Duties & Responsibilities Build, test, and maintain data pipelines Design logical and physical data models Support the growth of the data ...

Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data ...

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere … UK. You'll lead the design and development of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda ...

Support & Customer Value Quantification Provide the technical evidence base and build business cases for renewals and expansions, translating platform telemetry and incident response data into clear customer outcomes. Proactively health-check environments, close technical gaps, and resolve visibility issues ahead of renewal conversations. Collaborate with Sales Engineering … optimise security operations workflows. Work confidently across backend languages (Python preferred; Go, JavaScript, and Bash valued) utilising RESTful APIs, webhooks, and data pipeline patterns. Detection Engineering & SIEM Development Write, tune, and maintain high-fidelity, low-noise SIEM detection rules by translating threat intelligence and attacker behaviour. ...

Senior Data Engineer| AWS/Databricks/PySpark | London/Glasgow (Hybrid) | August Start Role: Senior Data Engineer Location: This is a hybrid engagement represented by 2 days/week onsite, either in Central London or Glasgow. Start Date: Must be able to start mid-August. … Data Science, Software Engineering and Product. Champion best practices in data governance, observability and compliance. Contribute to CI/CD pipeline development and infrastructure automation (Terraform, AWS DevOps). Provide input into technical decisions, peer reviews and solution design. Requirements Proven experience as a Data ...

Remote) UK Job Description Your role: As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming … distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) · Strong proficiency in Java, Python, or Scala · Solid understanding of event-driven architecture and data streaming patterns · Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure · Familiarity with Docker, Kubernetes, and CI/CD pipelines · Excellent problem ...

using Terraform, ECS, and Lambda while maintaining multi-tenant security and ISO 27001 standards. Develop and optimize hybrid search capabilities and data pipelines, integrating LLMs to automate complex research tasks for dealmakers. The ideal candidate: 7+ years of experience building and shipping production-grade systems in startup ...

fully configured, technically sound, and accelerating toward platform outcomes. Where CSMs own the relationship and business outcomes, you own the technical depth — integrations, data flows, product configuration, API health, and escalation triage. In this role, you’ll do: Serve as the dedicated technical point of contact … company Experience owning technical relationships with enterprise-tier accounts — not transactional; strategic, named accounts Demonstrated ability to work across APIs, integrations, data pipeline concepts, and SaaS platform configuration without needing Engineering to hand-hold every step Familiarity with influencer marketing, creator economy, or social media data ...

Contract basis. The role supports performance monitoring of the SEND DMP and SEND service decision-making. You will work with the Data Group, SEND Business Analyst, the Capita lead and the head of Service for SEND. About the role: Based in Central London (Hybrid - 2 days on site … Design and develop visually compelling and interactive Power BI dashboards and reports. Translating business requirements into technical solutions Connecting to a variety of data sources (Capita, SQL Server, Excel, SharePoint, APIs, etc.). Model data efficiently (e.g. star schema) for performance and scalability. Collaborate with ...

manual techniques of yesteryear – even as demand accelerates for copper, lithium, and other metals to build electric vehicles, renewable energy, and data centers. KoBold builds AI models for mineral exploration and deploys those models—alongside our novel sensors—to guide decisions on KoBold-owned-and-operated exploration programs. … exploration success rates by making mineral exploration data broadly accessible to humans and machines. Past projects have included SIP (the Structured Ingest Pipeline), DataKit generation (producing curated sets of data on demand), and RAG (Retrieval Augmentation Generation, utilizing natural language processing on unstructured data ...

land and expand model. Key buyer personas are the CPO and CTO. About the role We are looking for a Software Engineer or Data/AI Scientist with a strong background in AI production-grade applications with strong experience with LLM models (eg: GPT, Anthropic and others). … training existing or bespoke LLM models (and other AI tech) to improve and automate API & more generally SaaS interactions. Managing and updating Data pipelines used for AI use-cases Collaborate with cross-functional teams to identify opportunities for AI integration and automation Optimize and refine existing AI models ...

critical solutions for National Security customers - building products that protect people, platforms, missions and information against evolving threats. You'll help customers use data to improve mission outcomes, lead teams hands-on, and mentor others while working at the forefront of innovation. What you'll be doing … patterns across established and emerging technologies. Convert designs into working implementations and document to required standards. Develop and maintain APIs, UI components and data pipelines within existing data infrastructure. Lead and contribute to agile ceremonies (stand-ups, refinement, planning, demos). Keep the team aligned ...