16 of 16 Permanent Data Pipeline Jobs in Gloucestershire

Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure … variety of data sources using SQL and AWS 'big data' technologies. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics. Work with stakeholders including the Executive, Product, Data … data tools: Hadoop, Spark, Kafka, etc. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with AWS cloud services: EC2, EMR, RDS, Redshift. Experience with stream-processing systems: Storm, Spark More ❯

Data Engineer (Security Clearance) Position Description The Space, Defence and Intelligence business unit in CGI is a true IT Systems Integrator. We work, build, and operate bespoke, technically complex, mission-critical systems which help our clients keep us all safe and secure. We bring innovation to our clients … collaboratively with global technology companies, cutting edge SMEs and academia to deliver the optimal solution for each client. We're seeking a Senior Data Engineer to design and lead the implementation of data flows between operational systems and BI/analytics platforms. Our Data Services team manages the ingestion, storage, and availability of diverse datasets, enabling analysts and data scientists to generate insights that support operational and tactical decisions. We're expanding our team of Data Engineers to ingest new datasets and maintain existing ones ensuring data More ❯

to your opportunity As a practitioner, you will bridge the gap between client needs and technical solutions. Your main responsibility is to make data valuable by developing pipelines that ingest, transform, and enrich high-volume, diverse data into accessible, trusted information assets for actionable insights. You … will manage deliverables and client relationships, delivering solutions using agile methodologies across multidisciplinary teams and industries. Your responsibilities may include: Applying data engineering tools and frameworks to create standardized data for AI and reporting. Designing and implementing high-quality data pipelines and stores. Introducing … candidates with both technical and business skills who can articulate the value of their work, with experience in: End-to-end data pipeline development. Working with diverse data types and sources. Architectural design for scalable data solutions. Data modeling, warehouse design More ❯

Group Enterprise Data Architect Location: Cheltenham, UK (Hybrid working) Benefits: 27 days holiday plus Wellbeing day, Private Medical Insurance, Bonus scheme, Sharescheme, Enhanced pension plan, Life assurance, Discount scheme. Role Overview: Join Spirax Group as a Group Enterprise Data Architect , reporting directly to the Group Head … of Data and Analytics. This hybrid role requires a minimum of four days per month in Cheltenham and occasional travel. You will shape our global data strategy, influence business unit architects, and promote consistency in enterprise data architecture. Your objectives and responsibilities will focus … on Leading the strategic direction for data solutions across the Spirax Group. Collaborating with stakeholders and IS/IT teams to understand needs and deliver tailored data solutions. Mentoring Data/IT colleagues via a Community of Excellence. Building relationships with technology partners, evaluating More ❯

Experience function hiring in: United Kingdom Work Preference Option(s): Hybrid model Work from Office Join Ascent and help shape the future of data solutions by becoming a valued team member where your skills matter, your impact is significant, and your career can reach new heights. About Us … and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data science, IoT solutions, machine learning, DevOps optimization, and modernization of applications, data, and platforms. We work with incredible clients in all types of industries such as smart home devices, space exploration, beer manufacturing, finance, ecology, and logistics. We work with some of the sharpest minds in More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software More ❯

If you're a Senior Data Scientist with expertise in predictive modelling, segmentation, and data automation, and you're excited about shaping the future of data in a cloud-first environment, we want to hear from you! This is a fantastic opportunity to join … our client at the start of its major data transformation journey. Their move to the cloud with Microsoft Azure, Fabric, and Synapse technologies will see you work with cutting-edge Cloud and AI-driven analytics, making this an exciting time to be part of its data science team. The role. We are looking for a Senior Data Scientist with expertise in predictive modelling, segmentation, and data automation. You will Lead and optimize automated reporting pipelines, ensuring high performance and quality assurance. Build and deploy predictive models, enhancing customer behaviour forecasting More ❯

other locations will still be considered. Overview of the role Our ideal candidate is one that has a solid technical background and demonstrable data engineering skills gained in a practical environment; as such, those with only theoretical viewpoints will not be considered. The ideal candidate will be able … maintain an end-to-end advanced analytics solution on cloud. You will have exposure to cloud, preferably in Microsoft Azure, build and maintain data pipelines, understand CI/CD for end-to-end cloud solutions, be able to manage and maintain pre-existing ecosystems, and be competent in … Build and maintain data pipelines (including those from 3rd party sources and APIs) Identifying and patching issues and bugs identified in the pipeline/architecture Working as part of a data specialist team to deliver quality service to engagement clients Providing access and identity management More ❯

Principal Data Consultant (Snowflake/Matillion) Application Deadline: 18 June 2025 Department: Data Engineering Employment Type: Full Time Location: Bristol, UK Compensation: £85,000 - £100,000/year Description As a Principal Data Consultant, at Snap, you'll be at the forefront of our … most strategic initiatives. Your role will involve leading client engagements, managing large-scale projects, and shaping Snap's approach to modern cloud data platforms. You'll also contribute as a thought leader, developing insights and sharing expertise internally and externally while mentoring others and driving innovation across the … leader by authoring blogs, presenting at webinars, and engaging in external speaking opportunities. Technical Delivery Excellence You'll design and optimise cloud-based data architectures (e.g. Snowflake, Databricks, Redshift, Google BigQuery, Azure Synapse) to support advanced analytics. You'll build and automate scalable, secure, and high-performance data More ❯

Job Description: Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional and non-functional business requirements. We are looking for a young talent to join our team in a position with no previous experience. If you are proactive and More ❯

cyber reinsurance. Key Responsibilities Develop and optimise NLP models for tasks like information retrieval, summarisation, and other domain-specific applications. Work closely with data scientists, engineers, and domain experts to understand business needs and deliver AI-driven solutions. Stay up to date with the latest NLP technologies, including … semantic search and generative AI, and apply them to improve existing models. Build and maintain scalable data pipelines for processing both structured and unstructured data efficiently. Evaluate and fine-tune machine learning models to ensure optimal performance. Ensure models and data pipelines adhere to … their applications. Experience handling large-scale datasets and using distributed computing frameworks like Databricks or Spark. Background in insurance or cybersecurity. Understanding of data privacy regulations such as GDPR and CCPA. Salary & Benefits £40,000 - £60,000 depending on experience. Benefits include: 5% pension. 28 days holiday + More ❯

change to developing vaccines and new treatments for diseases yet their tools are still poor. Our AI powered software platform, Lumi, automates operational data capture, insights and processes in labs, augmenting scientists so they can focus on the more creative aspects of their work. Lumi is versatile and … As an AI Engineer at Reach Industries, you will be responsible for developing and implementing state-of-the-art AI models for visual data analysis and inference. Working collaboratively with cross-functional teams, your focus will be on understanding business requirements and designing optimal AI solutions. Develop and … deploy AI models for visual data analysis and inference using Python and C++, OpenVINO, OpenCV, AWS, CVAT, scikit-learn, and scipy. Collaborate with our data scientists and domain experts to understand project requirements and design optimised AI solutions. Preprocess and analyse visual data using More ❯

Linux/Unix CLI, Git, and testing. Experience with one of a major cloud platform (preferably AWS, or Azure platform). Knowledge of data governance and security best practices. Experience with Infrastructure as Code (IaC) tools like Terraform or CloudFormation It would also be great if you have … Basic familiarity with utilizing GPUs in the cloud environment Familiarity with monitoring tools and techniques for ML models and data pipelines Experience building APIs Demonstrable experience with modern CI/CD pipelines Knowledge of good DevOps and Data Engineering practices As a technology consultancy, we look More ❯

to hold at least an active SC security clearance, and be willing and eligible to obtain DV. Hexegic are looking for technically minded data and software engineers to work on an intriguing and exciting project, building and maintaining data pipelines and platforms for our customers in … a military setting. Our growing team ensure data driven projects can be rapidly prototyped and delivered in line with customer needs. About us Hexegic are a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those … with similar languages API awareness for data retrieval and integration into processing pipelines Experience of stakeholder management and requirements capture Understanding of pipeline scheduling and health checks What’s in it for you? Base salary of £50,000-£60,000 £5000 a year professional development budget Wellness More ❯

eDV Infrastructure Engineer Are you interested in building scalable, secure cloud infrastructure? Do you thrive on developing efficient data pipelines and optimising data storage solutions? If so, keep reading... A industry leading technology company is seeking an Infrastructure Engineer to join their team. This role offers … client. Salary - £50,000 Location - Cheltenham Key Responsibilities: Design, implement, and maintain scalable AWS infrastructure using Infrastructure as Code principles Develop and optimise data pipelines using technologies such as Spark, Python, and Java Collaborate with software engineers to align infrastructure with application needs Monitor and troubleshoot data More ❯