17 of 17 Data Pipeline Jobs in Gloucestershire

Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure … variety of data sources using SQL and AWS 'big data' technologies. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics. Work with stakeholders including the Executive, Product, Data … data tools: Hadoop, Spark, Kafka, etc. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with AWS cloud services: EC2, EMR, RDS, Redshift. Experience with stream-processing systems: Storm, Spark More ❯

we value so you may need to travel on occasion to any of our hub offices. About Jisc: Jisc is the UK digital, data and technology agency focused on tertiary education, research, and innovation. We are a not-for-profit organisation with a big ambition to improve lives … sectors. About the role: In this role, you will play a vital part in contributing to the design, implementation and improvement of the data pipelines for complex datasets, with a particular focus on census and international data. This role requires a strong foundation in both data engineering and platform development, with a focus on delivering innovative and scalable solutions. Responsibilities will include: Data Create and maintain robust and scalable data pipelines to ingest, process, and transform data from various sources, ensuring data and metadata quality, accuracy More ❯

Experience function hiring in: United Kingdom Work Preference Option(s): Hybrid model Work from Office Join Ascent and help shape the future of data solutions by becoming a valued team member where your skills matter, your impact is significant, and your career can reach new heights. About Us … and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data science, IoT solutions, machine learning, DevOps optimization, and modernization of applications, data, and platforms. We work with incredible clients in all types of industries such as smart home devices, space exploration, beer manufacturing, finance, ecology, and logistics. We work with some of the sharpest minds in More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

Data Engineer Hybrid: Remote/Bristol Salary: £70,000 - £75,000 About Us Duel is a SaaS company on a mission to make Brand Advocacy the industry standard playbook for building brilliant retail brands. It was founded by world record breaking adventurer and former brand ambassador Paul Archer … psychologists, brand experts, and community builders, combining cutting edge brand expertise with seasoned SaaS experience. The Role We are implementing a full-scale data warehouse using Snowflake and Kafka. To ensure long-term success, we're hiring a dedicated Data Engineer to own and maintain this … system. As our first dedicated Data Engineer, you will help shape how data is structured, accessed, and used at Duel. You'll work across multiple functions, ensuring that data is not only available but also meaningful and usable to engineers, product managers, and customer More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software More ❯

If you're a Senior Data Scientist with expertise in predictive modelling, segmentation, and data automation, and you're excited about shaping the future of data in a cloud-first environment, we want to hear from you! This is a fantastic opportunity to join … our client at the start of its major data transformation journey. Their move to the cloud with Microsoft Azure, Fabric, and Synapse technologies will see you work with cutting-edge Cloud and AI-driven analytics, making this an exciting time to be part of its data science team. The role. We are looking for a Senior Data Scientist with expertise in predictive modelling, segmentation, and data automation. You will Lead and optimize automated reporting pipelines, ensuring high performance and quality assurance. Build and deploy predictive models, enhancing customer behaviour forecasting More ❯

other locations will still be considered. Overview of the role Our ideal candidate is one that has a solid technical background and demonstrable data engineering skills gained in a practical environment; as such, those with only theoretical viewpoints will not be considered. The ideal candidate will be able … maintain an end-to-end advanced analytics solution on cloud. You will have exposure to cloud, preferably in Microsoft Azure, build and maintain data pipelines, understand CI/CD for end-to-end cloud solutions, be able to manage and maintain pre-existing ecosystems, and be competent in … Build and maintain data pipelines (including those from 3rd party sources and APIs) Identifying and patching issues and bugs identified in the pipeline/architecture Working as part of a data specialist team to deliver quality service to engagement clients Providing access and identity management More ❯

recognise, our business is our people. Job Description Over the past three years, Ultra PCS has transitioned to a new business intelligence and data architecture, centred on SQL Server, SSIS, and Power BI. We've developed an in-house Data Warehouse that serves as our OLAP … database and manages most ETL processes. Power BI is then used to consistently deliver high-quality data to our internal teams. We are Ultra Precision Control Systems Ultra PCS is a leading developer of mission and safety critical equipment in the defence and aerospace industry. Our team of … recognise, our business is our people. Job Description Over the past three years, Ultra PCS has transitioned to a new business intelligence and data architecture, centred on SQL Server, SSIS, and Power BI. We've developed an in-house Data Warehouse that serves as our OLAP More ❯

on technical innovation, strategic racing, and continuous improvement both on and off the track. We are looking for a passionate and technically capable Data Engineer to join our engineering group to help drive performance through data. Position Overview As a Data Engineer, you will play a … key role in acquiring, managing, and analyzing large volumes of motorsport and telemetry data to provide actionable insights that enhance car performance, reliability, and race strategy. Working closely with race engineers, performance analysts, and the broader technical team, you’ll support data systems during race weekends … and continuously improve processes through automation and advanced analytics. Key Responsibilities Develop, maintain, and optimize data pipelines for telemetry, video, and sensor data from Supercars. Build and manage databases and data storage systems for performance analysis. Support live data acquisition and processing More ❯

on technical innovation, strategic racing, and continuous improvement both on and off the track. We are looking for a passionate and technically capable Data Engineer to join our engineering group to help drive performance through data. Position Overview As a Data Engineer, you will play a … key role in acquiring, managing, and analyzing large volumes of motorsport and telemetry data to provide actionable insights that enhance car performance, reliability, and race strategy. Working closely with race engineers, performance analysts, and the broader technical team, you’ll support data systems during race weekends … and continuously improve processes through automation and advanced analytics. Key Responsibilities Develop, maintain, and optimize data pipelines for telemetry, video, and sensor data from Supercars. Build and manage databases and data storage systems for performance analysis. Support live data acquisition and processing More ❯

cyber reinsurance. Key Responsibilities Develop and optimise NLP models for tasks like information retrieval, summarisation, and other domain-specific applications. Work closely with data scientists, engineers, and domain experts to understand business needs and deliver AI-driven solutions. Stay up to date with the latest NLP technologies, including … semantic search and generative AI, and apply them to improve existing models. Build and maintain scalable data pipelines for processing both structured and unstructured data efficiently. Evaluate and fine-tune machine learning models to ensure optimal performance. Ensure models and data pipelines adhere to … their applications. Experience handling large-scale datasets and using distributed computing frameworks like Databricks or Spark. Background in insurance or cybersecurity. Understanding of data privacy regulations such as GDPR and CCPA. Salary & Benefits £40,000 - £60,000 depending on experience. Benefits include: 5% pension. 28 days holiday + More ❯

change to developing vaccines and new treatments for diseases yet their tools are still poor. Our AI powered software platform, Lumi, automates operational data capture, insights and processes in labs, augmenting scientists so they can focus on the more creative aspects of their work. Lumi is versatile and … As an AI Engineer at Reach Industries, you will be responsible for developing and implementing state-of-the-art AI models for visual data analysis and inference. Working collaboratively with cross-functional teams, your focus will be on understanding business requirements and designing optimal AI solutions. Develop and … deploy AI models for visual data analysis and inference using Python and C++, OpenVINO, OpenCV, AWS, CVAT, scikit-learn, and scipy. Collaborate with our data scientists and domain experts to understand project requirements and design optimised AI solutions. Preprocess and analyse visual data using More ❯

of the most exciting aerospace ventures of our time. An example of products you'll be working on is automated integration test facilities, data collection from rigs and aircraft into our data pipelines and how multimodal data is served to the business. You will … fair, we may ask you questions related to these aspects during the application process. For more information on how we will use your data, see our Legal section. More ❯

eDV Infrastructure Engineer Are you interested in building scalable, secure cloud infrastructure? Do you thrive on developing efficient data pipelines and optimising data storage solutions? If so, keep reading... A industry leading technology company is seeking an Infrastructure Engineer to join their team. This role offers … client. Salary - £50,000 Location - Cheltenham Key Responsibilities: Design, implement, and maintain scalable AWS infrastructure using Infrastructure as Code principles Develop and optimise data pipelines using technologies such as Spark, Python, and Java Collaborate with software engineers to align infrastructure with application needs Monitor and troubleshoot data More ❯