26 to 50 of 51 Data Pipeline Jobs in Gloucestershire

col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data … with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable … work with QA and analysts to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical More ❯

Principal Data Engineer Location: Bristol (hybrid) Salary: Competitive + 28% pension contributions Job type: Permanent/full-time or 6-12 month contract (both options available) Essential Experience: Strong Python programming knowledge, ideally with PySpark Knowledge of the Azure Databricks platform and its functionalities Adaptable with a willingness … analytical thinking skills with a pragmatic, collaborative problem-solving approach Effective communication of technical concepts to non-technical audiences Awareness of the modern data stack and related methodologies Key Responsibilities: Building and developing reusable pipelines for analytics and AI projects Driving innovation within the platform to enhance efficiency … and insights Managing relationships between IT and Data teams to expand the platform and introduce new capabilities Deploying production AI models with automated monitoring from data pipelines to model outputs Team Support Responsibilities: Extracting, loading, and transforming (ELT) data from various sources, focusing on More ❯

login/join with: We have partnered with a company that empowers underwriters to serve their insureds more effectively. They are using advanced data intelligence tools to rebuild the way that underwriters share and exchange risk. With a current focus on the small and medium-sized businesses that … into insurance pools, and their speciality portfolio is fully diversified with very low catastrophe, aggregation or systemic risk. The Role: Designing and implementing data pipelines and models, ensuring data quality and integrity. Solving challenging data integration problems, utilising optimal patterns, frameworks, query techniques, sourcing … from vast and varying data sources. Building, maintaining, and optimising our Data Warehouse to support reporting and analytics needs. Collaborating with product managers, business stakeholders and engineers to understand the data needs, representing key data insights in a meaningful way. Staying up More ❯

Social network you want to login/join with: Legal Data Analyst & Researcher, gloucester col-narrow-left Client: The Sponsor Legal Intelligence Platform Location: gloucester, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide … Job Description: Legal Data Analyst & Researcher (Part-Time, Remote) Location: Initially Remote moving to in-house Job Type: Part-Time (with potential to transition into Full-Time post-launch) Start Date: Mid-late June About The Sponsor The Sponsor is a legal intelligence platform designed to provide law … firms, professionals, and business leaders with a comprehensive view of the legal industry. Through curated deal data, AI-generated firm rankings, and editorially enriched insights, we help users stay ahead of the legal market. Currently in pre-launch, The Sponsor is backed by industry relevant investors and is More ❯

want to login/join with: North Scout are working in partnership with a major corporate client, we're looking to appoint a Data Operations Engineer to play a hands-on role within their established Data function. This is a great opportunity for someone with a … solid foundation in Data Operations or Engineering, who’s keen to build on their experience in a collaborative, delivery-focused setting. The role As part of a Consultancy team, you’ll be embedded within the client’s data function, helping to ensure the smooth running of … across the business to support reliable, well-documented data processes. This will include; Monitoring and supporting daily data loads and pipeline activity. Writing and refining SQL queries to transform, validate and extract data. Investigating and resolving data quality issues and anomalies. Responding to More ❯

Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Legal Data Analyst & Researcher (Part-Time, Remote) Location: Initially Remote moving to in-house Job Type: Part-Time (with potential to transition into Full-Time post … legal intelligence platform designed to provide law firms, professionals, and business leaders with a comprehensive view of the legal industry. Through curated deal data, AI-generated firm rankings, and editorially enriched insights, we help users stay ahead of the legal market. Currently in pre-launch, The Sponsor is … backed by industry relevant investors and is in the early stages of product deployment. Our mission is to modernise legal intelligence with data transparency, intuitive design, and actionable insights. As we prepare to go to market, we’re looking for a part-time Legal Data Analyst More ❯

Job Description A small and rapidly growing Consultancy are looking for a Lead Data Scientist to join their expanding team - this is a hybrid role, requiring around 2-3 days per week either in the office or on client site, depending on requirements. Many of their clients are … role. In this role, you will lead on client projects and provide them with subject matter expertise - you'll proactively identify opportunities for data science to be used to help solve their unique challenges, and will action this appropriately. This will involve working with varied data sources, and designing and implementing various data science and machine learning techniques and algorithms, both on-premises and on the cloud, depending on what's best for each particular client. You'll communicate your findings and insight to the client, getting involved in presentations to uncover More ❯

with: South Manchester – Remote (On-site just once a month MAX) Up to £60,000 + Bonus + Benefits Are you a skilled Data Engineer ready to shape the future of data in a rapidly scaling tech business? This is a great opportunity to join a … across sectors including the NHS, logistics, public safety, and retail. With their tech function now fully in-house, they’re investing heavily in data—and you’ll be at the forefront of that transformation. You’ll work directly with the CTO and Head of Engineering, helping define the … company’s data architecture, pipelines, and reporting solutions from the ground up. What You’ll Be Doing: Designing, building, and optimising scalable data pipelines, data warehouse structures, and integration processes. Implementing robust ETL solutions to consolidate data from multiple sources into the More ❯

login/join with: Location: Remote (UK-based) with occasional client site visits This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The role involves working both remotely and on … site to lead analysis efforts and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system migrations, and reporting needs. - Work closely with … both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive client More ❯

login/join with: Location: Remote (UK-based) with occasional client site visits This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The role involves working both remotely and on … site to lead analysis efforts and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system migrations, and reporting needs. - Work closely with … both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive client More ❯

As a Data Engineer, you’ll be actively involved in the development of mission-critical technical solutions that focus on data services for our National Security customers. Roke is a leading technology & engineering company with clients spanning National Security, Defence, and Industry. You will work alongside … our customers to solve their complex and unique challenges. As our next Data Engineer, you’ll be managing and developing data pipelines that transform raw data into valuable insights for Roke’s National Security customers, enabling downstream analytics and reporting. You’ll be working … with diverse data sources (batch, streaming, real-time, and unstructured), applying distributed compute techniques to handle large datasets. The Key Requirements... Able to develop Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) workflows to move data from source systems to data stores. You More ❯

which you can discuss with Talent Acquisition. What you'll be doing: Collaborating with cross-functional teams to identify business challenges and design data observability use cases Developing, deploying and optimizing log management pipelines using Cribl Building and maintaining comprehensive documentation, including use case requirements, workflows, and best … the threat intelligence, incident response, and operations teams to design solutions that support security and operational resilience Troubleshooting and resolving complex data pipeline and log processing issues Staying up to date with industry trends, emerging technologies and technology advancements to recommend innovative solutions Due to the number … experience of security engineering in a security operations team Proven experience with cloud SIEM technology such as Sentinel and Cribl Strong background in data engineering, log management, or observability platforms Experience with systems like Sentinel, Elasticsearch, Kafka, or similar Proficiency in data transformation, enrichment, and routing More ❯

Join to apply for the Azure Data Engineer role at IBM 2 days ago Be among the first 25 applicants Join to apply for the Azure Data Engineer role at IBM Introduction In this role, you’ll work in one of our IBM Consulting Client Innovation … plan of an additional 5% of your base salary paid by us monthly to save for your future. Your Role And Responsibilities A data engineer with expertise in Azure toolset advises on, develops, and maintains data engineering solutions on the Azure Cloud ecosystem. They design, build … and operate batch and real-time data pipelines using Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub. This role also involves designing, building, and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. More ❯

A leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £85,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager … will come from a data engineering background and have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role … you will need the following: Experience designing, improving and maintaining robust data pipelines Strong SQL programming skills. Knowledge of other programming languages such as Python, C++ and Java beneficial Possesses a strong understanding of Snowflake - beneficial Experience managing small teams of Data Engineers Strong experience working More ❯

A leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £85,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager … will come from a data engineering background and have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role … you will need the following: Experience designing, improving and maintaining robust data pipelines Strong SQL programming skills. Knowledge of other programming languages such as Python, C++ and Java beneficial Possesses a strong understanding of Snowflake - beneficial Experience managing small teams of Data Engineers Strong experience working More ❯

A leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £85,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager … will come from a data engineering background and have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role … you will need the following: Online job hunting tools Experience designing, improving and maintaining robust data pipelines Strong SQL programming skills. Knowledge of other programming languages such as Python, C++ and Java beneficial Possesses a strong understanding of Snowflake - beneficial Experience managing small teams of Data More ❯

Engineer who’s passionate about building intelligent systems at the intersection of law and machine learning. You’ll work closely with legal experts, data scientists, and product managers to develop AI features that tackle real legal challenges through the use of agentic GenAI. As Legal AI Engineer you … to translate domain knowledge into scalable machine learning solutions. Continuously evaluate model performance, ensuring accuracy, fairness, and compliance. Help shape the data pipeline and MLOps practices for handling sensitive legal content securely. Required Experience: Solid experience with Python and ML/NLP libraries (e.g., spaCy, Hugging Face More ❯

join their friendly, fast-moving delivery team. You'll be hands-on shaping technical architectures, leading agile teams, building smart backend systems, powerful data pipelines, and modern web apps all while making a real impact for Government clients. The role offers genuine flexibility with hybrid working, regular team More ❯

Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping … the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor … a team of machine learning and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance More ❯

Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping … the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor … a team of machine learning and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance More ❯

to hold at least an active SC security clearance, and be willing and eligible to obtain DV. Hexegic are looking for technically minded data and software engineers to work on an intriguing and exciting project, building and maintaining data pipelines and platforms for our customers in … a military setting. Our growing team ensure data driven projects can be rapidly prototyped and delivered in line with customer needs. About us Hexegic are a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those … with similar languages API awareness for data retrieval and integration into processing pipelines Experience of stakeholder management and requirements capture Understanding of pipeline scheduling and health checks What’s in it for you? Base salary of £50,000-£60,000 £5000 a year professional development budget Wellness More ❯

Social network you want to login/join with: We are seeking an experienced Principal Data Engineer to lead a team in developing and maintaining robust, scalable data pipelines, bridging on-premises and cloud environments, and delivering real-time analytics systems. This role requires deep expertise … in data engineering and streaming technologies, combined with strong leadership skills to drive the team towards achieving business objectives. You will collaborate with cross-functional teams including architecture, product, and software engineering to ensure the delivery of high-quality data solutions aligned with company goals. Requirements … 5+ years of hands-on experience in data engineering, including expertise in Python, Scala, or Java. Deep understanding of Apache Kafka for stream processing workflows (required) Proficiency in managing and optimizing databases such as PostgreSQL, MySQL, MSSQL. Familiarity with analytical databases. Familiarity with both cloud solutions (AWS preferably More ❯

and ongoing support. Key Responsibilities: Leading the design and development of Python-based software systems in a high-security setting Working closely with data scientists, analysts, and engineering teams to deliver scalable, reliable solutions Architecting secure applications and services in line with defence-grade standards Mentoring developers and … enforcing best practices across code, testing, and deployment Integrating machine learning models and real-time data pipelines where applicable Collaborating with stakeholders to gather requirements and showcase technical progress Essential Skills & Experience: Proven expertise in Python development in production environments Experience in secure or regulated industries (Defence, Government More ❯

and ongoing support. Key Responsibilities: Leading the design and development of Python-based software systems in a high-security setting Working closely with data scientists, analysts, and engineering teams to deliver scalable, reliable solutions Architecting secure applications and services in line with defence-grade standards Mentoring developers and … enforcing best practices across code, testing, and deployment Integrating machine learning models and real-time data pipelines where applicable Collaborating with stakeholders to gather requirements and showcase technical progress Essential Skills & Experience: Proven expertise in Python development in production environments Experience in secure or regulated industries (Defence, Government More ❯

right Job Views: 7 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Actian is transforming how enterprises discover, understand, and govern their data assets through our innovative data catalog and intelligence platform. Our customers rely on us to provide a seamless and scalable experience, and … management skills to ensure customers see long-term success with Actian solutions. Responsibilities: Technical Implementation & Onboarding Lead technical onboarding process for new Zeenea Data Intelligence Platform customers Develop and execute customer implementation plans ensuring smooth deployment and adoption Manage the technical setup, configuration, and deployment of Zeenea, ensuring … case studies showcasing innovative metadata implementations Skills and Expertise: 5+ years in technical implementation, consulting, professional services, or customer success in a SaaS, data management, or cloud-based environment Excellent ability to translate customer needs into actionable technical requirements Experience managing multiple concurrent implementation projects with enterprise customers More ❯