1 to 25 of 47 Data Pipeline Jobs in Gloucestershire

Working hours: 35 hours per week, Monday to Friday Duration: Permanent Location: Gloucester Job Ref: 203895 About the role Benefact Group is seeking a Lead Data & Analytics Engineer to join our Gloucester office. The role involves leading the design, development, and optimization of cloud-based data pipelines and analytics solutions using modern cloud technologies. You will … ensure scalable, secure, and efficient cloud data services that drive insights across the organization, providing technical leadership and strategic direction. Joining our expanding and innovative group offers a great opportunity to develop your career within an inclusive, purpose-led organization. Key responsibilities Team Leadership & Management: Manage a team of data engineers, providing mentorship and support to … ensure successful project delivery. Foster a collaborative, high-performance environment, supporting the Head of Data Operations in coordinating activities and achieving milestones. Cloud Data Engineering: Lead the design, build, and maintenance of cloud-native data pipelines using ETL/ELT, streaming, and modern data processing techniques. Data Visualisation & Analytics: Oversee More ❯

Working hours: 35 hours per week, Monday to Friday Duration: Permanent Location: Gloucester Job Ref: 203895 About the role Benefact Group , are looking for a Lead Data & Analytics Engineer to join our Gloucester office. Within the role, you willlead the design, development, and optimisation of cloud-based data pipelines and analytics solutions using modern cloud technologies. … This role involves ensuring scalable, secure, and efficient cloud data services that drive insights and knowledge across the organisation, while providing technical leadership and strategic direction. Joining our rapidly expanding and innovative Group presents a fantastic opportunity to develop your career and become an integral part of an inclusive, purpose-led organisation. Key responsibilities Team Leadership & Management: Lead … and manage a team of data engineers, providing guidance, mentorship, and support to ensure successful project delivery. Foster a collaborative and high-performance environment, encouraging continuous learning and professional development. Support the Head of Data Operations to coordinate team activities, set clear goals, and monitor progress to achieve project milestones and objectives. Cloud Data More ❯

Job Description: Working hours: 35 hours per week, Monday to Friday Duration: Permanent Location: Gloucester Job Ref: 203895 About the role Benefact Group , are looking for a Lead Data & Analytics Engineer to join our Gloucester office. Within the role, you willlead the design, development, and optimisation of cloud-based data pipelines and analytics solutions using modern … cloud technologies. This role involves ensuring scalable, secure, and efficient cloud data services that drive insights and knowledge across the organisation, while providing technical leadership and strategic direction. Joining our rapidly expanding andinnovative Group presents a fantastic opportunity to develop your career andbecome an integral part of an inclusive, purpose-led organisation. Key responsibilities Team Leadership & Management: Lead … and manage a team of data engineers, providing guidance, mentorship, and support to ensure successful project delivery. Foster a collaborative and high-performance environment, encouraging continuous learning and professional development. Support the Head of Data Operations to coordinate team activities, set clear goals, and monitor progress to achieve project milestones and objectives. Cloud Data More ❯

Lead Data Scientist (Equity Only) - 1%, Cheltenham About Luupli Luupli is a social media app 'in development' that aims to provide opportunities for diverse creators from marginalized communities. The platform will highlight their work and offer access to social media opportunities. Job Description As a Lead Data Scientist at Luupli, you will leverage AWS analytics services … to analyze data and generate insights. You will work with cross-functional teams to develop data-driven solutions and shape our data strategy to support business growth. Responsibilities Collaborate with teams to understand objectives and define analytics goals. Implement data analysis strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. … Design data pipelines and ETL processes for diverse data sources. Apply statistical and machine learning techniques for analysis and pattern recognition. Develop KPIs and dashboards using Amazon QuickSight for decision-making. Perform exploratory data analysis to identify trends and insights. Work with data engineers to optimize data architecture and governance More ❯

technologies to improve safety and the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models, perform data cleansing, transformation, and validation. Maintain accurate documentation of data … resources and troubleshooting data-related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency and reliability. Project & Improvement: Assist More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯

Social network you want to login/join with: Lead Data Scientist (Equity Only) - 1%, Gloucester col-narrow-left Client: Location: Gloucester, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: Lead Data Scientist - Equity-Only role 1% About Luupli … that aims to provide opportunities for diverse creators from marginalized communities. It will highlight their work and offer access to social media opportunities. Job Description: As a Lead Data Scientist at Luupli, you will leverage AWS analytics services to analyze data and extract insights. You will work with data engineers, product managers, and stakeholders … to develop data-driven solutions and recommendations. Your AWS expertise will shape our data strategy and support business growth. Responsibilities: Collaborate with teams to understand objectives, define data requirements, and set analytics goals. Develop data analysis strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design data pipelines More ❯

eDV Data Scientist – Contract Location: Cheltenham Security Clearance Required: EDV/UK*C Employment Type: Contract Pay Rate: £600 - £700 per day Job Summary We are looking for a mission-driven Data Scientist to join our team supporting high-impact initiatives in the Defence and National Security sector. You will apply advanced analytical techniques, machine learning … and statistical modelling to solve complex operational challenges. Working within a secure, multidisciplinary environment, you'll help deliver data-driven insights to support decision-making, threat detection, intelligence analysis, and national defence strategies. Key Responsibilities Develop and deploy data models, machine learning algorithms, and statistical analyses to support defence and national security operations. Work with structured … and unstructured data from diverse sources such as sensors, ISR feeds, satellite imagery, communications, cyber threat logs, and intelligence reports. Collaborate with domain experts, analysts, and engineers to understand mission needs and translate them into actionable data science problems. Design and build data pipelines and processes for data collection, cleansing, transformation, and More ❯

Gloucester Position ID: J0525-1566 Employment Type: Full Time CGI UK Careers – Your mission found here By playing this video you consent to Google/YouTube processing your data and using cookies – Learn more. Position Description: The Space, Defence and Intelligence business unit in CGI is a true IT Systems Integrator. We work, build, and operate bespoke, technically … end cyber capability. We work collaboratively with global technology companies, cutting edge SMEs and academia to deliver the optimal solution for each client. We're seeking a Senior Data Engineer to design and lead the implementation of data flows between operational systems and BI/analytics platforms. Our Data Services team manages the ingestion … storage, and availability of diverse datasets, enabling analysts and data scientists to generate insights that support operational and tactical decisions. We're expanding our team of Data Engineers to ingest new datasets and maintain existing ones ensuring data is well-formatted, complete, high-quality, and accessible for analysis. Your future duties and responsibilities: Lead More ❯

Job Description A small and rapidly growing Consultancy are looking for a Lead Data Scientist to join their expanding team - this is a hybrid role, requiring around 2-3 days per week either in the office or on client site, depending on requirements. Many of their clients are in the Public Sector, meaning you must be eligible for … order to apply for this role. In this role, you will lead on client projects and provide them with subject matter expertise - you'll proactively identify opportunities for data science to be used to help solve their unique challenges, and will action this appropriately. This will involve working with varied data sources, and designing and implementing … various data science and machine learning techniques and algorithms, both on-premises and on the cloud, depending on what's best for each particular client. You'll communicate your findings and insight to the client, getting involved in presentations to uncover the "story" the data is telling, and therefore what action can be taken. This role More ❯

Social network you want to login/join with: We have partnered with a company that empowers underwriters to serve their insureds more effectively. They are using advanced data intelligence tools to rebuild the way that underwriters share and exchange risk. With a current focus on the small and medium-sized businesses that power our global economy and … policy to deliver unprecedented insight into insurance pools, and their speciality portfolio is fully diversified with very low catastrophe, aggregation or systemic risk. The Role: Designing and implementing data pipelines and models, ensuring data quality and integrity. Solving challenging data integration problems, utilising optimal patterns, frameworks, query techniques, sourcing from vast and varying data sources. Building, maintaining, and optimising our Data Warehouse to support reporting and analytics needs. Collaborating with product managers, business stakeholders and engineers to understand the data needs, representing key data insights in a meaningful way. Staying up-to-date with industry trends and best practices in data modelling, database development More ❯

and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from Searchability NS&D Lead Consultant placing Security Cleared DevOps, Cloud, Data, Cyber, and Infrastructure candidates in the Southwest New Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Gloucester Gloucester location … hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep … the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the Data Engineer be Doing? You will develop mission-critical data More ❯

Vacancy Name Data & Analytics Engineering Specialist Requisition No VN3826 Time Type Full Time Location Thames Ditton Office Additional Location Country United Kingdom Job Description Technology......or technology that breathes life into work? SHL, People Science. People Answers. Are you an experienced data engineer or finance data analyst keen to move into an engineering focused role … Do you have sound SQL, data management applications know how, exposure to data visualisation tools and working knowledge of a programming language such as Python or Java? You will also need to have first class problem solving and stakeholder management experience. If this all sounds like you, the role of Data & Analytics Engineering Specialist … could be for you. You will join us on our journey towards an end-to-end digital transformation, ultimately becoming a more data-driven and digitally enabled organization. An excellent benefits package is offered in a culture where career development, with ongoing manager guidance, collaboration, flexibility, diversity, and inclusivity are all intrinsic to our culture. There is a More ❯

Social network you want to login/join with: Head of Data Engineering & Governance, gloucester col-narrow-left Client: Data Science Talent Location: gloucester, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 04.06.2025 Expiry Date: 19.07.2025 col-wide Job Description: Head of Data Engineering & Governance … client began to focus solely on wealth management. But now? This company – a trusted name in the UK financial services sector – fully recognise this. They understand that embracing data and AI is what will continue to position them at the forefront of the UK’s investment management sector. This isn’t a dalliance with data. It’s a … debate about the direction, fighting for investment or dragging people with you. Now, following a recent acquisition, they’re ready to embark on the next phase – transforming the data and harnessing its power. And that’s where you come in. Where you fit in As one of three new leaders in the newly established Group Data More ❯

Social network you want to login/join with: Head of Data Engineering & Governance, cheltenham col-narrow-left Client: Data Science Talent Location: Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 04.06.2025 Expiry Date: 19.07.2025 col-wide Job Description: Head of Data Engineering & Governance Investment & Wealth Management … client began to focus solely on wealth management. But now? This company – a trusted name in the UK financial services sector – fully recognise this. They understand that embracing data and AI is what will continue to position them at the forefront of the UK’s investment management sector. This isn’t a dalliance with data. It’s a … debate about the direction, fighting for investment or dragging people with you. Now, following a recent acquisition, they’re ready to embark on the next phase – transforming the data and harnessing its power. And that’s where you come in. Where you fit in As one of three new leaders in the newly established Group Data More ❯

Principal Data Engineer Location: Bristol (hybrid) Salary: Competitive + 28% pension contributions Job type: Permanent/full-time or 6-12 month contract (both options available) Essential Experience: Strong Python programming knowledge, ideally with PySpark Knowledge of the Azure Databricks platform and its functionalities Adaptable with a willingness to work flexibly as organizational needs evolve Ability to work … and external stakeholders Logical and analytical thinking skills with a pragmatic, collaborative problem-solving approach Effective communication of technical concepts to non-technical audiences Awareness of the modern data stack and related methodologies Key Responsibilities: Building and developing reusable pipelines for analytics and AI projects Driving innovation within the platform to enhance efficiency and insights Managing relationships between … IT and Data teams to expand the platform and introduce new capabilities Deploying production AI models with automated monitoring from data pipelines to model outputs Team Support Responsibilities: Extracting, loading, and transforming (ELT) data from various sources, focusing on Extract & Load Monitoring data workflows, identifying risks, setting SLIs, and configuring alerts Applying More ❯

Gloucester location - hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the Data Engineer be Doing? You will develop mission … critical data solutions and manage pipelines that transform diverse data sources into valuable insights for our client's National Security customers. You will collaborate with clients to solve complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and More ❯

New Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Gloucester Gloucester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who … to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the … Data Engineer be Doing? You will develop mission-critical data solutions and manage pipelines that transform diverse data sources into valuable insights for our client’s National Security customers. You will collaborate with clients to solve complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design More ❯

recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: We’re looking for an experienced Azure Data & AI Engineer with a strong focus on advanced analytics, machine learning, and applied AI - particularly Generative AI. This role will suit a technically capable professional who combines real-world … Vault), and telemetry via Application Insights or Log Analytics. KEY RESPONSIBILITIES: Have 5+ years of technical consulting or a similar chronology of demonstrable success in coding and deploying Data and AI models onto Azure environments. At least one year using Azure Fabric Create scalable and reliable data pipelines for data processing, transformation, and storage. … Establish and enforce data governance policies and be ‘hands-on’ in exploratory data analysis to identify and measure quality gaps that are a block to Data and Ai implementation. Implement robust security measures to protect sensitive data within Azure environments. Integrate AI and machine learning models into data pipelines and More ❯

Join to apply for the Azure Data Engineer role at IBM 2 days ago Be among the first 25 applicants Join to apply for the Azure Data Engineer role at IBM Introduction In this role, you’ll work in one of our IBM Consulting Client Innovation Centres (Delivery Centres), where we deliver deep technical and industry … Program, a group personal pension plan of an additional 5% of your base salary paid by us monthly to save for your future. Your Role And Responsibilities A data engineer with expertise in Azure toolset advises on, develops, and maintains data engineering solutions on the Azure Cloud ecosystem. They design, build, and operate batch and real … time data pipelines using Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub. This role also involves designing, building, and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. The data engineer is proficient in Azure Data Platform components, including More ❯

experienced and highly motivated Lead Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping the AI strategy and mentoring … machine learning team. Responsibilities: Lead the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor a team of machine learning … and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance, versioning, and documentation standards. Required Skills & Qualifications: Bachelor's or Master’s degree in Computer More ❯

experienced and highly motivated Lead Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping the AI strategy and mentoring … machine learning team. Responsibilities: Lead the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor a team of machine learning … and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance, versioning, and documentation standards. Required Skills & Qualifications: Bachelor's or Master’s degree in Computer More ❯

Social network you want to login/join with: Location: Remote (UK-based) with occasional client site visits This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The role involves working both remotely and on-site to lead analysis efforts … and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system migrations, and reporting needs. - Work closely with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops … and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive client value. Key Experience & Skills: - 5+ years in a business/data analyst role, ideally in a consultancy or commercial setting. - Strong analytical, problem More ❯

Social network you want to login/join with: Location: Remote (UK-based) with occasional client site visits This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The role involves working both remotely and on-site to lead analysis efforts … and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system migrations, and reporting needs. - Work closely with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops … and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive client value. Key Experience & Skills: - 5+ years in a business/data analyst role, ideally in a consultancy or commercial setting. - Strong analytical, problem More ❯

As a Data Engineer, you’ll be actively involved in the development of mission-critical technical solutions that focus on data services for our National Security customers. Roke is a leading technology & engineering company with clients spanning National Security, Defence, and Industry. You will work alongside our customers to solve their complex and unique challenges. As … our next Data Engineer, you’ll be managing and developing data pipelines that transform raw data into valuable insights for Roke’s National Security customers, enabling downstream analytics and reporting. You’ll be working with diverse data sources (batch, streaming, real-time, and unstructured), applying distributed compute techniques to handle large datasets. … The Key Requirements... Able to develop Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) workflows to move data from source systems to data stores. You will have used one or more supporting technologies, i.e. Apache, Kafka, NiFi, Spark, Flink, or Airflow. A history of working with SQL and NoSQL type databases (PostgreSQL, Mongo, ElasticSearch, Accumulo More ❯