1 to 25 of 118 Data Pipeline Jobs in Gloucestershire

EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 04.06.2025 Expiry Date: 19.07.2025 col-wide Job Description: Job Title: Senior Data Engineer Key Requirements: 4-8 years of experience from tier 1 or 2 big tech companies Job Location: Work with cutting-edge technology through … role requires a deep understanding of modern data engineering practices, real-time processing, and cloud-native solutions. Key Responsibilities: Data Pipeline Development & Management: Design, implement, and maintain scalable and reliable data pipelines to ingest, transform, and load structured, unstructured, and real-time data … environments. Machine Learning & Advanced Analytics Enablement: Collaborate with data scientists to prepare and serve features for ML models. Maintain awareness of ML pipeline integration and ensure data readiness for experimentation and deployment. Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow More ❯

EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 04.06.2025 Expiry Date: 19.07.2025 col-wide Job Description: Job Title: Senior Data Engineer Key Requirements: 4-8 years of experience from tier 1 or 2 big tech companies Job Location: Work with cutting-edge technology through … role requires a deep understanding of modern data engineering practices, real-time processing, and cloud-native solutions. Key Responsibilities: Data Pipeline Development & Management: Design, implement, and maintain scalable and reliable data pipelines to ingest, transform, and load structured, unstructured, and real-time data … environments. Machine Learning & Advanced Analytics Enablement: Collaborate with data scientists to prepare and serve features for ML models. Maintain awareness of ML pipeline integration and ensure data readiness for experimentation and deployment. Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow More ❯

Social network you want to login/join with: Duration: Contract About Us: We're seeking a skilled Data Engineering Analyst to join our team. You'll play a key role in designing, building, and maintaining our data infrastructure, ensuring seamless data flow and … insightful analytics. Key Responsibilities: Design, develop, and maintain data pipelines using Google Cloud Platform (GCP) services like BigQuery, Cloud Storage, and Cloud Dataflow. Develop and maintain reports, dashboards, and visualizations using Power BI, ensuring data-driven insights for business stakeholders. Write efficient and scalable Python code … and reporting. Strong programming skills in Python, with experience in data processing libraries like Pandas and NumPy. Experience with data pipeline development, data warehousing, and ETL processes. Strong analytical and problem-solving skills, with attention to detail and ability to work in a More ❯

Posted: 04.06.2025 Expiry Date: 19.07.2025 col-wide Job Description: You will provide expert-level troubleshooting, root cause analysis, and performance optimisation for data platforms such as Azure SQL databases, Fabric Warehouse, Onelake, Databricks, and Azure Data Factory. Purview or another MDM tool is highly desirable. Skills …/experience Bachelor’s degree in Information Technology, Computer Science, Data Management, or a related field. 4+ years of experience in data management, data operations, or IT support roles, with at least 2 years in Level 3/4 support or equivalent. Hands-on … experience with database technologies ( Azure landscape , Oracle, PostgreSQL, etc.). Industry certifications in professional data management, cloud platforms (AWS, Azure, GCP), metadata management, or database administration (e.g., Microsoft Certified: Azure Data Engineer Associate, DAMA CDMP) are desirable. Proven experience with ETL tools, data integration More ❯

myGwork – the largest global platform for the + business community. Please do not contact the recruiter directly. Number of Roles Available: 2 The Data and Insights Division is comprised of four key areas: 1. Data Governance and Intelligence 2. Data Acquisition, Quality, Strategy and … Literacy; 3. Data Insights; 4. Data Architecture, Platform and Engineering. This presents an opportunity to design a data strategy aligned with the organization's goals and execute the delivery of data effectively. D&I enables SJP to leverage value from its data through actionable insights and data led decision making. The Data Architecture, Platform and Engineering(DAPE) Division integrates architecture, platform and engineering to establish guidelines, principles and development standards aimed at building a secure, resilient data platform for the future. It plays a More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast paced organisation. You will join as a Senior Platform Data Engineer providing technical leadership to the Data Engineering team. You will work closely with our Data Scientists and business stakeholders to ensure value is delivered through our solutions. Job … environment with Spark Streaming, Kafka, DLT or Beam. Understanding of the challenges faced in the design and development of a streaming data pipeline and the different options for processing unbounded data (pubsub, message queues, event streaming etc) Understanding of the most commonly used Data More ❯

big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast paced organisation. You will join as a Senior Platform Data Engineer providing technical leadership to the Data Engineering team. You will work closely with our Data Scientists and business stakeholders to ensure value is delivered through our solutions. Job … environment with Spark Streaming, Kafka, DLT or Beam. Understanding of the challenges faced in the design and development of a streaming data pipeline and the different options for processing unbounded data (pubsub, message queues, event streaming etc) Understanding of the most commonly used Data More ❯

Data Engineer (Security Clearance) Position Description The Space, Defence and Intelligence business unit in CGI is a true IT Systems Integrator. We work, build, and operate bespoke, technically complex, mission-critical systems which help our clients keep us all safe and secure. We bring innovation to our clients … collaboratively with global technology companies, cutting edge SMEs and academia to deliver the optimal solution for each client. We're seeking a Senior Data Engineer to design and lead the implementation of data flows between operational systems and BI/analytics platforms. Our Data Services team manages the ingestion, storage, and availability of diverse datasets, enabling analysts and data scientists to generate insights that support operational and tactical decisions. We're expanding our team of Data Engineers to ingest new datasets and maintain existing ones ensuring data More ❯

hours per week, Monday to Friday Duration: Permanent Location: Gloucester Job Ref: 203895 About the role Benefact Group is seeking a Lead Data & Analytics Engineer to join our Gloucester office. The role involves leading the design, development, and optimization of cloud-based data pipelines and analytics … solutions using modern cloud technologies. You will ensure scalable, secure, and efficient cloud data services that drive insights across the organization, providing technical leadership and strategic direction. Joining our expanding and innovative group offers a great opportunity to develop your career within an inclusive, purpose-led organization. Key … responsibilities Team Leadership & Management: Manage a team of data engineers, providing mentorship and support to ensure successful project delivery. Foster a collaborative, high-performance environment, supporting the Head of Data Operations in coordinating activities and achieving milestones. Cloud Data Engineering: Lead the design, build More ❯

Data Engineer I am looking for a Data Engineer to join an established retailer as they look to migrate to Microsoft Fabric. They are looking to integrate a number of their data systems into one fully-scalable solution and create a brand-new data warehouse that will enable data to be readily available for reporting. The business have office locations around the UK, however their technology hub is based just outside of Bristol and you would work collaboratively with the Engineering manager and other Engineers. You will also work collaboratively … on GDPR at all times To be successful in this role you will have . Coding experience with Python/PySpark Data pipeline development experience utilising Azure Data Factory or Fabric Pipelines Experience working within an Azure environment such as Lakehouse Architecture, Data More ❯

join us at FPSM and be part of something bigger... What we are looking for: We are seeking a highly motivated and experienced Data Product Manager to own the strategy, roadmap, and execution of our Customer Data Platform (CDP) and Single Customer View (SCV). This … is a critical role within our rapidly growing data organization, and you will be instrumental in enabling data-driven decision-making across the business. You'll work closely with engineering, marketing, product, and other internal teams to ensure our CDP is a powerful tool for understanding … with overall business objectives and stakeholder needs. Requirements Gathering: Proactively gather, analyze, and prioritize requirements from internal stakeholders (marketing, product, analytics, etc.) for data integration, access, and utilization. Data Source Integration: Oversee the integration of various data sources into the CDP, ensuring data More ❯

join us at FPSM and be part of something bigger... What we are looking for: We are seeking a highly motivated and experienced Data Product Manager to own the strategy, roadmap, and execution of our Customer Data Platform (CDP) and Single Customer View (SCV). This … is a critical role within our rapidly growing data organization, and you will be instrumental in enabling data-driven decision-making across the business. You'll work closely with engineering, marketing, product, and other internal teams to ensure our CDP is a powerful tool for understanding … with overall business objectives and stakeholder needs. Requirements Gathering: Proactively gather, analyze, and prioritize requirements from internal stakeholders (marketing, product, analytics, etc.) for data integration, access, and utilization. Data Source Integration: Oversee the integration of various data sources into the CDP, ensuring data More ❯

London (links Piccadilly in the south to Oxford Street in the north) **Work Arrangement:** In-office only, five days a week. **Job Title:** Data Architect/Data Engineer **Experience Required:** 7-8 Years **Role Overview:** We are seeking a Senior Data Architect/Data Engineer to design and implement scalable data solutions, including real-time and ETL/ELT data pipelines. Responsibilities include optimizing our data warehouse, creating Power BI reports, and developing AI-driven solutions using OpenAI APIs. **Key Responsibilities:** - Design and implement robust real … time data pipelines from diverse sources. - Maintain a high-performance data warehouse for reporting and analytics. - Develop insightful Power BI dashboards and reports for stakeholders. - Use Azure Data Factory, Azure Functions, and Logic Apps for data integration. - Employ Python and SQL for More ❯

hours per week, Monday to Friday Duration: Permanent Location: Gloucester Job Ref: 203895 About the role Benefact Group , are looking for a Lead Data & Analytics Engineer to join our Gloucester office. Within the role, you willlead the design, development, and optimisation of cloud-based data pipelines … and analytics solutions using modern cloud technologies. This role involves ensuring scalable, secure, and efficient cloud data services that drive insights and knowledge across the organisation, while providing technical leadership and strategic direction. Joining our rapidly expanding and innovative Group presents a fantastic opportunity to develop your career … and become an integral part of an inclusive, purpose-led organisation. Key responsibilities Team Leadership & Management: Lead and manage a team of data engineers, providing guidance, mentorship, and support to ensure successful project delivery. Foster a collaborative and high-performance environment, encouraging continuous learning and professional development. Support More ❯

recruiter to learn more. Base pay range Direct message the job poster from Searchability NS&D Lead Consultant placing Security Cleared DevOps, Cloud, Data, Cyber, and Infrastructure candidates in the Southwest New Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data … hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the … delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for More ❯

Data Engineer Hybrid working (2-3 days per week in Gloucester) £450-£550 per day (inside IR35) We are seeking a skilled, Security Cleared, Data Engineer to join our team. The ideal candidate will have a strong background in data architecture and engineering, specifically … within the AWS ecosystem. You will be responsible for designing and implementing data pipelines that support large-scale data processing and analytics. Key Responsibilities: - Develop, construct, test, and maintain data architectures and data processing systems. - Collaborate with data scientists and … analysts to understand data requirements and ensure data availability. - Design and optimise data models to support business intelligence and reporting needs. - Monitor and troubleshoot data systems to ensure high availability and performance. - Implement best practises for data management, security, and More ❯

Data Engineer Hybrid working (2-3 days per week in Gloucester) 3 months £450-£550 per day (inside IR35) We are seeking a skilled, Security Cleared, Data Engineer to join our team. The ideal candidate will have a strong background in data architecture and … engineering, specifically within the AWS ecosystem. You will be responsible for designing and implementing data pipelines that support large-scale data processing and analytics. Key Responsibilities: - Develop, construct, test, and maintain data architectures and data processing systems. - Collaborate with data scientists and analysts to understand data requirements and ensure data availability. - Design and optimise data models to support business intelligence and reporting needs. - Monitor and troubleshoot data systems to ensure high availability and performance. - Implement best practises for data More ❯

make better use of it. We provide advice, support and delivery services across various industry sectors covering a multitude of areas, ranging from Data Strategy, Governance and Security to Data Platform Modernisation, Cloud and Customer Intelligence. We do everything with a view to creating tangible business … measure how we are performing and ensures we deliver the value that our customers deserve. Summary We are seeking a skilled and proactive Data Engineer with experience in Microsoft Fabric to join our growing data team. You will be responsible for developing, maintaining, and optimising data … lakehouse architectures. Hands-on experience with Power BI for data integration and visualisation. Familiarity with DevOps practices, particularly around data pipeline deployment. Good problem-solving skills and the ability to work under minimal supervision. Effective communicator with stakeholders of varying technical expertise. Learn to Earn More ❯

make better use of it. We provide advice, support and delivery services across various industry sectors covering a multitude of areas, ranging from Data Strategy, Governance and Security to Data Platform Modernisation, Cloud and Customer Intelligence. We do everything with a view to creating tangible business … measure how we are performing and ensures we deliver the value that our customers deserve. Summary We are seeking a skilled and proactive Data Engineer with experience in Microsoft Fabric to join our growing data team. You will be responsible for developing, maintaining, and optimising data … lakehouse architectures. Hands-on experience with Power BI for data integration and visualisation. Familiarity with DevOps practices, particularly around data pipeline deployment. Good problem-solving skills and the ability to work under minimal supervision. Effective communicator with stakeholders of varying technical expertise. Learn to Earn More ❯

Social network you want to login/join with: Data Operations & Governance Analyst/Engineer - Major Hedge Fund – Lucrative Total Comp Package, Cheltenham Client: Location: Job Category: Other - EU work permit required: Yes Job Views: 1 Posted: 04.06.2025 Expiry Date: 19.07.2025 Job Description: A high performing, multi-billion … dollar AUM hedge fund is looking to make a newly created Data Analyst hire into their rapidly growing centralised Data Management team. Reporting into the Global Head of Data and taking on a highly visible role within the team, the hire will work closely … transmission. This role has a highly technical/engineering focus. You will optimize the operation and quality management of the internal data pipeline, overseeing raw data onboarding to delivery of datapoints to front office/investment teams. You will utilize languages such as SQL, Python More ❯

New Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Gloucester Gloucester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL … processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data … and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the Data Engineer be Doing? You will develop mission-critical data solutions and manage pipelines that transform diverse data sources into valuable More ❯

New Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Gloucester Gloucester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL … processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data … and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the Data Engineer be Doing? You will develop mission-critical data solutions and manage pipelines that transform diverse data sources into valuable More ❯

hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the … delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for … significant growth. What will the Data Engineer be Doing? You will develop mission-critical data solutions and manage pipelines that transform diverse data sources into valuable insights for our client's National Security customers. You will collaborate with clients to solve complex challenges, utilising More ❯