22 of 22 Data Pipeline Jobs in Gloucestershire

for both civil and defence markets, in both the UK and around the world, to enhance the capabilities of its Customers. Within the Cyber & Security Division is our Data Practice which is where this role is positioned. Leonardo's Data practice works across a diverse array of sectors including Defence, Telecommunications, Energy and Finance to help … challenging, exciting and critical challenges to the UK's digital landscape. Skills in Python and machine learning are critical to this role as well as exposure to the data lifecycle. The role will include: Building, integrating, testing and scaling models including NLP and Computer Vision Take ownership of developing, training and productionising machine learning lifecycles, adhering to best … practices, security needs and quality assurance Development of neural networks Implementing and maintaining MLops workflows Work alongside Data Engineers and DevOps Engineers to ensure continuous integration and deployment of machine learning models in production. Proactive learning and researching new technologies and software versions Working with cloud technologies and different operating systems Working closely alongside Data Engineers More ❯

recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: We’re looking for an experienced Azure Data & AI Engineer with a strong focus on advanced analytics, machine learning, and applied AI - particularly Generative AI. This role will suit a technically capable professional who combines real-world … Vault), and telemetry via Application Insights or Log Analytics. KEY RESPONSIBILITIES: Have 5+ years of technical consulting or a similar chronology of demonstrable success in coding and deploying Data and AI models onto Azure environments. At least one year using Azure Fabric Create scalable and reliable data pipelines for data processing, transformation, and storage. … Establish and enforce data governance policies and be ‘hands-on’ in exploratory data analysis to identify and measure quality gaps that are a block to Data and Ai implementation. Implement robust security measures to protect sensitive data within Azure environments. Integrate AI and machine learning models into data pipelines and More ❯

recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: We’re looking for an experienced Azure Data & AI Engineer with a strong focus on advanced analytics, machine learning, and applied AI - particularly Generative AI. This role will suit a technically capable professional who combines real-world … Vault), and telemetry via Application Insights or Log Analytics. KEY RESPONSIBILITIES: Have 5+ years of technical consulting or a similar chronology of demonstrable success in coding and deploying Data and AI models onto Azure environments. At least one year using Azure Fabric Create scalable and reliable data pipelines for data processing, transformation, and storage. … Establish and enforce data governance policies and be ‘hands-on’ in exploratory data analysis to identify and measure quality gaps that are a block to Data and Ai implementation. Implement robust security measures to protect sensitive data within Azure environments. Integrate AI and machine learning models into data pipelines and More ❯

Principal Data Engineer Location: Bristol (hybrid) Salary: Competitive + 28% pension contributions Job type: Permanent/full-time or 6-12 month contract (both options available) Essential Experience: Strong Python programming knowledge, ideally with PySpark Knowledge of the Azure Databricks platform and its functionalities Adaptable with a willingness to work flexibly as organizational needs evolve Ability to work … and external stakeholders Logical and analytical thinking skills with a pragmatic, collaborative problem-solving approach Effective communication of technical concepts to non-technical audiences Awareness of the modern data stack and related methodologies Key Responsibilities: Building and developing reusable pipelines for analytics and AI projects Driving innovation within the platform to enhance efficiency and insights Managing relationships between … IT and Data teams to expand the platform and introduce new capabilities Deploying production AI models with automated monitoring from data pipelines to model outputs Team Support Responsibilities: Extracting, loading, and transforming (ELT) data from various sources, focusing on Extract & Load Monitoring data workflows, identifying risks, setting SLIs, and configuring alerts Applying More ❯

Gloucester location - hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the Data Engineer be Doing? You will develop mission … critical data solutions and manage pipelines that transform diverse data sources into valuable insights for our client's National Security customers. You will collaborate with clients to solve complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and More ❯

New Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Gloucester Gloucester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who … to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the … Data Engineer be Doing? You will develop mission-critical data solutions and manage pipelines that transform diverse data sources into valuable insights for our client’s National Security customers. You will collaborate with clients to solve complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design More ❯

Data Engineer Hybrid working (2-3 days per week in Gloucester) £450-£550 per day (inside IR35) We are seeking a skilled, Security Cleared, Data Engineer to join our team. The ideal candidate will have a strong background in data architecture and engineering, specifically within the AWS ecosystem. You will be responsible for designing … and implementing data pipelines that support large-scale data processing and analytics. Key Responsibilities: - Develop, construct, test, and maintain data architectures and data processing systems. - Collaborate with data scientists and analysts to understand data requirements and ensure data availability. - Design and optimise data models … to support business intelligence and reporting needs. - Monitor and troubleshoot data systems to ensure high availability and performance. - Implement best practises for data management, security, and compliance. Required Skills: - Active Security Clearance - Proficiency in AWS services related to data processing and storage, such as Amazon S3, Redshift, and EMR. - Strong experience with big data More ❯

Data Engineer I am looking for a Data Engineer to join an established retailer as they look to migrate to Microsoft Fabric. They are looking to integrate a number of their data systems into one fully-scalable solution and create a brand-new data warehouse that will enable data to … you would work collaboratively with the Engineering manager and other Engineers. You will also work collaboratively with the wider IT function to enable to organisation to leverage its data and orchestrate data-driven decisions. As part of this role, you will be responsible for. Help create a scalable data platform and integrate data … integrity and a focus on GDPR at all times To be successful in this role you will have . Coding experience with Python/PySpark Data pipeline development experience utilising Azure Data Factory or Fabric Pipelines Experience working within an Azure environment such as Lakehouse Architecture, Data Lake, Delta Lake, Azure Synapse More ❯

A leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £85,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager will come from a data engineering background and … have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role you will need the following: Experience designing, improving and maintaining robust data pipelines Strong SQL programming skills. Knowledge … of other programming languages such as Python, C++ and Java beneficial Possesses a strong understanding of Snowflake - beneficial Experience managing small teams of Data Engineers Strong experience working in a cloud environment and knowledge in the following very beneficial: Microsoft Azure, Azure Data Factory and Azure DevOps Experience working in fast-paced Agile environments Creativity and More ❯

A leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £85,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager will come from a data engineering background and … have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role you will need the following: Experience designing, improving and maintaining robust data pipelines Strong SQL programming skills. Knowledge … of other programming languages such as Python, C++ and Java beneficial Possesses a strong understanding of Snowflake - beneficial Experience managing small teams of Data Engineers Strong experience working in a cloud environment and knowledge in the following very beneficial: Microsoft Azure, Azure Data Factory and Azure DevOps Experience working in fast-paced Agile environments Creativity and More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in Python, PostgreSQL, GIS analysis and visualisation. You should be someone … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from … datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software experience is highly desirable Skills: Python SQL, PostgreSQL PostGIS GIS software - QGIS, Desktop GIS packages AWS FME for data More ❯

Lead Backend Engineers (Platform Experience & Data Warehousing teams) Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland numi are proud to have partnered with a front runner in data integration technology providing fantastic experience for their clients (who are some of the biggest names in the space)! We are looking for experienced Lead Backend Engineers (PHP) to … join either Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimising end-to-end platform journeys and building impactful customer experiences. They are currently developing a data visualisation tool (dashboards) and build features primarily from scratch. The Data Warehousing team is responsible for data storage and transfer solutions … helping users streamline data transfers to data warehouses/datalakes and improving internal storage. This involves scaling, refactoring, and enhancing a complex data transfer system handling large data volumes. As a Lead Backend Engineer, you will lead the development of new features, drive high code quality, provide technical guidance, and collaborate with More ❯

Lead Backend Engineers (Platform Experience & Data Warehousing teams) Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland numi are proud to have partnered with a front runner in data integration technology providing fantastic experience for their clients (who are some of the biggest names in the space)! We are looking for experienced Lead Backend Engineers (PHP) to … join either Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimising end-to-end platform journeys and building impactful customer experiences. They are currently developing a data visualisation tool (dashboards) and build features primarily from scratch. The Data Warehousing team is responsible for data storage and transfer solutions … helping users streamline data transfers to data warehouses/datalakes and improving internal storage. This involves scaling, refactoring, and enhancing a complex data transfer system handling large data volumes. As a Lead Backend Engineer, you will lead the development of new features, drive high code quality, provide technical guidance, and collaborate with More ❯

to consider flexible working arrangements, which you can discuss with Talent Acquisition. What you'll be doing: Collaborating with cross-functional teams to identify business challenges and design data observability use cases Developing, deploying and optimizing log management pipelines using Cribl Building and maintaining comprehensive documentation, including use case requirements, workflows, and … best practices Working closely with the threat intelligence, incident response, and operations teams to design solutions that support security and operational resilience Troubleshooting and resolving complex data pipeline and log processing issues Staying up to date with industry trends, emerging technologies and technology advancements to recommend innovative solutions Due to the number of applications we expect to … What you'll bring: Previous experience of security engineering in a security operations team Proven experience with cloud SIEM technology such as Sentinel and Cribl Strong background in data engineering, log management, or observability platforms Experience with systems like Sentinel, Elasticsearch, Kafka, or similar Proficiency in data transformation, enrichment, and routing Solid scripting and automation skills More ❯

and prototyping to secure deployment and ongoing support. Key Responsibilities: Leading the design and development of Python-based software systems in a high-security setting Working closely with data scientists, analysts, and engineering teams to deliver scalable, reliable solutions Architecting secure applications and services in line with defence-grade standards Mentoring developers and enforcing best practices across code … testing, and deployment Integrating machine learning models and real-time data pipelines where applicable Collaborating with stakeholders to gather requirements and showcase technical progress Essential Skills & Experience: Proven expertise in Python development in production environments Experience in secure or regulated industries (Defence, Government, Aerospace, etc.) Solid grasp of CI/CD, containerisation (Docker/Kubernetes), and cloud or More ❯

and prototyping to secure deployment and ongoing support. Key Responsibilities: Leading the design and development of Python-based software systems in a high-security setting Working closely with data scientists, analysts, and engineering teams to deliver scalable, reliable solutions Architecting secure applications and services in line with defence-grade standards Mentoring developers and enforcing best practices across code … testing, and deployment Integrating machine learning models and real-time data pipelines where applicable Collaborating with stakeholders to gather requirements and showcase technical progress Essential Skills & Experience: Proven expertise in Python development in production environments Experience in secure or regulated industries (Defence, Government, Aerospace, etc.) Solid grasp of CI/CD, containerisation (Docker/Kubernetes), and cloud or More ❯

functionality, reliability, security. Tools: Postman, SoapUI, RestAssured, Swagger. Mobile Testing Focus on mobile app quality across Android/iOS devices. Manual and automation testing using Appium, XCUITest, TestFairy. Data/ETL Testing Ensures accurate data flow, transformation, and validation in data pipelines. Works with SQL, Informatica, Talend, SSIS, Snowflake. AI/ML Model Testing More ❯

functionality, reliability, security. Tools: Postman, SoapUI, RestAssured, Swagger. Mobile Testing Focus on mobile app quality across Android/iOS devices. Manual and automation testing using Appium, XCUITest, TestFairy. Data/ETL Testing Ensures accurate data flow, transformation, and validation in data pipelines. Works with SQL, Informatica, Talend, SSIS, Snowflake. AI/ML Model Testing More ❯

for this role are required to hold at least an active SC security clearance, and be willing and eligible to obtain DV. Hexegic are looking for technically minded data and software engineers to work on an intriguing and exciting project, building and maintaining data pipelines and platforms for our customers in a military setting. Our growing … team ensure data driven projects can be rapidly prototyped and delivered in line with customer needs. About us Hexegic are a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career. Core Responsibilities Liaise closely with … Strong python proficiency, or familiarity with similar languages API awareness for data retrieval and integration into processing pipelines Experience of stakeholder management and requirements capture Understanding of pipeline scheduling and health checks What’s in it for you? Base salary of £50,000-£60,000 £5000 a year professional development budget Wellness program 25 days annual leave More ❯

Prompt Engineer (AI & Data) – Could suit a Graduate/Junior or Experienced professional Location: Hybrid (within reach of the M4/M5/M50 ideally - my client has offices in West London & the Wye Valley on the Wales/England border so some travel to these locations will be needed) Salary: £35-90k (depending on experience) ➕ Benefits … Insurance, Employee Assistance Program, Investors in People (Gold) Are you an aspiring or experienced AI Prompt Engineer ready to develop and optimise natural language interfaces, prompt strategies and data pipelines for Healthcare Technology ? Join an innovative business with a reputation and commitment for improving the quality of people’s lives . They are on a mission to empower … and revolutionise how care is delivered to others through the effective use of intelligent support tools by leveraging LLMs, Prompt Design and Data & Knowledge Engineering . I’m seeking an AI Prompt Engineer to the join the R&D team and design, test and refine prompts , clean and map unstructured text and structured fields into usable metadata and More ❯

Prompt Engineer (AI & Data) – Could suit a Graduate/Junior or Experienced professional 📍 Location: Hybrid (within reach of the M4/M5/M50 ideally - my client has offices in West London & the Wye Valley on the Wales/England border so some travel to these locations will be needed) 💵 Salary: £35-90k (depending on experience) ➕ Benefits … Insurance, Employee Assistance Program, Investors in People (Gold) Are you an aspiring or experienced AI Prompt Engineer ready to develop and optimise natural language interfaces, prompt strategies and data pipelines for Healthcare Technology ? Join an innovative business with a reputation and commitment for improving the quality of people’s lives . They are on a mission to empower … and revolutionise how care is delivered to others through the effective use of intelligent support tools by leveraging LLMs, Prompt Design and Data & Knowledge Engineering . I’m seeking an AI Prompt Engineer to the join the R&D team and design, test and refine prompts , clean and map unstructured text and structured fields into usable metadata and More ❯

prospecting and qualification through to negotiation and deal closure. Identifying key decision-makers and internal champions within target businesses to support deal progression. Building and maintaining a strong, qualified pipeline and consistently delivering against revenue targets. Working collaboratively with the wider sales, product, and engineering teams to refine value propositions and go-to-market approaches. Delivering consultative, solution-based … sales conversations focused on operational and financial outcomes for merchants. Accurately managing Salesforce, CRM data, pipeline forecasting, and activity reporting. Requirements We'd love it if you have A proven track record in B2B sales, coupled with experience selling to mid-cap and enterprise clients - ideally within fintech, SaaS, or payments (or a similar industry focused on … about Super Payments? If applying via Otta, please provide us with your phone number here. GDPR Select When you apply to a job on this site, the personal data contained in your application will be collected by Super Payments Ltd ("Controller"), which is located at 2 Temple Back East, Temple Quay, Bristol, BS1 6EG ( and can be contacted More ❯