26 to 50 of 64 Data Pipeline Jobs in Gloucestershire

Senior Data Scientist SME & AI Architect (10+ Years Experience) We are seeking a highly accomplished and results-oriented Senior Data Scientist Subject Matter Expert (SME) with over 10 years of experience to lead our advanced analytics and AI initiatives. This is a pivotal role requiring deep … technical mastery across large-scale Big Data technologies, multi-cloud environments, and cutting-edge specialized AI domains, including Generative AI, Computer Vision, and Natural Language Processing (NLP). You will be the principal technical leader, driving strategy, setting standards, and delivering high-impact solutions that transform business outcomes. ...

Senior Data Scientist SME & AI Architect (10+ Years Experience) We are seeking a highly accomplished and results-oriented Senior Data Scientist Subject Matter Expert (SME) with over 10 years of experience to lead our advanced analytics and AI initiatives. This is a pivotal role requiring deep … technical mastery across large-scale Big Data technologies, multi-cloud environments, and cutting-edge specialized AI domains, including Generative AI, Computer Vision, and Natural Language Processing (NLP). You will be the principal technical leader, driving strategy, setting standards, and delivering high-impact solutions that transform business outcomes. ...

DESCRIPTION This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring compliance with strict security standards and regulations. This … based onsite role with the option of compressed hours. The role will include: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. ...

Data Engineer Salary: £50,000 - £70,000 I am working with a leading organisation that is delivering innovative data solutions to support complex, high-impact projects. This role offers the opportunity to work on challenging and rewarding assignments where you will design and build scalable data … Python or similar programming languages. Awareness of APIs for data retrieval and integration. Experience in stakeholder management and requirements gathering. Understanding of pipeline scheduling and health checks. Some of the package/role details include: Salary up to £70,000 £5,000 annual professional development budget Wellness ...

senior Business Intelligence contractor to play a pivotal role in a greenfield Microsoft Fabric implementation, replacing a legacy on-premise SQL data warehouse across a multi-country European organisation. This is a high-impact, advisory-led role for someone who understands Azure and Fabric deeply, can confidently challenge … Doing Provide technical direction and oversight for the migration to Microsoft Fabric Act as the technical conscience of the programme - reviewing architecture, data models, pipelines, and design decisions Support development of data pipelines, Fabric workloads, and Power BI integration Validate ETL/ELT processes, migrated datasets ...

senior Business Intelligence contractor to play a pivotal role in a greenfield Microsoft Fabric implementation, replacing a legacy on-premise SQL data warehouse across a multi-country European organisation. This is a high-impact, advisory-led role for someone who understands Azure and Fabric deeply, can confidently challenge … Doing Provide technical direction and oversight for the migration to Microsoft Fabric Act as the technical conscience of the programme - reviewing architecture, data models, pipelines, and design decisions Support development of data pipelines, Fabric workloads, and Power BI integration Validate ETL/ELT processes, migrated datasets ...

Role As a Data Engineer, you’ll be responsible for designing, building, and maintaining robust data pipelines and architectures. You will work closely with stakeholders to understand complex data challenges, transform raw data into meaningful insights, and support analytics and reporting. This … includes working with batch, streaming, real-time, and unstructured data, applying distributed compute techniques to handle large datasets efficiently. Key Responsibilities Develop and maintain data ingestion pipelines and orchestration workflows Design database schemas and data models Integrate and enrich data from multiple ...

Role As a Data Engineer, you'll be responsible for designing, building, and maintaining robust data pipelines and architectures. You will work closely with stakeholders to understand complex data challenges, transform raw data into meaningful insights, and support analytics and reporting. This … includes working with batch, streaming, real-time, and unstructured data, applying distributed compute techniques to handle large datasets efficiently. Key Responsibilities Develop and maintain data ingestion pipelines and orchestration workflows Design database schemas and data models Integrate and enrich data from multiple ...

Title: Observability Engineer (Custom Data Integration) Location: Remote(UK) Key responsibilities Design and implement observability frameworks: Integrate and manage monitoring, logging, and tracing for cloud-native and on-premises systems. Data integration and ingestion: Build systems to collect and ingest data from various sources … often through APIs, and manage time-series data at scale. Develop custom solutions: Create custom dashboards, alerts, and reporting views to provide clear, actionable insights into system performance. Build status pages: Develop and maintain status pages that provide a user friendly web experience to communicate system health ...

Title: Observability Engineer (Custom Data Integration) Location: Remote(UK) Key responsibilities Design and implement observability frameworks: Integrate and manage monitoring, logging, and tracing for cloud-native and on-premises systems. Data integration and ingestion: Build systems to collect and ingest data from various sources … often through APIs, and manage time-series data at scale. Develop custom solutions: Create custom dashboards, alerts, and reporting views to provide clear, actionable insights into system performance. Build status pages: Develop and maintain status pages that provide a user friendly web experience to communicate system health ...

Working On Infrastructure Management: Docker management, Jenkins pipelines, Kubernetes deployments, VM management, and application/tool deployment. Automation: Deploy tools and scripts to data pipelines for processing incoming data, including Apache NiFi development . UI & Application Development: Build user and system interfaces to make information accessible … infrastructure, automation, or UI development. Hands-on experience with Docker , Kubernetes , Jenkins , and scripting for automation. Familiarity with Apache NiFi and data pipeline development. Ability to work collaboratively in a fast-paced environment and deliver high-quality solutions. Why Join Us? This is a chance to work ...

client, an award-winning fintech specialising in investment and insurance data solutions, is urgently seeking a Senior Data Engineer. You will work with actuarial and asset management datasets, building end-to-end data pipelines in Python (Pandas, NumPy), SQL, GCP (BigQuery), DBT, and Databricks. … This role focuses on large-scale financial data, automating processes, integrating multiple data sources, and delivering actionable insights to senior stakeholders. Only candidates with direct experience in investment, asset management, or reinsurance/insurance operations handling financial securities or actuarial outputs will be considered. Key Skills ...

Engineer bring? Strong backend development expertise with Go and additional bonus points for Node.js and Typescript Experience designing secure, scalable backend systems (authentication, data pipelines, APIs) Familiarity with modern cloud infrastructure (GCP or AWS) Ability to communicate technical ideas clearly and influence team direction A passion for building ...

powered applications from frontend to model serving Build intuitive user interfaces Develop scalable backend systems using Python and Go for model inference, data pipelines, and API services Develop sophisticated prompt engineering strategies for LLM-based features, including few-shot learning, chain-of-thought reasoning, and retrieval-augmented generation ...

powered applications from frontend to model serving Build intuitive user interfaces Develop scalable backend systems using Python and Go for model inference, data pipelines, and API services Develop sophisticated prompt engineering strategies for LLM-based features, including few-shot learning, chain-of-thought reasoning, and retrieval-augmented generation ...

Role: Data Engineer (Azure Databricks Contract) Day Rate: £250-£300 (Outside IR35) Duration: 2 months (Initially) Location: Fully Remote (UK-based candidates only) Start Date: 5th January 2026 This role will focus on Azure Databricks, revamping Salesforce integrations, modernising data pipelines, and building a new integration … layer to replace legacy systems. Key Responsibilities: Lead development and optimisation of Azure Databricks pipelines and workflows. Work with Azure Data Factory and Azure Data Streaming to ingest, transform, and deliver data in real time. Collaborate with developers to make C# modifications as part ...

Title: SC Cleared - Data Engineer (Databricks/Azure) Location: Fully Remote (UK-based) Day rate: Up to £400 a day Inside IR35 Clearance: SC Clearance required Contract Type: 12-month contract Interview Process: One stage Role Overview We are looking for an experienced Data Engineer … required to support a large-scale public sector digital transformation programme currently underway. The programme focuses on migrating data from legacy platforms into modern, cloud-based data environments. Key Responsibilities Design, develop and support data pipelines as part of a cloud migration initiative Build ...

Azure stack, including Logic Apps and Function Apps Experience with Microsoft Power Platform tools Proven experience building and maintaining API integrations and data pipelines (REST, JSON, XML, JDBC) Desirable Experience: Experience with MuleSoft Experience with Workday If this role sounds of interest, please contact Megan ...

Azure stack, including Logic Apps and Function Apps Experience with Microsoft Power Platform tools Proven experience building and maintaining API integrations and data pipelines (REST, JSON, XML, JDBC) Desirable Experience: Experience with MuleSoft Experience with Workday If this role sounds of interest, please contact Megan ...

with prompt engineering, tool calling, retrieval-augmented generation (RAG), and multi-agent workflows Experience integrating AI into real systems, APIs, event-driven architectures, data pipelines, and automation platforms (e.g. UiPath, Blue Prism) Comfortable experimenting with new models, SDKs, and platforms, and evaluating what's production-ready vs hype ...

model capabilities and protocols. Leadership & Collaboration - Collaborate on UI/UX integration, code reviews, architecture and roadmap decisions, and cross-functional work with data science, product, and commercial teams. Data Engineering - Design and maintain efficient data pipelines, ensuring smooth data flow between ...

with global AI teams in Canada and France as well as local engineering stakeholders in Gloucester. This is not a research or deep data science role — instead, you will apply software engineering fundamentals , support the integration and deployment of AI-based tools, and help uplift engineering capability through … that integrate AI/ML functionality. Build robust, high-quality Python applications used within engineering workflows. Contribute to the design and implementation of data pipelines and data storage solutions. Support troubleshooting, optimisation, and ongoing maintenance of AI-enabled systems. Lightweight AI/ML Integration Prototype ...

Lead Data Engineer – Azure/DBT/Snowflake – Gloucester/Flexible Based in Gloucester 2 days per week, the rest from home – own transport required due to office rural location 55k – 65k per annum plus discretionary bonus on offer Lead Data Engineer required for an organisation … change, transformation & investment in its systems & people. Within the role, you will play a key role in the oversight and optimisation of robust data pipelines, utilising Azure Data Services, DBT & Snowflake. You will be also responsible for the oversight and mentorship of a small team ...

awareness: you understand value propositions, return on investment, trade-offs (cost vs speed vs write-down risk), and you factor in risk, compliance, data governance when designing solutions. Key Responsibilities Lead technical discovery and scoping phases with prospective clients: understand their business, compliance, risk, operational, regulatory and data environment. Design solution architectures leveraging Aveni's products (Detect, Assist, Agents, FinLLM) plus integrations with client systems (e.g. CRM, communication tools, data pipelines). Develop, deliver, and customise demos, POCs, workshops to illustrate value, ROI, regulatory compliance, risk mitigation, etc. Collaborate with sales teams to respond ...

awareness: you understand value propositions, return on investment, trade-offs (cost vs speed vs write-down risk), and you factor in risk, compliance, data governance when designing solutions. Key Responsibilities Lead technical discovery and scoping phases with prospective clients: understand their business, compliance, risk, operational, regulatory and data environment. Design solution architectures leveraging Aveni's products (Detect, Assist, Agents, FinLLM) plus integrations with client systems (e.g. CRM, communication tools, data pipelines). Develop, deliver, and customise demos, POCs, workshops to illustrate value, ROI, regulatory compliance, risk mitigation, etc. Collaborate with sales teams to respond ...