3 of 3 Data Ingestion Jobs in Gloucestershire

next Data Engineer, you'll be managing and developing data pipelines that transform raw data into valuable insights for Roke's National Security customers, enabling downstream analytics and reporting. You'll be working with diverse data sources (batch, streaming, real-time and unstructured), applying distributed compute … techniques to handle large datasets. What You'll Do * Data pipeline development - Data ingestion and pipeline orchestration design and tooling. * Database schema design/database modelling * Data integration - Integrating and enriching data from various sources, ensuring data consistency and quality. * ETL processing design ...

data solutions company located in Cheltenham is seeking a Data Engineer to develop and operate a Data Collection Hub, ensuring reliable data ingestion and processing. The ideal candidate will have over 2 years of experience in building production software systems, with proficiency in Python ...

maintainable, and built to scale, adhering to secure development principles. Governance: Implement solutions in line with our AI governance framework, encompassing factors such as data handling, audit logging, human-in-the-loop controls, and regulatory compliance. Cost Management: Monitor and optimise LLM API usage and infrastructure costs, implementing strategies … vector databases: context windows, temperature and sampling parameters, system prompts, tool/function calling. Experience of implementing RAG pipelines end-to-end, including data ingestion, chunking strategies, embedding model selection, and retrieval tuning. Experience of implementing parsing pipelines for tasks such as document processing/ingestion, including ...