1 of 1 Permanent Open Source Jobs in Plymouth

X Days a week Plymouth Clearance: Active SC Essential | Sector: Defence Role Overview Defence client requires an SC Cleared AI Engineer to build fully on-premises RAG systems using open-source technologies. You'll develop classified AI capabilities on air-gapped infrastructure with zero external dependencies. Key Responsibilities - Build end-to-end RAG pipelines on isolated defence networks … using open-source LLMs (Llama 3, Mistral, Qwen) - Deploy local vector stores (Chroma, FAISS, Milvus) with sensitive document ingestion pipelines - Host and optimise LLMs using vLLM/TGI on local GPU clusters without internet connectivity - Implement agent orchestration using LangChain/LangGraph in completely offline environments - Design secure document processing for classified materials with appropriate data sanitisation - Build … monitoring and evaluation systems that operate within air-gapped infrastructure Essential Requirements - Active SC Clearance (non-negotiable) - willingness to undergo DV if required - Demonstrable experience deploying open-source LLMs (Llama, Mistral, Falcon) on-premises - Expertise with local vector databases (Chroma, FAISS, Weaviate) in offline deployments - Strong vLLM/Text Generation Inference experience for high-throughput model serving - Proven More ❯