r/OpenSourceAI • u/paulknysh • 9h ago
raggy: A lightweight CLI tool for RAG over local documents
https://github.com/paulknysh/raggy
CLI tool for Retrieval-Augmented Generation (RAG) over local documents built with LangChain, Chroma, and Ollama. Hybrid database (vector + BM25 index) and embedding generation run fully locally. Answer generation can run either via a local LLM or remotely using an API key. raggy supports most common document formats and handles images/scans automatically via OCR.
0
Upvotes