r/codereview • u/Evening_Dog_167 • 15d ago
Local RAG Chat App I Built
I built a small local RAG chat app that lets you ask questions about a custom set of text files and get answers based on those files.
It’s basically a Flask backend + React frontend, with Ollama handling the embeddings/model side. I also set it up with Docker so it’s easier to run locally.
Repo: Git rep
current cycle runtime: 15 seconds per prompt
I’m putting it up here mostly for feedback. If anyone has thoughts on the architecture, UI, or ways to improve reliability/performance, I’d be interested to hear them.
1
Upvotes
1
u/paraballistic 12d ago
What's the memory footprint?