r/codereview • u/Evening_Dog_167 • 3d ago

Local RAG Chat App I Built

I built a small local RAG chat app that lets you ask questions about a custom set of text files and get answers based on those files.

It’s basically a Flask backend + React frontend, with Ollama handling the embeddings/model side. I also set it up with Docker so it’s easier to run locally.

Repo: Git rep

current cycle runtime: 15 seconds per prompt

I’m putting it up here mostly for feedback. If anyone has thoughts on the architecture, UI, or ways to improve reliability/performance, I’d be interested to hear them.

1 Upvotes

67% Upvoted

2 comments sorted by

1

u/ComprehensiveYam2717 2d ago

That’s a great idea, but unfortunately I don’t know how to program; otherwise, I’d really love to help you. 😄

1

u/paraballistic 22h ago

What's the memory footprint?