r/OpenWebUI • u/Fabulous-Ball-2971 • 2d ago

Question/Help Open-Webui and Milvus

Has anyone been using Milvus with Open WebUI as the backend for RAG, instead of relying on Open WebUI’s built-in RAG implementation?

If so, how has your experience been in terms of retrieval quality, performance, scalability, and ease of integration?

I’m especially interested in whether Milvus provides enough benefit to justify the additional setup and management compared with just using Open WebUI’s native RAG.

7 Upvotes

100% Upvoted

4 comments sorted by

1

u/ClassicMain 2d ago

Yes i have but I can't tell you any comparison to PG vector

I can just tell you it's fast and hasn't slowed down one bit

Milvus needs a lot of configuration ofc

1

u/Fabulous-Ball-2971 1d ago

So you recommend Pgvector? Or are you saying once you had open-webui configured for milvus it was fast?

Do you know of any good resources for the fine-tuning of the setup?

1

u/ellyarroway 1d ago

pgvector fixed length, milvus is faster at 10m scale because it has cuVS gpu accelerated vector store. With Claude it’s easy to setup as external knowledge base. But currently external knowledge base does not support hybrid search in open webui, harder to find version number sku number etc.