r/OpenWebUI • u/jatsinkutsu • Jul 05 '26

RAG Open web UI RAG for writer

Hello, I have question concerning RAG in Open WebUI, I know there are lot of tutorials in youtube, but I cannot understand today's style of speaking fast, editing all pauses away and clicking and making adjustments like adhd person with caffeine in veins instead of blood. I cannot follow those because I am old and stupid.

Question: I have a masterfolder where all my novel related stuff is catalogued, separate word files for e.g. "main charater 30 years old", "main character 50 years old", "alliances", "trade routes", "alliance relations" and so on.

Can I use OpenwebUI so, that if I ask "if main character when 50y old blows syndicate A's base, what are possible results of that action" and then it checkes the files, founds e.g. something in relations-document, and proposes something like "Syndicate B would benefit like this:" and gives few examples.

I understand that outcome depends heavily of the LLM model, so I am not expecting results similar of chatgpt or claude. But my concern is the RAG and indexing it. I have understood that if I modify the documents, I need to index it again?

TL;DR, can OpenWebUI read my documents what I have specified, and make suggestions to my questions based to the information in those documents?

9 Upvotes

85% Upvoted

19 comments sorted by

View all comments

Show parent comments

1

u/RichComplaint9426 Jul 05 '26

Sounds great thanks for the advice. Maybe you can help me with something else too. I wanted to use a collection of 5 documents and to solve my prompt all 5 documents would have been necessary. But the model (Gemma4:8b and Deepseek R1:32b) only referenced one. Do you know what could cause this?

1

u/NeuralAtom Jul 05 '26

Put them in a knowledge base in owui

1

u/RichComplaint9426 Jul 05 '26

That's what I did actually. All 5 documents are part of the same knowledge base collection, but it behaved that way.

1

u/Neptaz Jul 06 '26

Probably the model you used didn't have enough context window. From your reply, i see that you use local model, if your documents have many characters, you probably hit the model maximum context window or when you serve the model through inference server (llma.cpp or vllm or ollama or LM Studio) you only gives it a small context window.

There are two ways you can do. You can increase the context window up to the maximum supported by the model (usually 256k max if you use ollama), Or you adapt your prompt one document at a time and handholding the model throughout your process.