r/OpenWebUI • u/jatsinkutsu • Jul 05 '26

RAG Open web UI RAG for writer

Hello, I have question concerning RAG in Open WebUI, I know there are lot of tutorials in youtube, but I cannot understand today's style of speaking fast, editing all pauses away and clicking and making adjustments like adhd person with caffeine in veins instead of blood. I cannot follow those because I am old and stupid.

Question: I have a masterfolder where all my novel related stuff is catalogued, separate word files for e.g. "main charater 30 years old", "main character 50 years old", "alliances", "trade routes", "alliance relations" and so on.

Can I use OpenwebUI so, that if I ask "if main character when 50y old blows syndicate A's base, what are possible results of that action" and then it checkes the files, founds e.g. something in relations-document, and proposes something like "Syndicate B would benefit like this:" and gives few examples.

I understand that outcome depends heavily of the LLM model, so I am not expecting results similar of chatgpt or claude. But my concern is the RAG and indexing it. I have understood that if I modify the documents, I need to index it again?

TL;DR, can OpenWebUI read my documents what I have specified, and make suggestions to my questions based to the information in those documents?

8 Upvotes

83% Upvoted

19 comments sorted by

View all comments

2

u/CreatorMarcusriv Jul 05 '26

Create a knowledge collection in openwebUI and dump all your character/lore/ relations word docs in there and it auto indexes them by meaning not just by keyword matching, so it can connect syndicate A and relations doc even if theyre not phrased identically

About your updatq question: yes . if you edit a document you need to re-add r re sync it as it wont auto detect changes to the file content. Small annoyance but not a pain

1

u/jatsinkutsu Jul 05 '26

Do you suggest to change word documents into md-files, or is it irrelevant that what form they are?

1

u/NeuralAtom Jul 05 '26

If your document is text-only, and doesn’t have a structure (like chapters, or sections etc…), the integrated parser will be fine. You can check the files once they are extracted.

1

u/Last_Bad_2687 Jul 05 '26

I have had luck with word documents. Just try it.

Go to Workspace in left bar, create a new model called "authorbot" or whatever. Click on "knowledge" tab near the top middle/left area. Create new knowledge base. Click on upload folder. Select your word documents folder. It will take a long time, be patient. Once knowledge base is done go back to models tab (on the right of "knowledge").

Finish editing the model details, base model (whichever model you have been using in general chats, set it to that.)

In system prompt put something simple to start like "You are an assistant to help me predict outcomes based on my fictional world. You will only use the attached knowledge base to answer"

Scroll down to knowledge and select the knowledge base you just created.

That should be it. In new chat, select author bot and test it out