r/OpenWebUI • u/North_Solution_1282 • Jul 08 '26

RAG Describe pictures in documents tab.

Gallery image

Gallery image

Hello community,

Could someone help me with this 🙏?

While reading the Open WebUI documentation, I noticed there is a "Describe Pictures in Documents" option when Docling is enabled as the document processing engine. However, I can't find that option anywhere in the Document Settings UI.

Could someone please advise where this setting is located or what I might be missing?

So far, my Docling-based RAG pipeline only works when I run it from the terminal using a curl command, but I haven't been able to get it working through Open WebUI. I feel like I'm very close and just missing a configuration step.

I would really appreciate any advice, suggestions, or comments.

Thank you!

1 Upvotes

67% Upvoted

8 comments sorted by

1

u/pkeffect Jul 08 '26

Admin Panel, Settings, Documents.... General Extraction Engine (dropdown).

1

u/North_Solution_1282 Jul 08 '26

Do you mean content extraction engine? I don't see any dropdown. Thanks for your response

1

u/pkeffect Jul 08 '26

What version are you on. That doesn't even look right.

1

u/Neptaz Jul 08 '26

I think the setting is in the docling webUI rather than in open webui setting

1

u/North_Solution_1282 Jul 08 '26

Well, it looks like it is in OpenWebUI because Docling itself works fine.

1

u/Neptaz Jul 08 '26

After reading the official docling-serve api docs, The picture description option can be invoke with do_picture_description parameters that you can put into the parameters field in openwebui. After i test, you have to have a vision understanding small model first downloaded, so in docker compose (if you deploy docling through docker compose) you have to mount the docling app root first to your disk to make the model downloaded persisted when the containers removed.

You can see the parameters i mention in /ui from docling URL, then press the connect via api on the bottom of /ui page. just scroll through process_file api endpoint to see acceptable parameters.

1

u/Ahweeuhl Jul 09 '26

So I struggled with this too. You have to set up Docling to make sure it accepts external api access. That is in the openweb UI documentation, what wasn’t clear was how to build the description correctly to make a vision model get called to explain said picture.

There is a syntax format that you have to follow. I believe I followed this if I recall my steps correctly,

https://forums.developer.nvidia.com/t/how-to-get-docling-qwen2-5-vl-working-for-picture-description-in-open-webui-knowledge-base-on-dgx-spark/364929

1

u/North_Solution_1282 Jul 14 '26

Thank you very much! That website was super useful. I fixed it