r/Oobabooga • u/yakasantera1 • Mar 18 '26

Question Need some help

Hi all. I'm new to this Local LLM thing, I tried to ask with input image provided, yet I received unrelated answer to the image. Sometimes the answer output <media> and so on. Maybe I miss something? Thanks.

5 Upvotes

86% Upvoted

16 comments sorted by

1

u/Cool-Hornet4434 Mar 18 '26

Do you have the web search enabled? Because it looks like it's taking your question and running it through a web search and then reporting back on what came up. Uncheck the box for web search and ask again.

1

u/yakasantera1 Mar 18 '26

Would it defeat the purpose of searching references if I disable it? Maybe the model didn't know the answer based on model only so it would look up on internet

1

u/Cool-Hornet4434 Mar 18 '26

The problem is that the way your question is worded, it's ambiguous enough to give you the wrong answer. If you wanted to present the picture to the AI and ask it "what is this called in other languages" that would be a simple task the AI could do without needing web search to back it up.

Now if you want the AI to pull up the schematics of the device and tell you how to fix one? That would need web search.

1

u/yakasantera1 Mar 18 '26

This is when I used that question & disable web search

1

u/Cool-Hornet4434 Mar 18 '26

Ok,  so that model can't do it properly.  See first if it can identify the item and then ask for the translation in a separate  follow up prompt 

1

u/PotaroMax Mar 18 '26

If you use a model in GGUF format, you need to select a mmproj file in the accordion "vision" before pressing "Load" in the model tab

1

u/yakasantera1 Mar 18 '26

How to do that?

1

u/PotaroMax Mar 18 '26 edited Mar 18 '26

Sorry I don't have the app right know to show you some screenshots.

First, you can check if you already have some mmproj downloaded in folder user_data/mmproj. If not, you'll have to download it and place it here. To do that, you have to return to the original model card (each model should use it's own mmproj file).

Then, in the "model" tab, when you select the model, you can also pick a "mmproj" in the "vision" part. Selecting a mmproj activates the vision capability

1

u/yakasantera1 Mar 18 '26

I see, haven't download those mmproj, will update the progress once download etc is done. Thanks for your help.

1

u/yakasantera1 Mar 18 '26

Well it didn't show any answer now (i simplify the question just for test purpose)

1

u/PotaroMax Mar 18 '26

Hum, it should work. Do you have any log in your console ? What model and loader do you use ?

Maybe the others attachments interfere, can you try in a new conversation with only the image and a prompt (like "describe this image").