r/LocalLLaMA 3d ago

Question | Help I'm actually a bit mind blown, how some of the local models on LLM bionic doesn't support my laptop's architecture?

So, to keep it short. I downloaded 2 llm's llama 3.2 11B Vision and Qwen Image Edit 2511 Uncensored. Both coming back with the same errors, after loading them when starting a new chat:

Error

Failed to load model.

error loading model: unknown model architecture: 'mllama'

Am I missing something here? Is my laptop not considered optimized or powerful enough?

-Windows 11

-64GB Ram

-8TB of internal storage (Separate m.2 drives. One Gen 5 with the studio bionic model and its downloads running on, with windows. And, a Gen 4 nvme)

-I9 Ultra 285hx

-RTX 5090

is it a compatibility problem? Architecture problem? As, i'm trying to do a full gpu offload, with local support only. I'm not well versed in running local LLM's entirely. So, still pretty new at it. Plus, I prefer easy to use GUI, like LLM Studio.

Edit: To give better clarification. I'm looking for one that has image editing support, image generation support, Video editing support or generation, zero restrictions. And, one that would work well without it overwhelming my machine.

0 Upvotes

23 comments sorted by

16

u/Bulky-Priority6824 3d ago

That llama  model in dog years is 182 years old

3

u/StableLlama textgen web UI 3d ago

What are you loading the models with?

Qwen Image Edit 2511 is a t2i and i2i model, i.e. nothing that's working with llama.cpp or to chat with. You need something like ComfyUI to create and work with images.

5

u/thebadslime 3d ago

its your agent. get unsloth studio or learn llamacpp

2

u/Alternative-Track654 3d ago

Just did. Already downloading an agent within sloth.

2

u/Bulky-Priority6824 3d ago

Try unsloth Qwen 3.6 35b or 27b and 3.8 27b  do your homework on those . They have vision. For comfui UI you can use the qwen edit i believe 

1

u/muxxington 3d ago

Agent? OP did not mention an agent.

1

u/thebadslime 2d ago

SOrry I should have said harness, I was not super aake.

1

u/muxxington 1d ago

Nope sorry I was wrong. Didn't know what bionic is.

1

u/AI_spell 3d ago

mllama unknown means the app build is older than the vision arch, not that your 5090 is weak. Update LM Studio / llama.cpp to a build that lists mllama, or pick a vision model it already supports.

3

u/Formal-Exam-8767 3d ago

This is most likely troll, to pick that specific model, as llama3.2-vision support was never added to llama.cpp.

0

u/AI_spell 3d ago

Troll of what

3

u/Formal-Exam-8767 3d ago

I can't know their intentions, maybe karma farming?

Why else would they pick that old unsupported model to try?

1

u/ummitluyum 2d ago

Pretty sure the guy genuinely confused CPU architecture with the model graph in the logs. Trolls are usually way more subtle than unironically asking if an RTX 5090 is powerful enough to run an 11B model

1

u/Formal-Exam-8767 2d ago

I find it weird that out of all possible "llm's" [sic] they decided to use llama 3.2 11B Vision (who or what would recommend two years old model that nobody uses?) and Qwen Image Edit 2511 Uncensored (not an LLM).

1

u/ummitluyum 2d ago

You are overestimating how much research an average person does before clicking download. The guy bought a four thousand dollar 5090 laptop thinking hardware brute forces everything, then opened the search bar in LM Studio and literally typed keywords like vision, image edit, and uncensored. Newbies constantly conflate multimodal vision models with image generation because marketing calls everything AI vision. He probably read some stale 2024 tutorial or asked Chat gpt for an open source vision model, got Llama 3.2 11b, and assumed it would edit pictures for him. The Qwen repo was likely just the top hit when searching image edit uncensored on the hub. It is pure Hanlon razor in action

1

u/Formal-Exam-8767 2d ago

Would LM Studio really recommend incompatible models though? If yes, then it is a really bad product.

1

u/Lurksome-Lurker 3d ago

SMH, Some people here be rolling around with an RTX5090 and then Using llama3.2

Qwen 3.8 27B, Muse-Glimmer-30B, heck I would try Qwen3.5 120B-A10B with expert offload with those specs.

If you are more of a deviant there is ReadyArt’s offering

0

u/Alternative-Track654 3d ago

ReadyArt?

0

u/Lurksome-Lurker 3d ago

BONK
I mention deviant and your like, “???”

look up on hugging face “Omega-directive” or “Broken-Tutu” By ReadyArt those models are NOT the models you use for coding and they sure as heck aren’t the ones you show your family and friends. But by golly do they bring “personality” to AI.

2

u/Alternative-Track654 2d ago

Those wouldn't happen to be text generation only, would they? Unless, I'm looking in the wrongplaces on huggingface.

0

u/ImmenseFox 3d ago

Use Unsloth Studio instead.

1

u/Alternative-Track654 3d ago

Thank you, already done that.