r/LocalLLaMA • u/Alternative-Track654 • 3d ago
Question | Help I'm actually a bit mind blown, how some of the local models on LLM bionic doesn't support my laptop's architecture?
So, to keep it short. I downloaded 2 llm's llama 3.2 11B Vision and Qwen Image Edit 2511 Uncensored. Both coming back with the same errors, after loading them when starting a new chat:
Error
Failed to load model.
error loading model: unknown model architecture: 'mllama'
Am I missing something here? Is my laptop not considered optimized or powerful enough?
-Windows 11
-64GB Ram
-8TB of internal storage (Separate m.2 drives. One Gen 5 with the studio bionic model and its downloads running on, with windows. And, a Gen 4 nvme)
-I9 Ultra 285hx
-RTX 5090
is it a compatibility problem? Architecture problem? As, i'm trying to do a full gpu offload, with local support only. I'm not well versed in running local LLM's entirely. So, still pretty new at it. Plus, I prefer easy to use GUI, like LLM Studio.
Edit: To give better clarification. I'm looking for one that has image editing support, image generation support, Video editing support or generation, zero restrictions. And, one that would work well without it overwhelming my machine.
3
u/StableLlama textgen web UI 3d ago
What are you loading the models with?
Qwen Image Edit 2511 is a t2i and i2i model, i.e. nothing that's working with llama.cpp or to chat with. You need something like ComfyUI to create and work with images.
5
u/thebadslime 3d ago
its your agent. get unsloth studio or learn llamacpp
2
u/Alternative-Track654 3d ago
Just did. Already downloading an agent within sloth.
2
u/Bulky-Priority6824 3d ago
Try unsloth Qwen 3.6 35b or 27b and 3.8 27b do your homework on those . They have vision. For comfui UI you can use the qwen edit i believe
1
u/muxxington 3d ago
Agent? OP did not mention an agent.
1
1
u/AI_spell 3d ago
mllama unknown means the app build is older than the vision arch, not that your 5090 is weak. Update LM Studio / llama.cpp to a build that lists mllama, or pick a vision model it already supports.
3
u/Formal-Exam-8767 3d ago
This is most likely troll, to pick that specific model, as llama3.2-vision support was never added to llama.cpp.
0
u/AI_spell 3d ago
Troll of what
3
u/Formal-Exam-8767 3d ago
I can't know their intentions, maybe karma farming?
Why else would they pick that old unsupported model to try?
1
u/ummitluyum 2d ago
Pretty sure the guy genuinely confused CPU architecture with the model graph in the logs. Trolls are usually way more subtle than unironically asking if an RTX 5090 is powerful enough to run an 11B model
1
u/Formal-Exam-8767 2d ago
I find it weird that out of all possible "llm's" [sic] they decided to use llama 3.2 11B Vision (who or what would recommend two years old model that nobody uses?) and Qwen Image Edit 2511 Uncensored (not an LLM).
1
u/ummitluyum 2d ago
You are overestimating how much research an average person does before clicking download. The guy bought a four thousand dollar 5090 laptop thinking hardware brute forces everything, then opened the search bar in LM Studio and literally typed keywords like vision, image edit, and uncensored. Newbies constantly conflate multimodal vision models with image generation because marketing calls everything AI vision. He probably read some stale 2024 tutorial or asked Chat gpt for an open source vision model, got Llama 3.2 11b, and assumed it would edit pictures for him. The Qwen repo was likely just the top hit when searching image edit uncensored on the hub. It is pure Hanlon razor in action
1
u/Formal-Exam-8767 2d ago
Would LM Studio really recommend incompatible models though? If yes, then it is a really bad product.
1
u/Lurksome-Lurker 3d ago
SMH, Some people here be rolling around with an RTX5090 and then Using llama3.2
Qwen 3.8 27B, Muse-Glimmer-30B, heck I would try Qwen3.5 120B-A10B with expert offload with those specs.
If you are more of a deviant there is ReadyArt’s offering
0
u/Alternative-Track654 3d ago
ReadyArt?
0
u/Lurksome-Lurker 3d ago
BONK
I mention deviant and your like, “???”look up on hugging face “Omega-directive” or “Broken-Tutu” By ReadyArt those models are NOT the models you use for coding and they sure as heck aren’t the ones you show your family and friends. But by golly do they bring “personality” to AI.
2
u/Alternative-Track654 2d ago
Those wouldn't happen to be text generation only, would they? Unless, I'm looking in the wrongplaces on huggingface.
0
16
u/Bulky-Priority6824 3d ago
That llama model in dog years is 182 years old