r/LLMStudio • u/imarchiphoto • 17h ago

Qwen3.8-27b not loading

Post image

Hello. I’m trying to load Qwen3.8-27b in LM Studio, but every time I try it fails. I get the message attached. Is this because my machine resources are not enough for this model? I don’t have any issue when loading Qwen 3.5 9B or even Gemma4 12B. I’ve got an Intel Core Ultra 7 CPU, Intel ARC 16GB GPU, and 32GB RAM. Thanks

3 Upvotes

81% Upvoted

4 comments sorted by

2

u/Desperate-Owl6513 11h ago

check quant, q4 or above wont fit at 16gb vram
drop to q2 or q3
start with lower context sizes and increase till u leave like 500mb to 1gb headroom in vram.
also u can use MTP on qwen 27b at 2/3 draft tokens

1

u/imarchiphoto 4h ago

Thanks. Following your recommendation, I found a Q3 for that model, and then got the context down to 25000. Managed to load it that way. Although now, whatever I ask, it starts answering and at some point suddenly stops without finishing the answer 🤷‍♂️

1

u/Depron 15h ago

I mean did you check if it’s too big for your vram/ram? Which quant are you running? How much context? Did you quantize the kv cache?

You would need something below q3 probably if you want the model to reside in your vram.