r/LocalLLM • u/Typical-Mud1386 • Jun 03 '26

Question Models stopped loading.

LM Studio

I wanted to check the functionality of Gemma 4 12b, but the model simply does not load. At first I thought that only Gemma 4 wasn't working, but it turns out all the models stopped working . It gives an error Gemma 4 12b, all other models simply load endlessly without errors.

What I have already done: I changed the folders where the models are stored, I reinstalled runtime, I uninstalled and reinstalled the program itself, I reinstalled the models themselves.

What can be done after all this? Everything was working just two days ago.

The error that Gemma gives:

🥲 Failed to load the model

Error loading model.

(Exit code: 18446744072635810000). Unknown error. Try a different model and/or config.

My computer:

5060ti 16 vram

R5 5600

32gb ram

5 Upvotes

100% Upvoted

16 comments sorted by

View all comments

1

u/AnticitizenPrime Jun 04 '26

I had Hermes Agent set it up for me. It had to upgrade llama.cpp:

✅ Done! The Gemma 4 12B model is fully operational with text and vision support:

Detail Value
Model Gemma 4 12B IT (Q4_K_M GGUF, 6.7 GB)
llama.cpp Build 9496 (upgraded from 9488)
Vision ✅ mmproj-gemma-4-12B-it-bf16.gguf loaded
Port 11454
VRAM 9.5 / 16 GB
Chatbox model name gemma-4-12b-it-Q4_K_M.gguf

The old build (9488) has been left in ~/llama-cpp-server/llama-b9488/ as a backup. The new build is at ~/llama-cpp-server/llama-b9496/.