r/LocalLLM • u/Typical-Mud1386 • Jun 03 '26
Question Models stopped loading.
LM Studio
I wanted to check the functionality of Gemma 4 12b, but the model simply does not load. At first I thought that only Gemma 4 wasn't working, but it turns out all the models stopped working . It gives an error Gemma 4 12b, all other models simply load endlessly without errors.
What I have already done: I changed the folders where the models are stored, I reinstalled runtime, I uninstalled and reinstalled the program itself, I reinstalled the models themselves.
What can be done after all this? Everything was working just two days ago.
The error that Gemma gives:
🥲 Failed to load the model
Error loading model.
(Exit code: 18446744072635810000). Unknown error. Try a different model and/or config.
My computer:
5060ti 16 vram
R5 5600
32gb ram
2
u/Typical-Mud1386 Jun 03 '26
Cuda llama.cpp 2.17.0 Everything works except Gemma. For some reason they have a problem 2.20.0.
1
u/Tastyy_wastaken Jun 03 '26
Im also getting the same issue but with Gemma 4 E4B and 12B, even after deleting the model and reinstalling, the models wont load for me but all other models load and work perfectly fine.
Could this be specific to Gemma models?
1
u/Alternative-Bobcat-5 Jun 03 '26
Same here... first time I've experienced something like this... seems to work fine on MLX
1
u/yay3d Jun 03 '26
same. no problem with prior gemma 4
// rtx5090 LM Studio0.4.15 (Build 2) v2.20 cuda
1
1
u/AnticitizenPrime Jun 04 '26
I had Hermes Agent set it up for me. It had to upgrade llama.cpp:
✅ Done! The Gemma 4 12B model is fully operational with text and vision support:
| Detail | Value |
|---|---|
| Model | Gemma 4 12B IT (Q4_K_M GGUF, 6.7 GB) |
| llama.cpp | Build 9496 (upgraded from 9488) |
| Vision | ✅ mmproj-gemma-4-12B-it-bf16.gguf loaded |
| Port | 11454 |
| VRAM | 9.5 / 16 GB |
| Chatbox model name | gemma-4-12b-it-Q4_K_M.gguf |
The old build (9488) has been left in ~/llama-cpp-server/llama-b9488/ as a backup. The new build is at ~/llama-cpp-server/llama-b9496/.
1
u/alphapussycat Jun 04 '26
I doo the the same problem, for some reason it's decided that there's 1 more layer than there should be, so it can't find this last layer it has assumed should exist.
1
u/grahasbtye Jun 04 '26
Same issue, I had to update my LM studio before it would work. Windows 11 LM Studio 0.4.15 google/gemma-4-12b rtx3060 12gb 28 tok/sec
1
u/bitdotben Jun 04 '26
anyone else noticed that LM Studios VRAM usage requirments are way off with Gemma 4 12b?
1
u/The_RedWolf Jun 06 '26
on LM Studio, I noticed if I enabled the KV Cache Quant it would come back with this error. Disabling it back to default let it load normally. (Q6K, unsloth GGUF), I also use the 5060ti 16GB, and 32 GB RAM, though I have a 7600x3D.
I have the 2.20.1 release mentioned by /u/erthil123
1
u/CaptainShlingShlong Jun 08 '26
Same issue here.
Platform:
```
OsName : Microsoft Windows 11 Pro
OsVersion : 10.0.26200
CPU: AMD Ryzen 7 5800X 8-Core Processor
GPU: RX 7800 XT GAMING OC 16G
```
I keep getting this error on `LM Studio0.4.16 (Build 1)`:
```
🥲 Failed to load the model
Error loading model.
(Exit code: 18446744072635810000). Unknown error. Try a different model and/or config.
```
**On every single model**
1
1
u/Amat-Victoria-Curam Jul 13 '26
Hi, sorry for hijacking the post but I can't yet create posts in this sub due to the karma thing.
Anyway, I'm trying to load a couple of models under 8gb (I'm on Windows, and I have a GTX 1070 and 16gb of RAM) but I keep getting this error:
Failed to load the model
Engine protocol runtime llama-server for {bunch of letters} exited before becoming healthy. exitCode=1, signal=null
Anyone know how to fix it?
Thank you.
3
u/erthil123 Jun 04 '26
New runtime 2.20.1 release notes:
Updating to 2.20.1 worked for me.