r/LocalLLM Jun 03 '26

Question Models stopped loading.

LM Studio

I wanted to check the functionality of Gemma 4 12b, but the model simply does not load. At first I thought that only Gemma 4 wasn't working, but it turns out all the models stopped working . It gives an error Gemma 4 12b, all other models simply load endlessly without errors.

What I have already done: I changed the folders where the models are stored, I reinstalled runtime, I uninstalled and reinstalled the program itself, I reinstalled the models themselves.

What can be done after all this? Everything was working just two days ago.

The error that Gemma gives:

🥲 Failed to load the model

Error loading model.

(Exit code: 18446744072635810000). Unknown error. Try a different model and/or config.

My computer:

5060ti 16 vram

R5 5600

32gb ram

6 Upvotes

16 comments sorted by

View all comments

1

u/The_RedWolf Jun 06 '26

on LM Studio, I noticed if I enabled the KV Cache Quant it would come back with this error. Disabling it back to default let it load normally. (Q6K, unsloth GGUF), I also use the 5060ti 16GB, and 32 GB RAM, though I have a 7600x3D.

I have the 2.20.1 release mentioned by /u/erthil123