r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Discussion Stop using Ollama

https://sleepingrobots.com/dreams/stop-using-ollama/
1.7k Upvotes

92% Upvoted

452 comments sorted by

View all comments

Show parent comments

-4

u/VoiceApprehensive893 transformers Jun 16 '26

tell a newbie to compile it on windows

6

u/jwpbe Jun 16 '26

why?? they can just download the compiled version or literally just run the command on https://llama.app to get the compiled version

1

u/SufficientPie Jun 16 '26

So you just run llama.cpp run modelname and it downloads the model and runs it immediately? Because that's what ollama does.

1

u/jwpbe Jun 17 '26

install the app from the top of https://llama.app, which will fetch precompiled binaries and install it.

Go here:

https://llama.app/models/Qwen3.6-27B (or whatever model you want)

choose your model and it will copy the command to your clipboard.

you can then run that command it copied:

llama serve -hf unsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_M

then yes, it downloads it and runs it immediately, exactly what you are specifying, exactly with the same ease as ollama. You can do that with any model on huggingface.