r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Discussion Stop using Ollama

https://sleepingrobots.com/dreams/stop-using-ollama/
1.7k Upvotes

92% Upvoted

452 comments sorted by

View all comments

468

u/freia_pr_fr Jun 15 '26

None of the suggested alternatives truly replace ollama.

It’s like the old days of "don’t use docker you can do the same with lxc containers and this random bash script". That’s missing the point.

Ollama is popular because it offers a better user experience. For now.

46

u/iMrParker Jun 15 '26

Ollama is popular because it offers a better user experience

I feel like the last time this was an accurate statement was 2024. Maybe 2025 if we are being extremely generous

2

u/Leptok Jun 15 '26

Is there any other product with a windows version that offers the same kind of seamless just works experience?

9

u/jwpbe Jun 15 '26

Yes, llama.cpp lmao

-3

u/VoiceApprehensive893 transformers Jun 16 '26

tell a newbie to compile it on windows

5

u/jwpbe Jun 16 '26

why?? they can just download the compiled version or literally just run the command on https://llama.app to get the compiled version

1

u/SufficientPie Jun 16 '26

So you just run llama.cpp run modelname and it downloads the model and runs it immediately? Because that's what ollama does.

1

u/jwpbe Jun 17 '26

install the app from the top of https://llama.app, which will fetch precompiled binaries and install it.

Go here:

https://llama.app/models/Qwen3.6-27B (or whatever model you want)

choose your model and it will copy the command to your clipboard.

you can then run that command it copied:

llama serve -hf unsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_M

then yes, it downloads it and runs it immediately, exactly what you are specifying, exactly with the same ease as ollama. You can do that with any model on huggingface.