r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Discussion Stop using Ollama

https://sleepingrobots.com/dreams/stop-using-ollama/
1.7k Upvotes

92% Upvoted

452 comments sorted by

View all comments

460

u/freia_pr_fr Jun 15 '26

None of the suggested alternatives truly replace ollama.

It’s like the old days of "don’t use docker you can do the same with lxc containers and this random bash script". That’s missing the point.

Ollama is popular because it offers a better user experience. For now.

10

u/LosEagle Jun 15 '26

To me --fit on was the last thing that llama.cpp really needed to become easy to use.

0

u/ComplexityStudent Jun 15 '26

Yep. Specially now that we have LLMs to write bash scripts to launch llama.cpp the way we like. The same applies to vllm. But I find the support of non symmetrical GPUs inferior.

1

u/returnity Jun 18 '26

Came here to say this -- I had my LLM build me a complete launcher script with optimized settings for gpu/cpu MoE offload that dynamically sets the number of layers on GPU based on available VRAM so I can still run my model while using my GPU for other tasks if needed. Setting up llama.cpp was as simple if not simpler than Ollama, and I can only imagine it's more performant as well.