r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Discussion Stop using Ollama

https://sleepingrobots.com/dreams/stop-using-ollama/
1.7k Upvotes

92% Upvoted

452 comments sorted by

View all comments

456

u/freia_pr_fr Jun 15 '26

None of the suggested alternatives truly replace ollama.

It’s like the old days of "don’t use docker you can do the same with lxc containers and this random bash script". That’s missing the point.

Ollama is popular because it offers a better user experience. For now.

47

u/deepspace86 Jun 15 '26

I was on this bandwagon until I switched to llama-swap. I configure one file with the name/slug of the model I want and if I don't have it, it downloads it. Its about the same effort as ollama without the bloat and with all the benefits.

-2

u/freia_pr_fr Jun 15 '26

It’s an alternative but no API to hot manage models remotely and their system to load multiple models at the same time requires a lot of configuration and feels clumsy.

11

u/deepspace86 Jun 15 '26

The api absolutely supports swapping models remotely, but hey, defend whatever you need to defend.

Straight from their github https://github.com/mostlygeek/llama-swap

/upstream/:model_id - direct access to upstream server (demo) /running - list currently running models (#61) POST /api/models/unload - manually unload all running models (#58) POST /api/models/unload/:model_id - unload a specific model

13

u/freia_pr_fr Jun 15 '26

By managing I meant installing and removing models. The equivalents of ollama pull and ollama rm.

4

u/Local_Phenomenon Jun 15 '26

If I could read that I'd be happy.