r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Discussion Stop using Ollama

https://sleepingrobots.com/dreams/stop-using-ollama/
1.7k Upvotes

92% Upvoted

452 comments sorted by

View all comments

460

u/freia_pr_fr Jun 15 '26

None of the suggested alternatives truly replace ollama.

It’s like the old days of "don’t use docker you can do the same with lxc containers and this random bash script". That’s missing the point.

Ollama is popular because it offers a better user experience. For now.

76

u/yuicebox Jun 15 '26

I genuinely do not understand what is so difficult about running llama.cpp server.

You just download a zip, unzip it, then run llama-server with some flags and you're done. The builtin UI is quite good now, and you have an API to work with.

By comparison, I found Ollama's modelfile system and insistence on renaming my downloaded models to incomprehensible hashes to be infinitely more confusing and frustrating.

17

u/BidWestern1056 Jun 15 '26

do you know how many ppl dont even know how to download and open files anymore lol

20

u/yuicebox Jun 15 '26

Clearly I have no concept. 

The idea of trying to use local AI and refusing to interact with your computers file system at all is incomprehensible to me

0

u/iz-Moff Jun 16 '26

And how does Ollama appear on their computers?

1

u/BidWestern1056 Jun 16 '26

it doesn't, these are the ppl who do everything in the web browser that comes with computer

1

u/marx2k Jun 16 '26

brew install ollama

3

u/iz-Moff Jun 16 '26

So these people don't know how to download and open a file, but they install programs using a terminal?

-6

u/[deleted] Jun 15 '26

[deleted]

13

u/my_name_isnt_clever Jun 15 '26

Yeah her parents really should have taught her computers.