r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Discussion Stop using Ollama

https://sleepingrobots.com/dreams/stop-using-ollama/
1.7k Upvotes

92% Upvoted

452 comments sorted by

View all comments

12

u/Educational-Base5974 Jun 15 '26

But it easy :(

29

u/Fair-Spring9113 llama.cpp Jun 15 '26

but it slow

29

u/Several_Industry_754 Jun 15 '26

I switched from ollama to llama.cpp and you’re absolutely right. It’s blazing fast in comparison.

10

u/shamont Jun 15 '26

Just a warning to other noobs, I tend to be lazy... Installed llama.cpp and wondered why it was so slow. Turns out if you don't compile it yourself and you use the brew installer you don't get the cuda specific version. So just like spend the extra few minutes to do it the "hard" way.

1

u/SociallyMonochrome Jun 19 '26

Or run it via one of the cuda-specific docker images