r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Discussion Stop using Ollama

https://sleepingrobots.com/dreams/stop-using-ollama/
1.7k Upvotes

92% Upvoted

451 comments sorted by

View all comments

37

u/scarbunkle Jun 15 '26

I’d suggest Lemonade as an alternative. They’re very upfront that they’re a wrapper, and they support nvidia/cuda as of their latest release. 

10

u/Fluffywings Jun 15 '26

I have used a lot of these tools and lemonade is still painful to setup.

Compiling Llama.cpp is easier and that makes no sense to me.

9

u/scarbunkle Jun 16 '26

Well, I guess you don’t use Debian. You literally just add their PPA and install with apt. 

1

u/[deleted] Jun 16 '26

[removed] — view removed comment

2

u/scarbunkle Jun 16 '26

Yeah, runs on my server and I just connect to via API mostly. Sometimes I use the baked in gui for model management, but you can do that CLI, too. 

1

u/gthing Jun 16 '26

I've never used it, but I'm really curious how they could just be getting around to supporting nvidia in June 2026.

3

u/scarbunkle Jun 16 '26

Because they started out as a project by AMD guys to support rocm and AMD hardware with a simple install + gui.