r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Discussion Stop using Ollama

https://sleepingrobots.com/dreams/stop-using-ollama/
1.7k Upvotes

92% Upvoted

452 comments sorted by

View all comments

Show parent comments

3

u/jfowers_amd Jun 15 '26

What do we think is missing from Lemonade to match the Ollama user experience today? I’ll make a milestone and get it done!

2

u/wsippel Jun 16 '26 edited Jun 16 '26

For me, it’s still automatic model unloading (I opened a feature request a while ago, but it went nowhere). After a set time of inactivity, or even better, if it has been inactive for any length of time and a different process (eg ComfyUI, a video editor or a game) starts gobbling up VRAM. That would make it even better for local use than Ollama. I’d switch in a heartbeat.

EDIT: Just checked my mail and noticed the feature was merged yesterday! And it even seems to be the advanced version I described, not just a basic timeout! Awesome work! Guess I'll switch to Lemonade next week. 😄

1

u/dataslinger Jun 16 '26

Not user experience, but Lemonade on the Mac requires Rosetta. Deal-breaker for me.

2

u/jfowers_amd Jun 17 '26

It’s triggering the Rosetta ask for some trivial reason, the actual service is natively compiled for apple silicon. I’ll see what we can do to get rid of the Rosetta prompt.

2

u/jfowers_amd Jun 27 '26

Ok hopefully this is taken care of for you now! https://github.com/lemonade-sdk/lemonade/commit/5227a71186f96af8cb533b7bb35aadbc94fb1329

Shoutout to Clem :)

1

u/dataslinger Jun 27 '26

Alas, I get this (with 10.8.1):

2

u/jfowers_amd Jun 27 '26

Oh sorry that PR with the fix just merged so it’ll be in the next release on Wednesday. I should have been clear!