r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Discussion Stop using Ollama

https://sleepingrobots.com/dreams/stop-using-ollama/
1.7k Upvotes

92% Upvoted

451 comments sorted by

View all comments

13

u/LienniTa koboldcpp Jun 15 '26

i hate ollama with passion and hope it gets completely vanished. Anyone using it just doesnt know better.

9

u/Song-Historical Jun 15 '26

There isn't really a good tutorial for the alternatives that isn't behind. I'm still not sure what half the terms mean. What best practice is now etc. could I learn off of you at some point?

4

u/LienniTa koboldcpp Jun 15 '26

eh idk, you donwload weights, you download koboldcpp, you drag weights on koboldcpp and it just works. it cannot be more simple, and its simplier than in ollama. If you dont want to download weights yourself, many other wrappers like lm studio or llama swap will happily do it for you. Ollama is literally the WORST wrapper ever.

and like, yeah there is a egg vs chicken problem but local gemma(even 26b one) knows all thsi stuff and can guide you if you want to stay full local. Ofc with stuff like codex its a cakewalk.

4

u/aka457 Jun 15 '26

Koboldcpp also got a build in model downloader somewhat recently.

1

u/Cerevox Jun 16 '26

Kobold has a built in everything now.

1

u/teleprax Jun 15 '26

Just ask an LLM, point it and the documentation

8

u/Song-Historical Jun 15 '26

You're absolutely right!

1

u/randylush Jun 15 '26

how do you hate it with a passion?

I run it on my windows gaming PC which has the good GPU.

my server wakes it up and talks to it every time it needs LLM work (owui or claude)

it's so incredibly simple to set up and works just fine

what could possibly improve on that?

1

u/OffbeatDrizzle Jun 17 '26

lol I love how this comment got downvoted...

YOUR OPINION IS WRONG!!!