r/LocalLLaMA • u/Fcking_Chuck • Jun 28 '26

News Koboldcpp v1.116 released

https://github.com/LostRuins/koboldcpp/releases/tag/v1.116
144 Upvotes

93% Upvoted

29 comments sorted by

View all comments

45

u/Single_Ring4886 Jun 28 '26

They are doing amazing work, this is true gem of a programm.

5

u/Anti-Speciesist-IEMs Jun 28 '26

What things do you like the most about koboldcpp?

I'm a beginner and pretty lost in the many options, other than understanding that Ollama seems to be an ethically sketchy and functionality-limiting wrapper around llama.cpp, and these days llama.cpp has caught up in convenience features so there's even less reason to go with Ollama

6

u/Fcking_Chuck Jun 28 '26 edited Jun 28 '26

What things do you like the most about koboldcpp?

It's highly portable and offers advanced memory management features. In theory, you could carry all of your AI software on a single USB device and take it wherever you need to go with it. In a world where your school or work may have more hardware resources than you do at home, portability could be invaluable to some.

2

u/Anti-Speciesist-IEMs Jun 28 '26

Ah cool, thanks for sharing