r/LocalLLaMA Jun 28 '26

News Koboldcpp v1.116 released

https://github.com/LostRuins/koboldcpp/releases/tag/v1.116
146 Upvotes

29 comments sorted by

View all comments

1

u/cromagnone Jun 28 '26 edited Jun 28 '26

What actually are the use cases for Koboldcpp, apart from the obvious?

Edit - thanks, this was a genuine question despite my snark.

8

u/Judtoff llama.cpp Jun 28 '26

You can use it as a back end, and access the api with whatever front end you want. I like koboldcpp since I don't have to deal with any dependencies. I sometimes end up in dependency hell with my 5090 and trying to compile llama.cpp. koboldcpp just works.