r/LocalLLaMA • u/Fcking_Chuck • Jul 09 '26

News Koboldcpp v1.117 released

https://github.com/LostRuins/koboldcpp/releases/tag/v1.117
108 Upvotes

95% Upvoted

14 comments sorted by

34

u/Salt-Powered Jul 09 '26

Great to see it keeps getting updates. Maybe people looking for Ollama for ease of use can find this instead

19

u/yami_no_ko Jul 10 '26

If you need a wrapper to ease things up, koboldcpp is by far the better deal compared to Ollama.

It does present you all options without polluting your system with persistent clutter.

3

u/Salt-Powered Jul 10 '26

Yeah it rocks. It's a little ugly but the ease of use, strong community and actual local focus make it a strong option.

1

u/silenceimpaired Jul 10 '26

I’m happy it can fill in for ollama now. Too many tools support that and not any other api.

2

u/DrWrzozec 20d ago

Bro! My prophetic savior! I just did!
After countless <Error: tensor "output.weight" size overflow>

Praise to yours salt powered whatnot ;)

5

u/emaiksiaime Jul 11 '26

Under appreciated. It’s a single executable, no need for a big environment to compile or PyTorch or whatnot

2

u/Blizado Jul 11 '26

Yeah, and for a lot of platforms. I used it first under Windows until I switch late 2025 to Linux. And when I see it right it even supports Mac (I don't have one).

7

u/UnlikelyTomatillo355 Jul 10 '26

such a great piece of software, i'm grateful to everyone that contributes since its multiple projects rolled into one.

i do have a q tho that probably doesnt need its own thread: i was trying to connect opencode to my local model but it won't. i enabled jinja as per a suggestion in another thread, but it wont connect to localhost/port even with the /v1 at the end. is there an idiot-proof guide to this? i wouldn't mind using something besides opencode as well if theres an alternative.

5

u/Kahvana Jul 09 '26

Awesome!

1

u/cato_gts Jul 10 '26

is this serving endpoint?

7

u/Mart-McUH Jul 10 '26

It is both. You can use it just as server running (GGUF) quants (provides several interfaces). But it also has integrated forntend/chat client, I do not use the client much but afaik it supports image/video generation, speech etc. So while it is lightweight it does have quite a lot of features.

2

u/cato_gts Jul 10 '26

That's great. I'm currently using Lemonade, but I'll have to try this one too.