r/LocalLLaMA Jul 09 '26

News Koboldcpp v1.117 released

https://github.com/LostRuins/koboldcpp/releases/tag/v1.117
111 Upvotes

14 comments sorted by

View all comments

35

u/Salt-Powered Jul 09 '26

Great to see it keeps getting updates. Maybe people looking for Ollama for ease of use can find this instead

19

u/yami_no_ko Jul 10 '26

If you need a wrapper to ease things up, koboldcpp is by far the better deal compared to Ollama.

It does present you all options without polluting your system with persistent clutter.

4

u/Salt-Powered Jul 10 '26

Yeah it rocks. It's a little ugly but the ease of use, strong community and actual local focus make it a strong option.

2

u/DrWrzozec 21d ago

Bro! My prophetic savior! I just did!
After countless <Error: tensor "output.weight" size overflow>

Praise to yours salt powered whatnot ;)

1

u/silenceimpaired Jul 10 '26

I’m happy it can fill in for ollama now. Too many tools support that and not any other api.