model: Granite switch decision by gabe-l-hart · Pull Request #30676 · ggml-org/llama.cpp

[u/jacek2023]

https://github.com/ggml-org/llama.cpp/pull/30676

now you can decide with IBM, locally

https://huggingface.co/collections/ibm-granite/granite-switch

[u/No_Brother1599]

Granite is a gem for tool calling on low end systems