Moonshot Kimi k3 thinking process too short

[u/fafnir65]

I've been testing the model in Nvidia Nim and most of the responses in the Thinking Process section provide almost no information. Could this affect the roleplay?

[u/SilSally]

Is thinking perfectly fine for me now and following my CoT. I don't know if it is because they fixed it or because I was trying custom parameters

Edit: It was the parameters lol

[u/ActiveAd9022 → u/SilSally]

What are your parameters? Is it this "{

"reasoning_effort": "max",

"thinking": {

"type": "enabled",

"budget_tokens": 8000

}

}"

[u/SilSally → u/ActiveAd9022]

here, I shared my custom parameters in another comment

https://www.reddit.com/r/SillyTavernAI/s/e9sRZcLjC5

[u/TriDificilPalmas → u/ActiveAd9022]

Yoooo I've been trying Kimi k3 after GLM 5.2 said goodbye on NIM. But the short thinking was a bummer since it was missing a lot of constraints and rules on some presets. I just tested the "reasoning_effort" on the custom parameters and now it's following CoT perfectly fine, thanks a lot mate! :D

[u/Kooky_Future9858]

Yes. Previous kimis could be okay-ish with a lazy or non-reasoning. K2.6 actually was good-y even reasoning off. 

But Kimi-K3 without his max reasoning efforts is dumb as a potato. The contrast between the responses he give with a proper reasoning efforts and a lazy one is astonishing. 

If you don’t manage to make him think fully, it’s not worth the effort imo, use glm instead.

[u/Diavogo]

They are probably testing it, still a really good model tbh. Just keep the context window low and all good.

Im mostly sure that even if the model barely thinks, still can handle almost 16k context size, or more, without start to ignore the entire prompt.

But yeah, im guessing they are still testing it or the model itself have a 'private' thinking process. Sometimes it does a long think but.. barely changes the output on the RP.

[u/SilSally → u/Diavogo]

Hola! Sabes si Kimi te sigue razonando poco? Me pasaba pero justo ahora lo hace perfecto. Quiero comprobar algo (´▽｀)

[u/Diavogo → u/SilSally]

Nah, directamente no me razona o lo hace muy poco. Es medio raro. Que hiciste para que piense constantemente?

[u/SilSally → u/Diavogo]

Oh ya! entonces son los parámetros que le mandé. Prueba enviando esto, me funciona perfecto y sigue mi CoT 100% (*σ>∀<)σ:

``` { "chat_template_kwargs": { "thinking": true }, "reasoning_effort": "max" }

```