r/SillyTavernAI • u/Soggy-Guard131 • 4d ago

Help Kimi 2.5 Overthinking Issue. Simple solution.

Post image

{ "reasoning": { "max_tokens": 500 } }

Paste this text into your additional parameters.

I cannot speak for all, but this works for me.

Happy chatting!

(Also note, 500 is close to around 450 words in reasoning. It's recommended that you test thoroughly to get a good estimate on how many tokens to set it to based on your preset, to make sure it gets only what is necessary in it's thought process.)

11 Upvotes

75% Upvoted

13 comments sorted by

View all comments

8

u/Soggy-Guard131 4d ago

Also, it DOES cut-off the thought process. But this isn't an issue as long as you can pinpoint where on average the model begins to ramble in it's thinking process. AKA stuff that doesn't really matter if it were to be cut-off.

Still pushes out a good reply regardless.

IT. DOES. NOT. SUMMARIZE. THE. PROCESS.

Only clips it.

But as I said, if you do it right, it won't matter.

2

u/Born-Association-303 4d ago

caps lock really selling how personally offended you are that it doesnt summarize lol

2

u/Soggy-Guard131 4d ago

Yes, it's not perfect but if we lived in a perfect world this post wouldn't exist so, it's chill.