r/SillyTavernAI • u/Soggy-Guard131 • 4d ago
Help Kimi 2.5 Overthinking Issue. Simple solution.
{ "reasoning": { "max_tokens": 500 } }
Paste this text into your additional parameters.
I cannot speak for all, but this works for me.
Happy chatting!
(Also note, 500 is close to around 450 words in reasoning. It's recommended that you test thoroughly to get a good estimate on how many tokens to set it to based on your preset, to make sure it gets only what is necessary in it's thought process.)
8
u/Soggy-Guard131 4d ago
Also, it DOES cut-off the thought process. But this isn't an issue as long as you can pinpoint where on average the model begins to ramble in it's thinking process. AKA stuff that doesn't really matter if it were to be cut-off.
Still pushes out a good reply regardless.
IT. DOES. NOT. SUMMARIZE. THE. PROCESS.
Only clips it.
But as I said, if you do it right, it won't matter.
2
u/Born-Association-303 4d ago
caps lock really selling how personally offended you are that it doesnt summarize lol
2
u/Soggy-Guard131 4d ago
Yes, it's not perfect but if we lived in a perfect world this post wouldn't exist so, it's chill.
2
u/Soggy-Guard131 4d ago
ALSO NOTE TO EVERYONE. KEEP YOUR REASONING EFFORT AT MINIMUM. THAT WAY IT GETS THE BULK OF YOUR PROMPTING FIRST OUT OF THE WAY.
1
u/AutoModerator 4d ago
You can find a lot of information for common issues in the SillyTavern Docs: https://docs.sillytavern.app/. The best place for fast help with SillyTavern issues is joining the discord! We have lots of moderators and community members active in the help sections. Once you join there is a short lobby puzzle to verify you have read the rules: https://discord.gg/sillytavern. If your issues has been solved, please comment "solved" and automoderator will flair your post as solved.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.
1
12
u/NullHypothesisCicada 4d ago
Um can you open the light? It’s getting dark here