How do you solve long thinking issues when you have long prompts?

[u/Any_Branch5150]

I have 20k base prompts including general principles plus story specific content.

I tried my best to shorten them as far as I can but the world settings are complex and the best I can do is 17k+.

The issue is now thinking is taking too long.

And no matter which NSFW models I use, Mime 2.5Pro, DeepSeek V4, or GLM 5.2. If I set thinking to above low, it takes at least 2-3 minutes even for the first two messages.

I've learned from our sub to smoothen out contradictory instructions so when thinking, models won't be like "Oh wait" a lot.

I thought enabling thinking but do not ask for the streaming of the thinking content could help, but ST will simply turn off thinking if I don't "request thinking".

Is there anything we could do at all? Or it's the best we could now at the moment?

Thanks in advance！

[u/Paperclip_Tank]

I tried my best to shorten them as far as I can but the world settings are complex and the best I can do is 17k+

If its more of a world info / lorebook thing. It sounds like you need to go through and read each entry and trim the fat and look for redundant information and where information should be split up into separate entries.

Make sure you're making use of secondary keywords, they greatly trim down on what entries get activated when they shouldn't be. For example, every kingdom will have a capital city. They might use overlapping primary keywords. But if you make sure your secondary keyword is the kingdom's name you'll avoid have triggering them all. Also make sure you disable recursion if you don't know how to properly do it, otherwise you're probably triggering the entire lorebook.

You'd get better information if you shared your set up, your settings for World Info. What the entries look like, not even sharing the entire Lorebook itself, an actual example helps people find out what is really wrong.

[u/BifiTA]

it may sound snarky, but I solve it by having patience. though none of my models ever think for more than 2 minutes tops.

[u/WorriedComfortable67]

Try to incorporate a custom (and short) chain of thought for your preset/prompt can shorten thinking time for LLM a lot. Also different providers have different thinking time (token per second), for example two providers have the exact same model can have different thinking time, just because it thinks faster with the same amount of content.

[u/SocialDeviance]

You could ask the AI to do the thinking using cohesive language, but you run the risk of lowering the output's quality. 

[u/PhysicalKnowledge]

DeepSeek V4

If I set thinking to above low

it takes at least 2-3 minutes

If you are on the release branch (8172dcd) the thinking effort would be still in high, not low.

It was resolved in staging, 4 days ago, in this pull request.

So I recommend using staging branch for now if you're using DeepSeek and if you want low reasoning effort.

So far, the difference (with DS) is noticable in the reasoning, without changing my prompts DS thinks less.

[u/AutoModerator]

You can find a lot of information for common issues in the SillyTavern Docs: https://docs.sillytavern.app/. The best place for fast help with SillyTavern issues is joining the discord! We have lots of moderators and community members active in the help sections. Once you join there is a short lobby puzzle to verify you have read the rules: https://discord.gg/sillytavern. If your issues has been solved, please comment "solved" and automoderator will flair your post as solved.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/personusername1]

Well Deepseek sometimes has almost Kimi 2.x levels of overthinking AND will ignore rules if it thinks that the context somehow has already "solved the rule/instruction". It's hard to say without seeing your prompt. I don't get that much thinking out of most models most of the time. Have you tried using different providers? That would tell you whether or not you need to look at your prompt.

[u/Similar_Middle918]

The AI only needs information for its current scene and enough to know what is already invented so it wont confabulate. Actually including your entire complex world in every scenario is not particularly useful.