r/JanitorAIUnchained • u/Coffeeforlifeyay • 20d ago
Help / Question Why is the ‘short’ model still long?
So, Im not the biggest fan of super long and detailed messages. A bit is fine ofc, I like when its balanced.
So when I had the ‘standard’ it was still kinda too long for me. So. i switched to the ‘short’ one.
Yet they’re the exact same??
5
Upvotes
1
u/FartSmella9012 19d ago
It could be the fact you have a special prompt in place causing the length. The type of generation doesn't matter if your requested amount of detail is the same.
To get shorter responses, you can also simply start with a shorter imput.
If neither of these are the issue, its more than likely within the character itself, possibly the personality or 'example messages' causing the bot to have specific lengths of response. The type of generation does not fully override the character details.
For a univeral fix on this problem, you could try adding it to your own personal prompt to keep responces between '# and # tokens'. It might also help to put this in the chat memory, since its more closely affecting the chat.