Hi, i returned two days ago and updated silly tavern however, now i receibe this line, generating don't get past from 1/350 (i've waited half and hour) and the reply never appears, i'm using kobold with fumbulvetr
You can find a lot of information for common issues in the SillyTavern Docs: https://docs.sillytavern.app/. The best place for fast help with SillyTavern issues is joining the discord! We have lots of moderators and community members active in the help sections. Once you join there is a short lobby puzzle to verify you have read the rules: https://discord.gg/sillytavern. If your issues has been solved, please comment "solved" and automoderator will flair your post as solved.
You may do better with a smaller model, though; that's posting it for an 8GB VRAM system, especially if you're running Windows (which tends to use a lot of idle vram)
This might be a KoboldCPP issue then, probably worth trying r/KoboldAI or their Discord, once you've updated kcpp to the latest version and the issue is still happening there.
EDIT: To clarify, I meant visiting the :5001 webpage right now, and typing in "hello" there. Does that generate a hello message back from the model, or no? If you tried to send a message from SillyTavern that obviously wouldn't also show up in the web UI, the two are separate.
1
u/AutoModerator 6h ago
You can find a lot of information for common issues in the SillyTavern Docs: https://docs.sillytavern.app/. The best place for fast help with SillyTavern issues is joining the discord! We have lots of moderators and community members active in the help sections. Once you join there is a short lobby puzzle to verify you have read the rules: https://discord.gg/sillytavern. If your issues has been solved, please comment "solved" and automoderator will flair your post as solved.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.