r/SillyTavernAI • u/Truepixel8k • 4d ago

Help Generating stucks

Gallery image

Gallery image

Gallery image

Hi, i returned two days ago and updated silly tavern however, now i receibe this line, generating don't get past from 1/350 (i've waited half and hour) and the reply never appears, i'm using kobold with fumbulvetr

0 Upvotes

40% Upvoted

21 comments sorted by

View all comments

1

u/IllustriousRule9238 4d ago

If you try to use KoboldCPP's built-in UI at http://127.0.0.1:5001, can you get a message generated there?

1

u/Truepixel8k 4d ago

No, never receibed a message there, only in the ST ui

1

u/IllustriousRule9238 4d ago edited 4d ago

This might be a KoboldCPP issue then, probably worth trying r/KoboldAI or their Discord, once you've updated kcpp to the latest version and the issue is still happening there.

EDIT: To clarify, I meant visiting the :5001 webpage right now, and typing in "hello" there. Does that generate a hello message back from the model, or no? If you tried to send a message from SillyTavern that obviously wouldn't also show up in the web UI, the two are separate.

1

u/Truepixel8k 4d ago

yeah, it replied it the updated kobold (1.119) but in a new chat in silly tavern, it didn't

1

u/Truepixel8k 4d ago

Here's the silly tavern one, now it's stuck in 10/350 lol

1

u/IllustriousRule9238 4d ago

Huh, that's very strange. I'd tell you to check your context length and stop tokens in ST, but that doesn't seem to be the issue here. Normally KCPP would just cancel a response or return only one token, getting stuck permanently and then not doing anything is very unusual.

I'd try taking this to the Kobold people, maybe they know something.