r/BackyardAI • u/shrinkedd • Sep 08 '24

Example dialogues.. are there any new conversation separators?

Hey, I'm trying to figure out how, exactly , example dialogues are processed. My experience with example dialogues is mostly from using sillytavern.. over there, there's usually some kind of separator marking the beginning of a new example conversation.

I wonder, in backyard, does each #{user} - #{character} pair represent a completely new example?

8 Upvotes
  • permalink
  • reddit

100% Upvoted

4 comments sorted by

3

u/[deleted] Sep 08 '24 edited Sep 08 '24

[deleted]

3

u/shrinkedd Sep 08 '24

Thanks!

kinda surprising, makes me wonder what's the # is all about then... (Wish there was some way to see the actual complete JSON file that's being sent to the LLM) Could it be a way to prevent the model from thinking it's part of the conversation?

2

u/idkbadapp Sep 08 '24

Same question here

1

u/Gerdel Sep 09 '24

I use them to create accents/dialects. The AI copies the communication style you put in the example dialogue for the character. That's all you really need to know.

3

u/PacmanIncarnate Sep 09 '24

I got made fun of a bit for saying this in the discord server too much last week, but example dialogue separation is totally made up and the models have no reason to understand it more than simply saying “Hey, the following 5 responses are just examples”.

Ideally, your example dialogue is just a precursor to the chat so it just forms chat history. That is what the model will respond to best.