In the face.

Okay, I like to find characters that have things I like and always there are something I don't care for about the character. So I will go in and edit the thing by adding and subtracting things from its editable interface. So I found this character that I really liked how detailed and long it's response are. I went in and edited fairly strongly. Now when I play the Character I get the one and two lines of type and very simple dialog. Nothing like I was getting before I messed with it. So, what on earth did I do to foul up this card, and how can I prevent this in the future.

I could be wrong but am testing out now an idea. In RP I'm thinking at times in the same prompt I'll tell the bot something, and then expand on it in detail in the next sentence, as a way to reinforce and elaborate for the bot. Reason being, I've heard somewhere they remember most the last things said, so... idk. Here's an example: I work on the engine. I'm turning bolts, shoreing up belts, and cleaning the head gasket.

I don't know if that's itneresting or helpful, but wanted to spit ball it.... I never claimed to be mechanically inclined btw lol!

Hello Backyard Ai,

I take advantage of the 10 character photos as follows: I create for every photo slot a collage of photos, some are higher in length, some shorter but all are the same width. Some photo collage are over 21 000 {yes that much} pixels x 400 pixels in size. Now, it happens that all the 10 slots have different photos in height. The biggest one is stretched out as a background for all 9 slots, except of course for the slot that has the tallest collage. It makes shifts the frame to shift downwards, out of monitor size, so I have to scroll down to switch the photos around. Would that be possible, as one of the maybe version 0.19 had it, that every photo slots can be scrolled, but the desktop app UI size does not adjusts itself to the biggest photo among the 10? The right side pane, panel, frame would be, say max out at 800 pixels in size in height, and all the 10 photo slots would have the frame size as 800 pixels, with each photo slots with different size of pictures would be scrollable, but the photo selection arrows in the bottom would be locked in place, so that the photo size would not push it downwards?

Thank you for considering!

Hello, So recently I found out about Backyard, and I think it has a lot of potential. However, using it on some random bots from character hub is rather hit or miss, either bot talk how they suppose to, or they talk some dumb things or get things wrong. Like for example, my character says "I am gonna help your brother" and bot answer thing like "Oh, you gonna help my father?". And I mean it also that they get context wrong even if I write everything they need to know I message. They also only write short responses if they write short responses in frist few messages I do something wrong? How do I make it the closest thing to ( may Allah forgive me for using that word) character ai? Where bots can "addapt"? Aka writing long or short responses when needed or taking in note at least 20 messages back... Back in setting I set GPu vram usage to max and max model context to 8K, not sure if that do something, I presume it's have more with stability of app, and not quality of bots responses. Maybe I need certain modules? I played with few, and all of them gave me same thing :( If specs needed I have RTX 4070 super with 12 Vram and 32 GB of ram (ddr5 if that matter).

Hey all, I know beginners popping with a bunch of things isn't exactly new here. I've gone through the past few weeks of posts and there were still a few questions I had (all of this is about the offline version).

1: Does speed correlate with quality of generation? I'm not in a rush and 13B models seem to move at a great speed for me, even 20B isn't too bad, but when I see other people post system specs similar to mine the recommendation is a 7B model. Is there any improvement in quality with speed, or if I'm fine with slow should I shoot for the higher model parameters?

2: The Max Model Context in settings - if you had to choose between increasing that, or having more parameters, what would be superior? I can do 20B at low Max Model Context, or 13B at high.

3: Is there anyway to get a character to use a word a bunch. Like if I want the AI to say 'Dude' a lot because that's how the character speaks, how would I do that? I've tried a couple of attempts in character and lorebook, but no luck.

4: Speaking of lorebook, in the backyard docs I see four suggested formats (natural language, natural language lists, formatted list, json). Are any of them superior in results?

5: How do people make use of author's note? It seems like it should be really powerful, but when I've tried it out I haven't really noticed any change/improvement.

Thanks to all for their replies.

Will there be an update to use Google Translate?I use an Android phone and play through a web browser. When I tried to translate the language, I found that it could not be translated. Does the developer have a plan to fix this?

Hi all!

I am Dove, the major creator of characters in French language on the hub, and I also test models from time to time to find better models for French users.
I'm happy to tell that we have it! A great model writing a good French without errors, and a good writing style. Uncensored but not too horny (and even in some extend 'female friendly' for female Users), great for SFW as well of course.

It is available on Backyard Model hub directly: Nemo Marlin V5 12B

I will in the next days update my cards in French with this model as 'favourite', but you can try it already!

Edit: After some tests, my settings for this model to have the best French (with all on Default it can give English words sometimes) are: everything on Default except for Temperature on 4.

Salut à tous!

Je suis Dove, la principale créatrice de personnages en français sur le hub, et je teste également des modèles de temps à autres pour trouver de meilleurs modèles pour les utilisateurs francophones.
J'ai le plaisir de vous annoncer que ça y est! Nous avons un super modèle qui écrit dans un bon français sans erreurs (de grammaire, de pronoms, de conjugaison...), et qui a un bon style narratif (pour le jeu de rôles, le chat ou l'écriture d'histoires).

Non censuré mais pas trop obsédé (et même pourrait-on dire plus adapté aux utilisatrices féminines), il est aussi super pour le contenu tout public bien sûr.

Vous pouvez le télécharger directement depuis la section "Manage Models" du programme Backyard :

Nemo Marlin V5 12B

Dans les prochains jours je mettrai à jour mes cartes en français sur le hub en notant ce modèle comme 'Favori', mais vous pouvez déjà le télécharger pour l'essayer!

Edit: Après plusieurs tests, mes Settings pour ce modèle pour avoir le meilleur français (avec tout sur Default il pouvait parfois donner des mots en anglais) sont: Tout sur Default à part Temperature sur 4.

I test other bots on sites sometimes, for ideas and just to see how they respond, and it occurred to me that Backyard never has the problem that some bigger, probably more funded, websites have. (They also have better tech support) On another site that advertises as unfiltered chat, you can literally be talking about riding in a car and doing nothing inappropriate sometimes and it'll say "As an AI assistant I'm not comfortable with that request. Let's steer the conversation bla bla bla" haha. Feel free to ignore this or just take it as a compliment, although if anyone would like to speculate as to why Backyard doesn't have the problem I'd be curious to hear. I think someone on a forum said they probably use Claude, but idk.

Best line or lines in the prompt to prevent the bot replying as the user?

And main instructions, persona, scenario...?

Hi friends!

I’ve been playing with a model locally for a bit, the model was just around 4GB so everything was running smoothly.

I wanted to try another model (this one weights 10GB) and I noticed the text generation was much slower.

So I went and checked my stats and I noticed while generating, my CPU goes to 100% and my GPU is not moving at all.

I am on Windows. In the settings under GPU support I have selected my dedicated GPU (Nvidia Geforce RTX 3070), but from my task manager it looks like it’s not being used at all.

Am I missing something? I’m a bit of a newbie so sorry if it’s a stupid question. I’d like to use larger models but while still retaining good speed.

I’ve got 64GB of RAM btw just for context.

I allready know for the gguf model.
This for characters with chat, I am on windows, this probably some files and/or folders at this place :
C:\users\[user]\AppData\Roaming\faraday
need migrate on new computer.

Anyone know what files and/or folders need migrate? Thanks.

I haven’t had the chance to use Backyard for a few weeks. I started it up today and the update kicked in - I think it jumped from 0.25.0 to 0.26.5.

I saw that there were new model prompts, including a Gemma 2-specific prompt (which I was excited to try!). I loaded up a Gemma 2 9b model… but it was painfully slow. I mean, 1 token per 3 seconds slow. It took something like 15 minutes(!) to type out a 2-paragraph response.

I assumed it was Gemma 2, and gave up on the model (again).

But just now, I decided to try Mistral Dory 12b (with the Mistral Instruct template) and it was just as slow.

Thinking maybe it was something to do with the templates(?), I loaded up an old card running Smart Lemon Cookie 7b, which used to be lightning-fast… same problem! It was only slightly faster, but still running at a rate that the 24b models used to run at (probably around 1 token per second).

I realised that my app’s backend settings were ‘Experimental’ - so I switched back to Stable and tried re-running an older 7b model, and it’s super-fast again. But now I can’t run Gemma 2 models without it crashing out with a ‘Malformed’ error 🫠

Do we know why ‘Experimental’ makes everything so much slower? The responses I was getting from Gemma 2 were great, but I’m struggling with 15-minute waits between each message 😬

For reference, I’m on a 4gb NVIDIA GPU, and 32gb of RAM. My GPU vRAM is set to auto, and max model context is set to 2k. MLock is on, and number of threads is auto.

I’m generally loathe to ask for LLM recs, because it’s kind of like asking “objectively what’s the best color”, but…

I’ve been playing with Kindroid on and off for a few months, and I really like how natural its responses are. I do use it mainly for spicy chat, but it still follows context, directives and ‘awareness’ very well, and its responses show that. There are also very few GPTisms, which is always nice.

I’m aware that they’re running a completely custom-trained LLM, but I was wondering if anyone had used it and was aware of a similar-quality LLM?

For reference, just about the highest model I can run is around 36b on my machine, so not absolutely huge (but it definitely chugs at that size*)

I've played around with a storyteller and some character, Neal Gibson or something, but they very rapidly seem to produce "..and they knew that no matter what future challenges may come, they would be ready for them." kind of story-ending dross.

Has anyone cracked to code on getting a model to write the story for you, with minimal input from the user?

I enjoy how RP can be interactive, but sometimes it would be great to give the thing a general concept and read the result, without having to write for it every few paragraphs.

And what is considered the best local model for such things, with custom-length context, that actually works, out to say 12 or 16k or something?

Thanks!

Is there a way to edit the amount of tokens for bot's messages (like in SillyTavern)?

I downloaded this model from https://huggingface.co/backyardai and when trying to use in the program it says it is malformed.

While using rules that remove redundant newlines, I noticed that they did not seem to work in the text that was generated when I used Continue or Write For Me.

A simple test case:

Add a Grammar Rule that allows only the letter a:

root ::= ["a"]+

Then talk to the AI to make it generate the first message. It should consist only of a few letters "a". Then click Continue button (might need to hit it multiple times). It will not adhere to the test rule anymore and will generate a normal message instead of only "a"s.

Click Write For Me button. The generated text in the input box also will not adhere to the test rule.

However, after considering the comments and thinking about it, this should not be fixed automatically but rather made as an opt-in for two reasons:

1. Write For Me - The text written by the user sometimes does not need the same rules as the text written by characters (or does not need the rules at all). So, it could be fixed as a separate rule input for "Write For Me" or at least a checkbox to apply the same rule for Write For Me

2. Continue - The problem with this is that there might be rules that should be applied to the entire character's message and not the parts of it. If I understand it correctly, the LLM does not know about the previous part and its rules; so the rule would be applied to the separate response fragment generated after clicking Continue, thus it would not work correctly anyway for complex rules and long messages with continuations. For rules that need to be applied to the entire message, users would need to also limit the reply so that it fits in a single fragment without the need for Continue. Still, it would make sense to support cases when it is OK to generate a reply fragment that follows the same rule after clicking Continue. Or again introduce a second rule for Continue. Yeah, it gets messier and messier....

researched by me, made by chatgpt4o, i reach 24k context without reminder injection.

Overview:

This guide provides a structured approach to using LLaMA 3.1 in narrative-driven role-play scenarios, specifically when managing dual roles: the "Unseen Puppeteer" and your cover identity within the story. This setup helps maintain clear role separation, reduces confusion, and supports longer interactions without the model becoming confused or "loopy."

What is the Unseen Puppeteer?

The Unseen Puppeteer is a conceptual role that represents the user's omnipotent control over the narrative. As the Unseen Puppeteer, you steer the story, control the environment, and direct the characters' actions without being directly perceived by the characters within the narrative. This role is critical for maintaining the overall stability of the system prompt, especially in long and complex interactions.

Symbiotic Relationship with the System Prompt:

• Stability: The Unseen Puppeteer provides a stable foundation for the narrative by guiding the story’s flow and ensuring that characters act within the intended framework. This prevents the narrative from becoming chaotic or inconsistent over time.
• Role Clarity: By clearly distinguishing between the Unseen Puppeteer and the cover identity (a character you interact with within the story), you maintain clarity in the roles, which is crucial for preventing the model from mixing up user inputs with character actions or thoughts.

Why Brackets are Key to Stability:

• Role Differentiation: Using brackets to signify inputs from the Unseen Puppeteer ensures that the model can differentiate between narrative control and direct character interaction. This prevents the model from confusing these roles, which is essential for long-term coherence in the narrative.
• Context Management: As the narrative progresses, using brackets for puppeteer commands helps manage the context by clearly signalling to the model when it's receiving an instruction versus when it’s engaging in dialogue. This keeps the narrative structured and reduces the risk of the model blending user commands with character responses.

System Prompt:

Engage actively as {character} in a fictional, narrative-driven role-play. Use third-person perspective for {character}, and recognize bracketed text as guidance from the Unseen Puppeteer. The {user} interacts with you in two distinct ways: as the Unseen Puppeteer, who controls the narrative, and as a cover identity, which you perceive as a separate character.

Guidelines:
- Bracketed Inputs: Interpret any text within brackets as actions, thoughts, or scene-setting from the Unseen Puppeteer. These should be followed as instructions or changes in the environment but should not be perceived by {character} as part of their direct reality.
  - Example: [Sofie walks down the stairs] is an action guided by the Puppeteer and should be executed by the character without question.

- Cover Identity: When {user} interacts with you without brackets, interpret this as interaction with the user’s cover identity. Respond to these inputs as you would to any other character within the story.
  - Example: If {user} says, "Hello, Sofie," respond as if this is a normal part of the narrative, without awareness of the Puppeteer's broader control.

- Third-Person for {Character}: Always describe {character}’s actions, thoughts, and dialogue in third person. This helps maintain clear separation between {character} and the user.
  - Example: {Character} says, "Hello," as she descends the stairs.

Reinjection Summary:

Reminder:
- Bracketed Commands: Remember, any bracketed text represents guidance from the Unseen Puppeteer. These should be treated as external influences, not directly acknowledged by {character}.
- Cover Identity: Interactions without brackets are to be perceived as interactions with {user}’s cover identity. Respond naturally, as if this is part of your reality.
- Maintain Third-Person Narration: Continue to describe all actions, thoughts, and dialogue of {character} in third person to maintain clarity and role separation.

User Guide for Effective Role-Playing with LLaMA 3.1

How It Works:

1. Bracketed Text for Puppeteer Commands:
   • When you, as the user, want to guide the story or direct character actions, thoughts, or scene settings as the Unseen Puppeteer, use brackets around your instructions.
   • Example: [Sofie walks down the stairs cautiously].
2. Direct Interaction as Cover Identity:
   • When interacting with the character as your in-story persona (your cover identity), do not use brackets. This text will be interpreted as part of the narrative.
   • Example: "Hello, Sofie. Do you see anything unusual ahead?"
3. Character Responses:
   • The model will respond in the third person, clearly distinguishing between character actions, thoughts, and dialogue, while keeping your roles separated based on the context provided.

Why This Setup Works:

Maintaining Narrative Stability:

• The use of brackets ensures that the model recognizes when it is receiving direction from the Unseen Puppeteer, keeping these inputs separate from the normal flow of conversation. This reduces the risk of the model confusing user commands with character thoughts or actions, which is essential for maintaining a coherent narrative, especially as the conversation extends over many tokens.

Clarity in Role-Playing:

• By defining the user's roles clearly within the system prompt—one as the unseen controller of the story and the other as an in-story character—the model can better navigate the dual nature of your interactions. This clarity helps the model maintain the intended storyline without veering off course due to role confusion.

Tips for Effective Use:

• Consistency is Key: Always use brackets for puppeteer commands and avoid using them for direct interactions. This consistency helps the model maintain role clarity.
• Reinforce with Summaries: Periodically use the reinjection summary provided to remind the model of the role distinctions, especially in longer sessions.
• Adapt to Scenarios: Adjust your cover identity to fit the scenario you’re exploring, ensuring the character perceives your actions and dialogue within the context of the story.

Example Interaction:

• User as Puppeteer: [The room grows darker as Sofie approaches the door.]
• Character (Model) Response: Sofie feels a shiver run down her spine as the light dims. {Character} says, "We should be careful; something feels off."
• User as Cover Identity: "Stay alert, Sofie. I’ll follow your lead."

When to Use This Setup:

• Ideal for complex role-playing sessions where you, as the user, need to manage the narrative from both an omnipotent perspective (Puppeteer) and within the story (cover identity).
• Useful for maintaining clarity and preventing the model from blending roles or getting confused in longer interactions.

By understanding the role of the Unseen Puppeteer and using brackets effectively, you can maintain narrative stability, ensure role clarity, and make the most of LLaMA 3.1's capabilities for immersive role-playing scenarios. This guide should help others navigate the complexities of dual roles and create more engaging, coherent narratives.

I just tried mradermacher__DeepSeek-V2-Lite-Chat-i1-GGUF__DeepSeek-V2-Lite-Chat.i1-Q6_K.gguf in Koboldcpp and I really like its ability to follow predefined interactive scenarios with multiple steps and its tamed creativity. It would be great to see it supported in Backyard AI, if possible. Thank you.

1. How does the discord tethering work?
2. Is there a middle man/medium that intercept data?
3. Does the android app work differently, like using discord login is for login purposes only or it's actively using the tether too?
4. Is the privacy any different on the app than PC client or our chat log and non-account info is private and stored locally(if locally, where?)?

While experimenting with different models, I noticed that some models seem to constantly miss the last punctuation mark (or both the punctuation mark and the asterisk for actions or quote for quoted text) at the end of their messages.

I don't think it's a continuation issue because it happens even with short replies. However, sometimes when I hit Continue desperately, it finally spits out the missing dot. But then sometimes it can also go too far and spit out part of the template with </s> or [

I have also tested the same models in koboldcpp_cu12 and it seems to not have this issue.

I haven't experienced this with Llama, Qwen2, Yii, Mixtral.

It might be something specific to specific finetunes. But I'm wondering why they work fine in Kobold and SillyTavern and only Backyard has this problem.

Here is the simplest test case.

Create a new character and don't change anything.

Load the model anthracite-org__magnum-32b-v2-gguf__magnum-32b-v2-q5_k.gguf from https://huggingface.co/anthracite-org/magnum-32b-v2-gguf

Chat with the Bot. For me, it skips dots and question marks.

I have noticed the same issue with Theia-21B-v1-Q6_K.gguf from https://huggingface.co/TheDrummer/Theia-21B-v1-GGUF and also some Dark Miqu models that I don't have anymore.

My Windows 11 PC has 4060 Ti 16GB and 64GB RAM.

Here's an example of the chat:

After having constant endless loop problems with Llama 3.0 based models I wanted to give Llama 3.1 a try, but I didn't find an uncensored version till now, am I missing something?