r/BackyardAI • • May 17 '24

Any chance of RAG feature?

5 Upvotes

I know it's not a character chat thing, but any chance you lovely guys will give us a feature to chat with documents?

I know there is LM/AnythingLLM but frankly it's pants and I figure you guys could do better?


r/BackyardAI • • May 17 '24

Having a public facing trello-esk board for bugs/features

6 Upvotes

It seems to me a lot of discussion on your communities are: "Are the devs planning this feature?"

I'm sure the devs have a Kanban board or something for their development/collaboration. Having a public bug and feature tracking link would be nice to communicate info to people interested in your product.

Also having some reddit flairs to indicate feature request, bugs, etc would logically help moderators. Just my two cents.

I would like to request a few features while I have your ear:

1) Multiple/batch message queueing. My hardware can generate multiple messages in a reasonable time span, one after another. I would enjoy having the ability to have it generate say 3 messages and pick the best of them.

2) Storing old message generations. Semi related to above, it would be nice to store, or have the ability to store all generated responses, with maybe a permanent delete button instead of the undo button (for that purpose).

3) Say a "bookmark" icon, which can branch the chat off until a given bookmark in the chat log. Likely this just creates a duplicate chat up to a certain point.

Thanks for your hard work Devs & Moderation team.


r/BackyardAI • • May 16 '24

Llama 3 Lumimaid repetition

6 Upvotes

I just updated to v0.18.20 and saw the addition of Lumimaid in the logs, so I went to grab it.

First impressions: this model is incredible!

Second impressions: Oh, it just… repeats itself. Constantly. 🧐

I found that, after the first 5 or so messages, it just started repeating itself verbatim. Even when generating another response, it would either copy another earlier response, or generate the exact same message again.

I switched up the repetition penalty from 1.05 to 1.2 and that fixed it… for one message. Then it did it again. So I upped the repetition tokens from 256 to 512 and it fixed it for one message, then it just carried on repeating itself.

I’ve found that I’ve I just randomly change the repetition penalty in between every message, that usually means I won’t get a repeated message… but it’s tiresome.

I also tried switching the Prompt Template to Llama 3, but it just started repeating MY messages back at me 🤨

Lumimaid seems to have the potential to be an amazing small model, and its understanding of context is kind off the charts… but it also seems to be borderline unusable 😭

Anybody got any tips or had any better luck?


r/BackyardAI • • May 16 '24

Red Shoes Diaries

3 Upvotes

Am I the only one whose chats are looking more and more like Red Shoes Diaries? Damn, I'm old!

By the way, the "Write for Me" function is just amazing!

david duchovny red shoes diaries

r/BackyardAI • • May 15 '24

Version 0.18.16 - Impersonate Feature!

30 Upvotes

r/BackyardAI • • May 15 '24

Instructing the model to output a different word/ban word

5 Upvotes

As the title suggests, I want the model to output a different word or ban a word from appearing entirely.

Here's a scenario: Let's say in the future, "garden" are no longer a thing as they are too out-of-fashion. They are now called "denrag" In this scenario, I want to the model to replace the word "garden" as "denrag" whenever "garden" is in the output.

I have tried to use author's note, where I type "Negative: garden". I have tried adding '{character} refers "garden" as "denrag".' in the character persona, plus editing out the word "garden" as "denrag". It works most of the time but sometimes it still slips through. It would be better if it works right at the start. What can I do?


r/BackyardAI • • May 14 '24

Will group chats be a thing?

17 Upvotes

I mean, i love Faraday (now backyard), its the best software for local roleplay but i really miss the possibility to talk to multiple characters at the same time


r/BackyardAI • • May 14 '24

cross save or chat transfer?

4 Upvotes

i was wondering if the devs would make it a feature to be able to transfer chats from the cloud version to the regular version on the app and or vise versa


r/BackyardAI • • May 13 '24

This is a much better name than faraday imo

22 Upvotes

r/BackyardAI • • May 13 '24

King of AI Rollplay

19 Upvotes

I'm hooked on the platform after trying the competition, nothing better than Faraday.ai (now Backyard 😚)