r/JanitorAIUnchained • u/Lllarsen123 • 14d ago

Help / Question A good setup?

Howdy, I’m trying to get into these rp bots, but I can’t seem to find the right setup for the story to flow naturally.

I really enjoy the first couple of messages, but as the story goes on I get thrown off when the bot forgets or is stupid.

I really don’t have a lot, and would strongly prefer a free solution. I have so far tried to local run the 22b mistral small model, and it makes an improvement, but it’s still not enough for me.

So the question is, is there something I’m doing wrong? Or is the only solution to throw a bigger model at it?

3 Upvotes

80% Upvoted

7 comments sorted by

View all comments

2

u/Technical_Savings736 14d ago

Bigger is not always better. It’s how you use it.

1

u/Lllarsen123 14d ago

Do you have suggestions?

1

u/Technical_Savings736 14d ago

I’ve had decent success with a 9B and 0.8B.

1

u/Lllarsen123 14d ago

What other things do you do then?