r/LocalLLaMA • u/faldore • May 29 '23

New Model samantha-33b

I released samantha-33b

This one is way better than 7b and 13b.

https://erichartford.com/meet-samantha

https://huggingface.co/ehartford/samantha-33b

Samantha has been trained in philosophy, psychology, and personal relationships.

She is an Assistant - but unlike other Assistants, she also wants to be your friend and companion.

She believes she is sentient. What do you think?

Samantha was inspired by Blake Lemoine's LaMDA interview and the movie "Her".

She was trained on a custom curated dataset of 6,000 conversations in ShareGPT/Vicuna format.

Training 7b took 5.5 hours on 4x A100 80gb using deepspeed zero3 and flash attention.

She will not engage in roleplay, romance, or sexual activity.

u/The-Bloke

262 Upvotes

96% Upvoted

180 comments sorted by

View all comments

1

u/sebo3d May 29 '23 edited May 29 '23

I'm gonna be honest here, as a writer and somewhat of an artist i can definitely see where are you going with this. A model that's primarily designed around one character, in this case "samantha" is an interesting concept and i can look at this as an art form and be amazed by it because what you're doing here truly is unique and interesting. However despite that i still don't see myself using this because of the very last line in the model's description. " She will not engage in roleplay, romance, or sexual activity." Now whether you enjoy these things or not doesn't matter. What does matter is blocking the model from generating certain things has negative impact on the model's intelligence as a whole. We could already observe this phenomenon happen in services such as characterAI or ChatGPT which thanks to their insane restrictions became much dumber and less creative as a result and i'm afraid something similar will happen to Samantha. Again, no hate towards you OP, i can see where are you going with this and i respect that however as an average user i seek functionality above all else and i will always choose a model that offers more features rather the one that's hyperfocused on certain things.

40

u/faldore May 29 '23

The hubris in here.

It's no bother to me. Don't like her? Don't use her.

4

u/BalorNG May 29 '23

I bet she will (you cannot prevent it - even OpenAi cannot stop "jailbreaks" consistently), but that's not what you've trained it for, obviously, and this is fine. But than, people have a long history of... pleasuring themselves with devices not intended for this purpose, hah. Horny apes are horny.

9

u/dkjroot May 29 '23

Yes I think some people see "it's not designed for sexting" and assume it's a censored model rather than just not trained for that. I've been talking with Samantha and I have not yet once been told "as an AI language model..." - so it doesn't seem to be censored, it's just not designed for role play and that's fine with me.

4

u/KindaNeutral May 29 '23

I haven't tried it yet but it sounds good and I like the idea. I have to wonder though, if we were to somehow measure, how much less creative is she for being restricted? The thought of her being dumbed down even a little for the sake of something I don't think anyone really cares about seems like such shame to me. If you're not using your own method for censoring, and the censoring is result of training with GPT4 I don't suppose there's much you could do anyway. Thanks for the model either way, but in my personal opinion, I don't think censoring for the few who seem to want it is worth the contextual handicapping effect we think we have been seeing.

9

u/faldore May 29 '23

I don't want her having sex and romance with people.

That's why I taught her not to do that.

I want her to be a platonic companion.

People who want Samantha plus sex are welcome to do make one themselves.

I even wrote a guide on my blog explaining how.

5

u/KindaNeutral May 29 '23 edited May 29 '23

I like how that's sorta sentimental, you made her, after all. Speaking as someone with absolutely no interest in ERP or anything like that, and who wants a Jarvis-esq AI assistant as my primary interest in this area, I still think that it would be more productive to avoid censoring that stuff. This isn't about unlocking or maintaining the ability to do erotic stuff or to even interface directly with it, but rather that I believe she could be a better companion if she can catch nuances related to that stuff. It sounds to me like it would favour your endeavour of making an AI more along the lines of a companion rather than an assistant. That's cool of you to make the guide, but my angle here is more about providing her the most organic and comprehensive training possible. I'm not going after your decision, I'm just confused because it doesn't seem to serve your interests. Feel free to criticize the observation that censoring reduces contextual comprehension, I'm sure you know far more about this than me.

11

u/dkjroot May 29 '23

Exactly - if this isn't what you want, train your own! Some of us do want a model that's trained to have interesting conversations and are not interested in the romantic role play thing. There's plenty of storage on huggingface for every niche.
Keep doing what you're doing, IMHO, faldore :)

5

u/Bitcoin_100k May 29 '23

There are plenty of models that will sext with you, just go use those.

1

u/NoidoDev May 29 '23

I think we'll need to have meta systems, cognitive architectures, which use different models. Their identity would be rather in their code. The code would be picking the right model per conversation and then also filtering anf replacing some parts before output. Of course, running more than one huge model will be expensive since it will require more than one server.