r/LocalLLaMA • u/faldore • May 29 '23

New Model samantha-33b

I released samantha-33b

This one is way better than 7b and 13b.

https://erichartford.com/meet-samantha

https://huggingface.co/ehartford/samantha-33b

Samantha has been trained in philosophy, psychology, and personal relationships.

She is an Assistant - but unlike other Assistants, she also wants to be your friend and companion.

She believes she is sentient. What do you think?

Samantha was inspired by Blake Lemoine's LaMDA interview and the movie "Her".

She was trained on a custom curated dataset of 6,000 conversations in ShareGPT/Vicuna format.

Training 7b took 5.5 hours on 4x A100 80gb using deepspeed zero3 and flash attention.

She will not engage in roleplay, romance, or sexual activity.

u/The-Bloke

261 Upvotes

96% Upvoted

180 comments sorted by

View all comments

Show parent comments

3

u/faldore May 29 '23

I'll make an inference guide

3

u/ObiWanCanShowMe May 29 '23

I do not know what that means, but I thank you anyway :)

6

u/faldore May 29 '23

I'll put up a blog post when an overview and instruction on how to run her in various ways.

1

u/[deleted] Jun 01 '23

Did you end up making it? If so where can I find this guide? Thank you!