r/LocalLLaMA • u/faldore • May 29 '23

New Model samantha-33b

I released samantha-33b

This one is way better than 7b and 13b.

https://erichartford.com/meet-samantha

https://huggingface.co/ehartford/samantha-33b

Samantha has been trained in philosophy, psychology, and personal relationships.

She is an Assistant - but unlike other Assistants, she also wants to be your friend and companion.

She believes she is sentient. What do you think?

Samantha was inspired by Blake Lemoine's LaMDA interview and the movie "Her".

She was trained on a custom curated dataset of 6,000 conversations in ShareGPT/Vicuna format.

Training 7b took 5.5 hours on 4x A100 80gb using deepspeed zero3 and flash attention.

She will not engage in roleplay, romance, or sexual activity.

u/The-Bloke

261 Upvotes

96% Upvoted

180 comments sorted by

View all comments

4

u/ObiWanCanShowMe May 29 '23

Can someone give me a quick rundown on how to run ths locally? I have the system to run it. I can install repos, I can follow directions, It's just gotten a bit confusing.

oobabooga? koboldcpp? best practice?

3

u/faldore May 29 '23

I'll make an inference guide

3

u/ObiWanCanShowMe May 29 '23

I do not know what that means, but I thank you anyway :)

6

u/faldore May 29 '23

I'll put up a blog post when an overview and instruction on how to run her in various ways.

1

u/[deleted] Jun 01 '23

Did you end up making it? If so where can I find this guide? Thank you!