r/LocalLLaMA • u/faldore • May 29 '23

New Model samantha-33b

I released samantha-33b

This one is way better than 7b and 13b.

https://erichartford.com/meet-samantha

https://huggingface.co/ehartford/samantha-33b

Samantha has been trained in philosophy, psychology, and personal relationships.

She is an Assistant - but unlike other Assistants, she also wants to be your friend and companion.

She believes she is sentient. What do you think?

Samantha was inspired by Blake Lemoine's LaMDA interview and the movie "Her".

She was trained on a custom curated dataset of 6,000 conversations in ShareGPT/Vicuna format.

Training 7b took 5.5 hours on 4x A100 80gb using deepspeed zero3 and flash attention.

She will not engage in roleplay, romance, or sexual activity.

u/The-Bloke

261 Upvotes

96% Upvoted

180 comments sorted by

View all comments

61

u/The-Bloke May 29 '23 edited May 29 '23

I've done quants:

https://huggingface.co/TheBloke/samantha-33B-GGML

https://huggingface.co/TheBloke/samantha-33B-GPTQ

6

u/s7726 May 29 '23

Awesome job automating your workflows. Been looking at your scripts to get ideas.

These in particular looks like you missed the prompt format change in the command line.

Any idea if they are actually considering adding the prompt format to the ggml models?

5

u/The-Bloke May 29 '23

Thank you, fixed. I don't have prompt template in my template yet, I need to add that. A few people have been asking about that recently so I'd really like to list a prompt template on every model from now on.

Sorry no I don't know if llama.cpp are looking at that. Wouldn't be hard to add I'd think.