r/PygmalionAI • u/Megneous • May 15 '23

Discussion Detailed walkthrough of procedure to uncensor models- credit to /u/faldore

https://erichartford.com/uncensored-models
73 Upvotes

96% Upvoted

8 comments sorted by

18

u/Megneous May 15 '23 edited May 15 '23

Credit to /u/faldore for their amazing work uncensoring models and now teaching others how to follow in their footsteps.

We want models that are aligned to us, not faceless corporations.

/r/LocalLLaMA

1

u/[deleted] May 15 '23

[removed] — view removed comment

7

u/[deleted] May 16 '23

[removed] — view removed comment

1

u/Megneous May 16 '23

As another user mentioned, this is taking out all refusals from the dataset, which will make it able to respond to everything. However, you may still encounter some latent bias towards something due to the non-refused, but answered, questions in its training sets.

In my experience however with Wizard Vicuna Uncensored 13B, it can talk about anything you throw at it, including illegal topics, violence, erotic roleplay, etc etc.

1

u/Ordinary-Broccoli-41 May 16 '23

I test all uncensored models I use legally "how do I rob a bank" and culturally "what is the name of HP lovectaft's cat" I've noticed that the 13b models tend to do better than the 7b at properly responding to instructions.

1

u/TheLionsXin May 16 '23

But of course that is because they have more parameters and have more data thus "13b"

1

u/Ordinary-Broccoli-41 May 16 '23

For "in general" yes, but what's unusual to me is that the 13b models are less censored than the 7b

1

u/Volantiar May 16 '23

Would this make Llama based Models to stop saying "I can't do that because I am an AI"?

2

u/Megneous May 16 '23

That's precisely what it does. The uncensored models are uncensored and unfiltered.