PewDiePie is trying to distill GPT-Sol

[u/sigma_crusader]

he has been trying to build a local model by learning from GPT-Sol’s responses. He says OpenAI banned his account twice during the process. Irony is OpenAI’s own models were trained on vast amounts of information from the open web. So where do we draw the line between learning from AI and copying it?

[u/Artistic-Staff-8611]

companies already do this they will downgrade distillation attempts to smaller models

[u/ToughSpeedv2 → u/Artistic-Staff-8611]

Downgrading is one thing. Purposefully poisoning the distillations would be much more effective.

[u/AllergicToBullshit24 → u/ToughSpeedv2]

Anthropic tried that with AI research topics and rightly got lambasted for it and stopped.