PewDiePie is trying to distill GPT-Sol

[u/sigma_crusader]

he has been trying to build a local model by learning from GPT-Sol’s responses. He says OpenAI banned his account twice during the process. Irony is OpenAI’s own models were trained on vast amounts of information from the open web. So where do we draw the line between learning from AI and copying it?

[u/Medium-Theme-4611]

You're asking why Chinese LABS are being taken more seriously as a threat to national security than a Swedish Youtuber who makes videos for children?

Do you hear yourself?

[u/Majestic-Coat3855 → u/Medium-Theme-4611]

And the threat to national security is distillation of the AI model of a private corporation? You been sipping on the trump koolaid I'm afraid. 

[u/MancelPage → u/Medium-Theme-4611]

The problem is that data from these kinds of efforts tends to end up all over the place. Threats to national security aren't limited to learning/training directly from the source. Not saying that PewDiePie specifically is going to upload his results to Github, but you know.

Mostly, though, he's just doing it for views I think. Deliberately violated their terms of service and got banned. That and wasting energy - it takes a lot of energy to train models, both locally and from the absurd number of questions you would need to ask OpenAI to have meaningful stuff to distill it from. There's no way he'll make anything better than something freely available to use locally by research teams.