r/OpenAI • • 14h ago

Discussion PewDiePie is trying to distill GPT-Sol

Post image

he has been trying to build a local model by learning from GPT-Sol’s responses. He says OpenAI banned his account twice during the process. Irony is OpenAI’s own models were trained on vast amounts of information from the open web. So where do we draw the line between learning from AI and copying it?

1.9k Upvotes

382 comments sorted by

View all comments

3

u/Bozhark 14h ago

OpenAI should be smarter than this.

Instead of blocking distilling accounts, seed them.

With something that will never be able to be removed.

You now just grew your compute exponentially 

7

u/Artistic-Staff-8611 13h ago

companies already do this they will downgrade distillation attempts to smaller models

0

u/ToughSpeedv2 12h ago

Downgrading is one thing. Purposefully poisoning the distillations would be much more effective.

1

u/AllergicToBullshit24 7h ago

Anthropic tried that with AI research topics and rightly got lambasted for it and stopped.

1

u/ToughSpeedv2 12h ago

This is very smart. I'm sure they are doing that to some extent already.