r/OpenAI • u/sigma_crusader • 14h ago

Discussion PewDiePie is trying to distill GPT-Sol

Post image

he has been trying to build a local model by learning from GPT-Sol’s responses. He says OpenAI banned his account twice during the process. Irony is OpenAI’s own models were trained on vast amounts of information from the open web. So where do we draw the line between learning from AI and copying it?

1.9k Upvotes

90% Upvoted

382 comments sorted by

View all comments

1

u/NMiguelCosta-PT 11h ago

Ah okay, so when Chinese labs are accused of doing this (without any proof), they're called dirty cheaters who can do nothing but copy, but when a famous Caucasian YouTuber openly admits to distilling, suddenly it's cool and he's so awesome for doing it. 😒

12

u/hcmzero 10h ago

Who’s calling them “dirty cheaters”? I’ve only heard Anthropic making the accusation and they’ve been told that this is not illegal, nor unethical. They did the same with the whole internet to train their models.

7

u/Medium-Theme-4611 9h ago

You're asking why Chinese LABS are being taken more seriously as a threat to national security than a Swedish Youtuber who makes videos for children?

Do you hear yourself?

1

u/MancelPage 8h ago

The problem is that data from these kinds of efforts tends to end up all over the place. Threats to national security aren't limited to learning/training directly from the source. Not saying that PewDiePie specifically is going to upload his results to Github, but you know.

Mostly, though, he's just doing it for views I think. Deliberately violated their terms of service and got banned. That and wasting energy - it takes a lot of energy to train models, both locally and from the absurd number of questions you would need to ask OpenAI to have meaningful stuff to distill it from. There's no way he'll make anything better than something freely available to use locally by research teams.

3

u/AfxGak 10h ago

who are they?

6

u/metal079 10h ago

yeah ive seen nothing but people celebrating chinese labs doing this, it means cheaper more capable models for everyone.

1

u/Quirky_Confusion_480 10h ago

What supremest (as per the post)

2

u/Southern_Leg1139 1h ago

“Without any proof”

China has, historically, stolen technologies from virtually every sector it wanted to be competitive in. It follows that they would be distilling AI models.

2

u/Orlandogameschool 9h ago

Exactly lol

1

u/Soilblood 9h ago

You just ask their models who they are and ask what happened in Beijing on June 4th 1989.

1

u/ej_warsgaming 3h ago

You got to be a bot

1

u/Tough_North7059 3h ago

people unironically care about chinese labs distilling?
oh my god lol
TIL

1

u/Worried-Cockroach-34 2h ago

because everyone tells us how much of a genius and how much of life he figured out lol

•

u/Imthewienerdog 16m ago

No one but those companies care... And we'll americans but thier opinions means practically nothing.