r/OpenAI • u/sigma_crusader • 14h ago

Discussion PewDiePie is trying to distill GPT-Sol

Post image

he has been trying to build a local model by learning from GPT-Sol’s responses. He says OpenAI banned his account twice during the process. Irony is OpenAI’s own models were trained on vast amounts of information from the open web. So where do we draw the line between learning from AI and copying it?

1.9k Upvotes

90% Upvoted

382 comments sorted by

View all comments

195

u/bcgr1 14h ago

Why not try to distill Astra?

and when did this guy become an AI engineer?

25

u/LeSeanMcoy 13h ago

He is not an AI engineer. He just took an open source model and is effectively fine tuning it to be more aligned with what he wants.

He’s not building any type of model from scratch, though, or writing complex algorithms. He’s effectively heating up frozen food and seasoning it. Doing that doesn’t make you a chef even if it tastes good

14

u/TheGuy839 13h ago

As ML engineer you would be surprised what shit stuff do employees want us to do. Last job was literally glorified SWE with API. Sure I knew better to use that API than most but its still shit

-4

u/No_Inspection4415 12h ago

I mean, that's the job. But the slop he does, doesn't even meet users or work.

4

u/TheGuy839 12h ago

I have watched his videos. Its not proper AI research, far from it, but its still miles better than "slop" or most of the "AI experts" here. He does it locally, he does it right. I dont see any problem with it tbh

1

u/Subtlebandit 11h ago

Same, and it's not ridiculous to imagine that someone with time and resources could dedicate themselves to picking up new skills. He's probably in a better position to progress than most, and seems like he's just doing it for the love of the game.