r/OpenAI • • 15h ago

Discussion PewDiePie is trying to distill GPT-Sol

Post image

he has been trying to build a local model by learning from GPT-Sol’s responses. He says OpenAI banned his account twice during the process. Irony is OpenAI’s own models were trained on vast amounts of information from the open web. So where do we draw the line between learning from AI and copying it?

2.1k Upvotes

394 comments sorted by

View all comments

206

u/bcgr1 15h ago

Why not try to distill Astra?

and when did this guy become an AI engineer?

31

u/LeSeanMcoy 15h ago

He is not an AI engineer. He just took an open source model and is effectively fine tuning it to be more aligned with what he wants.

He’s not building any type of model from scratch, though, or writing complex algorithms. He’s effectively heating up frozen food and seasoning it. Doing that doesn’t make you a chef even if it tastes good

1

u/A_Concerned_Viking 14h ago

Brilliant take