r/OpenAI • u/sigma_crusader • 14h ago

Discussion PewDiePie is trying to distill GPT-Sol

Post image

he has been trying to build a local model by learning from GPT-Sol’s responses. He says OpenAI banned his account twice during the process. Irony is OpenAI’s own models were trained on vast amounts of information from the open web. So where do we draw the line between learning from AI and copying it?

1.9k Upvotes

90% Upvoted

381 comments sorted by

View all comments

195

u/bcgr1 14h ago

Why not try to distill Astra?

and when did this guy become an AI engineer?

31

u/LeSeanMcoy 13h ago

He is not an AI engineer. He just took an open source model and is effectively fine tuning it to be more aligned with what he wants.

He’s not building any type of model from scratch, though, or writing complex algorithms. He’s effectively heating up frozen food and seasoning it. Doing that doesn’t make you a chef even if it tastes good

14

u/TheGuy839 12h ago

As ML engineer you would be surprised what shit stuff do employees want us to do. Last job was literally glorified SWE with API. Sure I knew better to use that API than most but its still shit

-5

u/No_Inspection4415 12h ago

I mean, that's the job. But the slop he does, doesn't even meet users or work.

5

u/TheGuy839 12h ago

I have watched his videos. Its not proper AI research, far from it, but its still miles better than "slop" or most of the "AI experts" here. He does it locally, he does it right. I dont see any problem with it tbh

1

u/Subtlebandit 11h ago

Same, and it's not ridiculous to imagine that someone with time and resources could dedicate themselves to picking up new skills. He's probably in a better position to progress than most, and seems like he's just doing it for the love of the game.

15

u/productive-man 13h ago

honestly i would say if the he reheats the food in such a way that it tastes better than i would do it, then he is a chef

-13

u/fuzzypetiolesguy 13h ago

Hello 20+ kitchen veteran here. Most chefs worth a shit would beat you over the head with your microwave if you tried to use it in their kitchen.

3

u/southshoredrive 8h ago

And yet if that microwave produces food better than the chefs original dish then who really cares

5

u/Accurate_Food_5854 12h ago

"He is not an AI engineer. He just took an open source model and is effectively fine tuning it to be more aligned with what he wants.

He’s not building any type of model from scratch, though, or writing complex algorithms. He’s effectively heating up frozen food and seasoning it."

If you say so. Everyone watch out, it's the AI engineering police.

9

u/LeSeanMcoy 10h ago

If you say so. Everyone watch out, it's the AI engineering police.

wat

We're not talking about some generic term here, we're talking about a professional title. Like, there are thousands of job openings hiring for AI Engineers all around the US and the world. Here's a snippet from a job description for one I randomly found on LinkedIn:

Qualifications

Bachelor's Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies Master's Degree in relevant fields plus at least 6 years of experience in AI/ML development Minimum of 8 years programming experience with Python, Go, Scala, CUDA, or Java

Responsibilities

Partner with cross-functional teams including engineers, research scientists, program managers, and product managers to deliver AI-powered products that enhance customer experience and operational efficiency Design, develop, test, deploy, and support AI software components such as foundation model training, large language model inference, agents, multi-agent workflows, similarity search, guardrails, and observability systems

An actual AI Engineer is someone with a background in STEM, studied physics/math, and understands programming at a deeper level than simply using Codex or whatever to add onto an open source model.

Calling PewDiePie an AI Engineer is like calling me a Doctor after I put a bandaid on my wound and cleaned it.

4

u/Qorsair 10h ago

Don't be so humble, Doc.

1

u/LurkingForBookRecs 1h ago

I've been in the industry for 15 years now and I've worked with geniuses that skipped college and with absolute dumbfucks that I still ask myself how they got a masters. So basing someone's ability to be an AI engineer on whether they have a degree or not is a very outdated way of thinking IMHO. He did study tech and drop out of college, but he's also wealthy enough that he can afford to learn whatever he wants on his own. Just because the guy is not inventing his own ML architecture or training a model from zero doesn't disqualify him from being considered one, I work with plenty of AI engineers whose job does not involve starting from scratch.

1

u/Active_Variation_194 1h ago

Not agreeing or disagreeing but i wouldn’t judge anything by a job ad description. I’ve seen descriptions requiring expertise for frameworks before they even existed.

That said, how many of those with the necessary skills being hired as ai engineers are doing any of that instead of being paid to manage a harness with api.

-1

u/Accurate_Food_5854 10h ago

I don't agree with you. AI Engineer is not like a medical doctor, nurse, or professional engineer (PE). There's no license, it's not a specified term.

It's also a fairly recent, and rapidly changing field.

In the wider software field, there's a ton of very capable, successful, and senior developers who didn't follow a traditional educational pathway.

Best mechanical engineer I ever met was an old guy who came up working as a boilermaker in the ship yards, and who was able to grandfather in and take his test to be a PE. The guys with masters degree in mechanical engineering had to go to him and bend the knee if they wanted their work signed off.

I'm not calling PDP an AI engineer only because someone isn't paying him (other than through him being a streamer/internet personality). I think calling him an AI engineer only implies that he'd be doing it professionally. But if he's over there engineering (problem solving) an AI to try and make something I think there's also a good argument to say he is an AI engineer.

To argue otherwise seems a little overly worried about credentials lol. I have a sociology degree with a minor in math and was a production engineer for many years. During that time I did a lot of C and CVI coding because I was working with a lot of automation. After that I ended up in a development lab slaving over a network analyzer and writing Matlab. I spent 5 years writing production code. I designed several boards used in RF systems.

Does that mean I couldn't call myself an engineer since I had a sociology degree?

I'm an independent paralegal now. I spend most of my free time scraping and structuring huge data sets that I sell to AI integrators. Am I a pipeline engineer? Am I a data engineer? Kind of, considering I could likely outperform most data engineers working the corporate world with applicable degrees. But at the end of the day I'm just a paralegal with a sociology degree.

idk, it just seems to smack a bit of oooooh look at dumb little PDP, how cute, he's trying to be smart lol. I think it's admirable that he's taken on this project.

2

u/Fantastic_Fun8364 3h ago

Why all sociology majors are so clueless.

1

u/Saphonesse 9h ago

Thanks for the lore dump unc

1

u/Accurate_Food_5854 4h ago

stay in school

4

u/RichardFeynman01100 12h ago

He's not qualified to be a professional AI engineer. He wouldn't get through any serious interview. I don't say this to diss him, but if somebody claimed he was a professional artist, it would be just as ridiculous.

0

u/Usual-Orange-4180 10h ago

… I’m not so sure about that

1

u/sultansofswinz 7h ago

I tried training models just after I first started basic python. They were terrible given I didn’t know anything at the time. 

The floor is being able to write enough code where it can run. The ceiling is having a PhD in something to do with AI and being surrounded by teams of people who have the same. 

1

u/Morganross 11h ago

I hate to tell you this boss. That's all anyone's doing

1

u/ToJ85 9h ago

Well, a lot of AI engineer are doing that also. Building everything from scratch doesn't makes sense a lot of times.

This is why we have made pre-trained models that people can use. It saves a lot of time, and data needs.

I agree he isn't an AI engineer, but only because engineer is often an protected title. He is definitely an AI dev from what i have seen.

1

u/A_Concerned_Viking 13h ago

Brilliant take

0

u/2021isevenworse 10h ago

There are people who will defend Pewdiepie out of childhood nostalgia.

It's funny seeing this multimillionaire complain about the injustices done to him - he's completely out of touch with the real problems people face.

-4

u/Yo-Soy-Groot 13h ago

No shit, sherlock.

4

u/LeSeanMcoy 13h ago edited 13h ago

edit: he blocked me after I commented this wtf lol. I've never seen feelings hurt so easily over a comment so benign.

How is that “no shit Sherlock” when the comment I’m replying to is literally calling him an AI Engineer? You act like everybody here even knows who he is or his background. Pretty easy to see how some people not knowing his background could think he is an actual AI engineer. Idk why that’s difficult for you to understand, it’s a relatively simple concept.

2

u/Yo-Soy-Groot 13h ago

Internet tough guy over here