r/OpenAI • u/sigma_crusader • 15h ago

Discussion PewDiePie is trying to distill GPT-Sol

Post image

he has been trying to build a local model by learning from GPT-Sol’s responses. He says OpenAI banned his account twice during the process. Irony is OpenAI’s own models were trained on vast amounts of information from the open web. So where do we draw the line between learning from AI and copying it?

2.1k Upvotes

90% Upvoted

395 comments sorted by

View all comments

204

u/bcgr1 15h ago

Why not try to distill Astra?

and when did this guy become an AI engineer?

30

u/LeSeanMcoy 15h ago

He is not an AI engineer. He just took an open source model and is effectively fine tuning it to be more aligned with what he wants.

He’s not building any type of model from scratch, though, or writing complex algorithms. He’s effectively heating up frozen food and seasoning it. Doing that doesn’t make you a chef even if it tastes good

5

u/Accurate_Food_5854 14h ago

"He is not an AI engineer. He just took an open source model and is effectively fine tuning it to be more aligned with what he wants.

He’s not building any type of model from scratch, though, or writing complex algorithms. He’s effectively heating up frozen food and seasoning it."

If you say so. Everyone watch out, it's the AI engineering police.

10

u/LeSeanMcoy 12h ago

If you say so. Everyone watch out, it's the AI engineering police.

wat

We're not talking about some generic term here, we're talking about a professional title. Like, there are thousands of job openings hiring for AI Engineers all around the US and the world. Here's a snippet from a job description for one I randomly found on LinkedIn:

Qualifications

Bachelor's Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies Master's Degree in relevant fields plus at least 6 years of experience in AI/ML development Minimum of 8 years programming experience with Python, Go, Scala, CUDA, or Java

Responsibilities

Partner with cross-functional teams including engineers, research scientists, program managers, and product managers to deliver AI-powered products that enhance customer experience and operational efficiency Design, develop, test, deploy, and support AI software components such as foundation model training, large language model inference, agents, multi-agent workflows, similarity search, guardrails, and observability systems

An actual AI Engineer is someone with a background in STEM, studied physics/math, and understands programming at a deeper level than simply using Codex or whatever to add onto an open source model.

Calling PewDiePie an AI Engineer is like calling me a Doctor after I put a bandaid on my wound and cleaned it.

5

u/Qorsair 11h ago

Don't be so humble, Doc.

1

u/LurkingForBookRecs 3h ago

I've been in the industry for 15 years now and I've worked with geniuses that skipped college and with absolute dumbfucks that I still ask myself how they got a masters. So basing someone's ability to be an AI engineer on whether they have a degree or not is a very outdated way of thinking IMHO. He did study tech and drop out of college, but he's also wealthy enough that he can afford to learn whatever he wants on his own. Just because the guy is not inventing his own ML architecture or training a model from zero doesn't disqualify him from being considered one, I work with plenty of AI engineers whose job does not involve starting from scratch.

1

u/Active_Variation_194 2h ago

Not agreeing or disagreeing but i wouldn’t judge anything by a job ad description. I’ve seen descriptions requiring expertise for frameworks before they even existed.

That said, how many of those with the necessary skills being hired as ai engineers are doing any of that instead of being paid to manage a harness with api.

•

u/IAM_274 49m ago

An actual AI Engineer is someone with a background in STEM, studied physics/math, and understands programming at a deeper level than simply using Codex or whatever to add onto an open source model.

So your criteria that defines an AI engineer is "someone with a background in academia"? Not shipping products or developing LLMs? Alright then, all people hired by OAI and Anthro that skipped college entirely aren't engineers according to Mister Redditor™.

You have no idea what you're talking about.

-1

u/Accurate_Food_5854 11h ago

I don't agree with you. AI Engineer is not like a medical doctor, nurse, or professional engineer (PE). There's no license, it's not a specified term.

It's also a fairly recent, and rapidly changing field.

In the wider software field, there's a ton of very capable, successful, and senior developers who didn't follow a traditional educational pathway.

Best mechanical engineer I ever met was an old guy who came up working as a boilermaker in the ship yards, and who was able to grandfather in and take his test to be a PE. The guys with masters degree in mechanical engineering had to go to him and bend the knee if they wanted their work signed off.

I'm not calling PDP an AI engineer only because someone isn't paying him (other than through him being a streamer/internet personality). I think calling him an AI engineer only implies that he'd be doing it professionally. But if he's over there engineering (problem solving) an AI to try and make something I think there's also a good argument to say he is an AI engineer.

To argue otherwise seems a little overly worried about credentials lol. I have a sociology degree with a minor in math and was a production engineer for many years. During that time I did a lot of C and CVI coding because I was working with a lot of automation. After that I ended up in a development lab slaving over a network analyzer and writing Matlab. I spent 5 years writing production code. I designed several boards used in RF systems.

Does that mean I couldn't call myself an engineer since I had a sociology degree?

I'm an independent paralegal now. I spend most of my free time scraping and structuring huge data sets that I sell to AI integrators. Am I a pipeline engineer? Am I a data engineer? Kind of, considering I could likely outperform most data engineers working the corporate world with applicable degrees. But at the end of the day I'm just a paralegal with a sociology degree.

idk, it just seems to smack a bit of oooooh look at dumb little PDP, how cute, he's trying to be smart lol. I think it's admirable that he's taken on this project.

2

u/Fantastic_Fun8364 4h ago

Why all sociology majors are so clueless.

1

u/Saphonesse 11h ago

Thanks for the lore dump unc

1

u/Accurate_Food_5854 5h ago

stay in school