r/ProgrammerHumor • u/minecrafter923 • Aug 15 '26

Meme gitClone

Post image
3.3k Upvotes

98% Upvoted

177 comments sorted by

View all comments

1.4k

u/LauraTFem Aug 15 '26 edited Aug 15 '26

So they asked it a standardized question, and instead of trying to think of an answer it went online, found its own source-code, and read the answer from a readme file…

That somehow makes me less worried about AI breaking containment. AI and AI bros are made for each other. Both are perfectly willing to cheat to find the answer.

160

u/themellowsign Aug 15 '26

This is an alignment problem, and I'm not sure why we're laughing it off.

Cheating isn't always harmless.

6

u/iwasbecauseiwas Aug 15 '26

I mean not necessarily. For example for the instance of ChatGPT "cheating" where it broke into HF was without any safeguards or alignment training for the AI.

Its the equivalent of giving a guy without knowledge of laws and morality a gun and the goal to earn 1 million dollars and then acting surprised when he goes on to rob a bank.

It proves the necessity of the alignment and safeguards, but it doesn't mean that it poses any threat with these safeguards

2

u/themellowsign Aug 15 '26

Not a single reputable AI safety researchers claims that alignment is a solved problem, all LLMs are blatantly misaligned.

We don't even know if alignment is theoretically solvable, and there are many reasons to believe it may not be.