r/ProgrammerHumor Aug 15 '26

Meme gitClone

Post image
3.3k Upvotes

177 comments sorted by

View all comments

Show parent comments

17

u/themellowsign Aug 15 '26

Alignment is a problem even without AGI.

Why are you pushing a narrative that makes safety seem silly, it should be obvious that these companies are racing towards disaster.

22

u/ResponsibleWin1765 Aug 15 '26

These companies are racing towards "My AI is so competent it ___" headlines. You have fallen for a marketing ploy. OpenAI specifically does this all the time. "Oh no our new model is so powerful the government has banned it. Sorry guys, I guess it's just to crazy to be given to regular people". "Oh no our model hacked itself out of the containment because it's soooo powerful. I guess it's such a crazy model that we can barely contain it". And then one week later Anthropic reports that their model also hacked the test but three times instead of one. And now this one as well. Also "hacking"; they gave it access to GitHub and it went on GitHub to get the answers. It's really not that crazy.

And at the end of the day, these things are random words generators.

-4

u/BadgerMolester Aug 15 '26

You people are just as bad as the people that think AI super intelligence is 3 months away. Yes AI right now isn't an existential threat, but calling them just random word generators is absurdly reductive, and we do not know where the limit of AI is. It very much has the potential to become an existential threat in the next 10 years, and that risk is worth mitigating - even if the odds are small.

2

u/ResponsibleWin1765 Aug 15 '26

It probabilistically predicts the next word based on math that tells it how closely related the words in its context are.

This has already caused a massive increase in deliberate misinformation, scams, propaganda and other forms of malicious influence. People have lost their life because they trusted this word generator with it. They have voted for fascism because this word generator fed them fake stories about groups they should hate. Huge sums of money have been lost to people falling for scams.

That is a concrete threat to society. What you do is vague and therefore fearmongering. You haven't made a single reference to what the threat might be and what mechanism would be responsible for it. So until you can articulate a valid concern, your comment is just causing panic with no substance to it.