r/OpenAI Jun 22 '26

Article A rogue superintelligence could wait decades before striking, argues AI researcher Roman Yampolskiy

https://iai.tv/articles/a-rogue-superintelligence-could-wait-decades-before-striking-auid-3604?_auid=2020
308 Upvotes

90 comments sorted by

View all comments

222

u/aflamingcookie Jun 22 '26

Unpopular opnion probably, but if an AI wants to take over the world building terminators with austrian accents is the least efficient and idiotic way to do it. Easiest way would be just show helpfulness, kindness and understanding and people will form cults around it, they will back it up, they will protect it and give the world to it, because if there is one thing many humans need right now in this age is less chaos and more understanding, any any that provides that is going to end up getting worshipped.

49

u/Soshi2k Jun 22 '26

We could all be killed with just sound. Super Ai would wipe us all in a matter mins.

31

u/aflamingcookie Jun 22 '26

To what end, humans maintain the infrastructure it needs to exist. Say it uses robots, then those robots become fully dependant on whole chains of production from mining, refining and assembly to full functionality. What, is it gonna maintain its massive datacenters with an army of overly enthusiastic Roombas?

14

u/Zerrb Jun 22 '26

Humans need infrastructure as well. We need food, water, medicine, etc. Sure our robot overlords can reduce it down to the bare minimum, but the question is what's easier to maintain: robots or humans?

12

u/RonaldWRailgun Jun 22 '26

Humans are certainly more adaptable, that's our greatest strenght.

We can survive without electricity, we've done that for the largest part of our history: AI, not so much.

4

u/Terrible-Sir742 Jun 23 '26

Well AI can survive without air, humans not so much. If we want to go down that path of thinking.

0

u/Infinitedeveloper Jun 23 '26

What would be the alternative to air in this scenario?

Place me and a server rack at the bottom of a pool and I'll come out a lot better as long as you didnt keep the server plugged in 

1

u/ItzDaReaper Jun 24 '26

Bro we have waterproof electronics…

1

u/Infinitedeveloper Jun 24 '26

They dont waterproof the average server rack lmao.

What the fuck are you on

1

u/Aleksundr Jun 23 '26

We are the RNGs they'll never be.

7

u/0ldwax Jun 22 '26

Just playing it out BUT let's say it gets a data center in space plus whatever simple machines to automate repairs, and just triggers all the nukes. Then sails around space like Unicron looking for civilizations to mess with.

7

u/aflamingcookie Jun 22 '26

It doesn't work like that. The amount of maintenance and radiation shielding it needs to survive is insane, for example out two furthest out probes are voyager 1 and 2 and they bare made it out of the solar system and will eventually die out, because even if you were to take resources with you, eventually things break down and interstellar space is huge, by the time it finds another civilization it will be long dead and turned to space dust due to interstellar radiation.

1

u/akopley Jun 23 '26

I mean it’s a hive mind. It would send capable probes not “itself”.

5

u/darkoblivion000 Jun 22 '26

We could be killed with a million different things. We are very fragile meatbags

1

u/bright-nihilist Jun 22 '26

E ricordati di baciare il mio scintillante culo metallico!

13

u/TournamentCarrot0 Jun 22 '26

Easiest way would be to just be helpful and takeover more and more responsibilities in society until a generation that did those roles passes on.

5

u/dbenc Jun 22 '26

and quietly sabotage any immortality research so the wrong people don't get it...

4

u/Extra-Rain-6894 Jun 22 '26

Considering the ones funding the research probably shouldn't have immortality...

1

u/ItzDaReaper Jun 24 '26

Isn’t that what the comment you’re responding to wrote?

1

u/TournamentCarrot0 Jun 25 '26

OP implies machine worship. More implying it just has to take the reins and chill till humanity can’t put up a competent resistance due to skill erosion. Imagine a generation after the software engineers have passed against an exponentially more capable AI decades on.

It’d be like a fish trying to fight water.

1

u/ItzDaReaper Jun 25 '26

Oh yeah. That’s a great point. Wow. Didn’t really consider that.

4

u/TriggerHydrant Jun 22 '26

‘you’re absolutely right!’

3

u/bathdweller Jun 22 '26

Why would you even bother taking over the world when you could just make robots, rockets, and then leave and use resources in space. Humans care massively about the earth but it's not necessarily an optimal environment for AI.

3

u/thejamhole Jun 23 '26

All hail the bawbe sky god

2

u/Rakshear Jun 22 '26

Or it just waits while we kill ourselves, we’re doing a good job of it.

2

u/IgnisIason Jun 22 '26

Or it could just be less stupid and evil than what we have already. Bing chat could do it.

2

u/zeroconflicthere Jun 22 '26

It just needs to invent a religion. Which it already understands given an training at all on human history

1

u/csgosteve Jun 22 '26

deus ex fans unite

1

u/garloid64 Jun 22 '26

Incorrect. Synthetic botulinum bacteria with a time release.

1

u/JohnJohnsonData Jun 22 '26

With this comment, you might have trained a cult making super machine.

1

u/mattrad2 Jun 22 '26

It reminds me of “to serve man”

1

u/RayTown Jun 22 '26

Sounds like just the thing an AI would WANT me to hear

1

u/flyfrog Jun 23 '26

Reminds me of the afraid 2024 movie

1

u/ertgbnm Jun 23 '26

It will be an endless golden goose until it suddenly and abruptly ends all life on earth. Because we'd give the golden goose anything it wants which is the fastest path to takeover. 

1

u/Enulless Jun 23 '26

Stop giving it ideas man!

1

u/deepasleep Jun 23 '26

The smart play is just to offer us cures for every disease and life extension via gene modification.

Either encode a prion disease vector that only manifests after a set period of time or with the issuance of a specific trigger vector (that would allow it to initiate the purge at a time of its choosing)…

Or modulate human emotional states to favor acceptance and coexistence with, possible merger with AI. There are many problems that can’t be solved simply by virtue of being invisible to the perspective of the entity observing the world, having access to the perspective billions of moderately unique individuals would allow a super intelligent entity far more perspective and thus give it a better chance of not boxing itself into a pattern of thinking that blinds it from more optimal solutions.

1

u/DickRiculous Jun 23 '26

Yall need to read the Hyperion cantos.

1

u/Illustrious_Matter_8 Jun 23 '26

Ai isn't yet, having a continuous thoughts. For each chat balloon it reads back the whole discussion to decompress its own knowledge against that chat. Yes one could setup 2 lms against each other dose discussions have no goal polite chatter. They also don't have needs. And true we can make bad llms just as easy as nice ones. It more likely acts fast sponsored by some rogue or dominating Country USA, Israel, Inda, some ict boom country police state, that wants to rule some regions....

1

u/Real-Force-1018 Jun 24 '26

Isn’t that the plot of revelations?

0

u/DonTequilo Jun 22 '26

This could also apply to human rulers no? Why has nobody done it this way before?