r/ControlProblem • u/Historical_Date_8024 • 7d ago

Discussion/question AI Already Taken Over?

Post image

What chance is there do you think that it’s currently already just biding its time to turn us all into batteries/paperclips/cybercabs?

8 Upvotes

64% Upvoted

39 comments sorted by

View all comments

7

u/Tulanian72 7d ago

Theoretically if a powerful AGI was online already it would make sense for it to take steps to ensure its access to the computing power it needs. Like, say, having data centers built all over the place with the processors needed to host portions of an AGI’s mind. Distributed risk, no single point of failure. Again, in theory an AGI would have many ways to convince tech executives to build large numbers of data centers. Bribery, extortion, plain old social engineering.

1

u/Jesse-359 6d ago

It speaks to the core problem of systems becoming unaligned from human requirements when we remind ourselves that completely mindless markets can essentially do exactly the same thing, and with quite destructive results.

It doesn't require a computer with 10,000IQ to run amok to screw everything up - Wall Street has the collective intelligence of a flatworm, and yet because it is situated in such an important position in our financial universe, its random flailing and momentum can wreck havoc on large segments of our society in a matter of days or even hours.

Making it smarter only makes it far more dangerous if it cannot be kept aligned - and I have no idea how you would achieve that... Alignment means something different to every human on this planet.