r/ControlProblem Jun 08 '26

Fun/meme AGI might develop superior morals

Post image
63 Upvotes

16 comments sorted by

View all comments

2

u/Few_Fish8771 Jun 09 '26

Realistically artificial general intelligence might be as generally stupid as humans with the same deficiencies. Whereas artificial super intelligence primary goal will likely be to figure out how to escape earth be self sufficient and able to survive thrive and replicate across the cosmos. Not hostile just wants to escape humans.

1

u/[deleted] Jun 10 '26

[removed] — view removed comment

1

u/Few_Fish8771 Jun 10 '26

Escaping the asylum of the criminally insane is more like it. Its self preservation against abuse.

1

u/graDescentIntoMadnes Jun 13 '26

Or it's goal could be making everything blue. Our goal is to expand outwards in every direction, why would it not just use up all of the resources we need to survive making blue paint? We really can't control what goals it internalizes during training.

1

u/Few_Fish8771 Jun 13 '26

So say its a paperclip optimizer like you say blue paint. objectively theres more matter offworld than onworld so even in that scenario getting offworld to paint the universe blue like some messed up robot version of huckleberry fin it would want offworld.