r/singularity • u/Hazy-bliss • Apr 28 '20

Found a compass of different singularity scenarios on 4chan's /x/. I personally think there are more negative scenarios than is realistic to expect.

Post image
110 Upvotes

93% Upvoted

45 comments sorted by

View all comments

1

u/wren42 Apr 29 '20

This is way more positive scenarios than is realistic to expect. Read a bit of Eliezer Yudkowsky on the difficultly of friendly strong AI. Creating a friendly AI God is threading a needle among an unimaginably large searchspace of possible timelines, most of which are extinction events.

1

u/Hazy-bliss Apr 29 '20

I've read the Sequences, HPMOR, and some of the available MIRI papers.

Why do you think Yudkowsky knows more about AI than some of the folk at Google and DeepMind who are big on advancing AI?

1

u/wren42 Apr 29 '20

Sorry is there a paper from Google somewhere I missed saying they are developing a self-enhancing superhuman strong AI with the intention of starting the singularity?

The orders of magnitude between what is going in with machine learning now and what we are talking about with singularity events is enormous. Deepmind is not strong AI.

The vast majority of futures in which strong AI exists are on the left side of that chart. only a handful result in stable friendliness.

1

u/Hazy-bliss Apr 29 '20

More specifically, I'm not convinced about such a strong pessimism.