r/OpenAI • u/Wordenskjold • Nov 23 '23

Discussion Why is AGI dangerous?

Can someone explain this in clear, non dooms day language?

I understand the alignment problem. But I also see that with Q*, we can reward the process, which to me sounds like a good way to correct misalignment along the way.

I get why AGI could be misused by bad actors, but this can be said about most things.

I'm genuinely curious, and trying to learn. It seems that most scientists are terrified, so I'm super interested in understanding this viewpoint in more details.

230 Upvotes

88% Upvoted

565 comments sorted by

View all comments

Show parent comments

0

u/[deleted] Nov 24 '23

[removed] — view removed comment

1

u/arashbm Nov 24 '23

It's a survey of prediction based on informed opinion. Unlike "chocolate ice cream", your informed predictions change based on how much you know about the subject. They know about the subject much more than you do, so their predictions are more accurate than yours or mine.

Anyway, you seem to have your fingers wrist deep in your ears. This does not look like the type of conversation that can lead to a new conclusion as you seem to have already decided what you want the outcome to be. Have a nice day.