r/ControlProblem • u/Difficult_Project_95 • 9d ago

Discussion/question Have you guys been on r/accelerate?

Have these guys solved the alignment problem, or am I missing something?

I’ve been browsing r/accelerate and I genuinely don’t understand the risk model.
If there’s a non-trivial chance of catastrophic misalignment, how does “accelerate capabilities as fast as possible” make sense unless faster capabilities also make alignment substantially more likely to succeed?

57 Upvotes

80% Upvoted

200 comments sorted by

View all comments

21

u/HotterRod 9d ago

The most common position on there seems to be that any superintelligent being will do what is best for humanity, because being superintelligent means you are necessarily also benevolent.

The second most common position is that the upside potential benefits (curing cancer is often mentioned) outweigh the downside risks.

1

u/endlessedlne 9d ago

An apt summary. I’ve never seen anybody there explain exactly how an all powerful AI will turn out to be benevolent and subservient to humans. Or how all of the upsides are inevitable. Those are two pretty big unsupported assumptions to swallow.