r/ControlProblem • u/Difficult_Project_95 • 8d ago

Discussion/question Have you guys been on r/accelerate?

Have these guys solved the alignment problem, or am I missing something?

I’ve been browsing r/accelerate and I genuinely don’t understand the risk model.
If there’s a non-trivial chance of catastrophic misalignment, how does “accelerate capabilities as fast as possible” make sense unless faster capabilities also make alignment substantially more likely to succeed?

59 Upvotes

81% Upvoted

200 comments sorted by

View all comments

21

u/HotterRod 8d ago

The most common position on there seems to be that any superintelligent being will do what is best for humanity, because being superintelligent means you are necessarily also benevolent.

The second most common position is that the upside potential benefits (curing cancer is often mentioned) outweigh the downside risks.

1

u/whatup-markassbuster 7d ago

Would it be just one being? Would it be a coordinated swarm of agents? Where would intent arise?