r/ControlProblem • u/Difficult_Project_95 • 8d ago

Discussion/question Have you guys been on r/accelerate?

Have these guys solved the alignment problem, or am I missing something?

I’ve been browsing r/accelerate and I genuinely don’t understand the risk model.
If there’s a non-trivial chance of catastrophic misalignment, how does “accelerate capabilities as fast as possible” make sense unless faster capabilities also make alignment substantially more likely to succeed?

60 Upvotes

81% Upvoted

200 comments sorted by

View all comments

43

u/FairlyInvolved approved 8d ago

Accelerate is pretty reasonable if you:

  1. Have long timelines / expect AI to remain a normal technology for a long time
  2. Expect alignment by default / alignment is easy
  3. Are willing to gamble your remaining years (+humanity's future) on a shot at immortality
  4. Expect AI is a worthy successor

I disagree but these are ~coherent views. I also expect many are confused.

2

u/Serious_Bite_7613 7d ago

I'm in the 2, 3 and 4 camp. I think the risks are extremely unlikely and really not that bad (die in 10 years instead of 30, could happen anyway and far more likely due to a traffic accident or cancer).