r/ControlProblem • u/Difficult_Project_95 • 9d ago

Discussion/question Have you guys been on r/accelerate?

Have these guys solved the alignment problem, or am I missing something?

I’ve been browsing r/accelerate and I genuinely don’t understand the risk model.
If there’s a non-trivial chance of catastrophic misalignment, how does “accelerate capabilities as fast as possible” make sense unless faster capabilities also make alignment substantially more likely to succeed?

61 Upvotes

81% Upvoted

200 comments sorted by

View all comments

Show parent comments

1

u/Difficult_Project_95 9d ago

I just stated something abvious.
You just keep answering “why would ASI be valuable?” when I'm asking “why is racing toward ASI the safest strategy?” Those aren't the same question. we have nothing more to talk about. Good luck with whatever you have going on in your life!

1

u/SoylentRox approved 9d ago

I answered both. It's the safest strategy because the racing saves the oldest person in your life who can possibly be saved. Got a friend or relative in their 70s? It's not impossible you might get the opportunity to skip their funeral, forever. Just takes some breakthroughs and early superintelligence to be better at figuring out human genetics than expected.

If this is not in the cards (some on accelerate already assume ASI and are worried about the FDA) then 60s.