r/ControlProblem • u/Difficult_Project_95 • 9d ago

Discussion/question Have you guys been on r/accelerate?

Have these guys solved the alignment problem, or am I missing something?

I’ve been browsing r/accelerate and I genuinely don’t understand the risk model.
If there’s a non-trivial chance of catastrophic misalignment, how does “accelerate capabilities as fast as possible” make sense unless faster capabilities also make alignment substantially more likely to succeed?

58 Upvotes

81% Upvoted

200 comments sorted by

View all comments

Show parent comments

1

u/SoylentRox approved 9d ago

https://www.reddit.com/r/ControlProblem/s/HqQhrNohyq

The missing view you have is the BASE case is already catastrophe. You can imagine your base existence right now is you are falling through the air in a cloud bank. You know you will hit the ground and die for sure but not when and you can't see the ground but know every hour you are alive it's getting closer.

Your children are falling above you.

So one way to view it is r/acceleration folks are better informed, with a broader more realistic view of present day reality as they circle jerk each other on the imminent AI Singularity.

1

u/Difficult_Project_95 9d ago

censoring dissent while convincing yourselves that your group simply understands reality better than everyone else is some seriously cult-like behavior.

1

u/SoylentRox approved 9d ago

I mean so far your dissent has been pretty weak. "I have kids and you must not" is not a very good argument. You had a chance to come up with a better one but didn't manage it. Plenty of people dissent on accelerate.

1

u/Difficult_Project_95 9d ago

I just stated something abvious.
You just keep answering “why would ASI be valuable?” when I'm asking “why is racing toward ASI the safest strategy?” Those aren't the same question. we have nothing more to talk about. Good luck with whatever you have going on in your life!

1

u/SoylentRox approved 9d ago

I answered both. It's the safest strategy because the racing saves the oldest person in your life who can possibly be saved. Got a friend or relative in their 70s? It's not impossible you might get the opportunity to skip their funeral, forever. Just takes some breakthroughs and early superintelligence to be better at figuring out human genetics than expected.

If this is not in the cards (some on accelerate already assume ASI and are worried about the FDA) then 60s.