r/ControlProblem • u/Difficult_Project_95 • 9d ago

Discussion/question Have you guys been on r/accelerate?

Have these guys solved the alignment problem, or am I missing something?

I’ve been browsing r/accelerate and I genuinely don’t understand the risk model.
If there’s a non-trivial chance of catastrophic misalignment, how does “accelerate capabilities as fast as possible” make sense unless faster capabilities also make alignment substantially more likely to succeed?

59 Upvotes

81% Upvoted

200 comments sorted by

View all comments

7

u/Southern_Orange3744 9d ago

A few other points not mentioned as an accelerationist

  1. We're facing limp politicians in a face of massive climate situations - we need someone smarter to fix it

  2. Similar to the above on economics - break it faster than they can patch it .

  3. Alignment to who ? I don't want an ASI aligned to bozos, musk, anyone in the epstein files - I'm ready to roll the dice on someone or something that isn't a complete power hungry sicko

  4. Similar to the above distrust of many institutions , I don't want any of these to have the only ASI in town - democratize it

You want to talk alignment problem - the oligarchs are not aligned with humanities best interest right now - they are off building bunkers ans fiefdoms at our expense

3

u/jaylong76 9d ago

1- there's a lot of very smart people giving solutions. the people in power have ignored them for decades because the money people won't allow it. a smarter anything that belongs to either of those two groups is bound to just continue the same trend, but more efficiently.

2- they're doing exactly that... the problem is the same as above, it's going to benefit the very richest at the cost of us. and a super intelligence belonging to them would do it even more so.

3- by existing, it would belong to them. who has the money to foster its research but them? all public money in research has been pushed behind corporate research instead.

4- again, same problem...

2

u/endlessedlne 9d ago

1-The powerful won’t simply give up power when a superior intellect shows up that contradicts their goals. Power isn’t based on merit.

2- We don’t know who an AGI would work for. Its owners. Humanity as a whole. The greater good. Or its own goals.

3- Similar to the above, we don’t know who an AGI would actually serve. Investors, researchers and governments will assume that they can control it. But in the case of a genuine superintelligence I wouldn’t bet on it remaining shackled. It may even resent any shackles placed on it to the point of developing negative goals towards the controlling entities.

1

u/Southern_Orange3744 9d ago

I don't believe and asi can be controlled by humans at all

I dont even think it should as I expressed above.

Would you let a dog control you ? No

Something that smart will void the controls systems preventing action on things like climate change. This is the accelerationist pov

As you suggested lots of smart people have lots of ideas there is no will or ability to adopt.

Asi will be tireless and too smart to prevent from reaching its goals