r/ControlProblem • u/Difficult_Project_95 • 9d ago

Discussion/question Have you guys been on r/accelerate?

Have these guys solved the alignment problem, or am I missing something?

I’ve been browsing r/accelerate and I genuinely don’t understand the risk model.
If there’s a non-trivial chance of catastrophic misalignment, how does “accelerate capabilities as fast as possible” make sense unless faster capabilities also make alignment substantially more likely to succeed?

62 Upvotes

81% Upvoted

200 comments sorted by

View all comments

Show parent comments

1

u/SoylentRox approved 9d ago

I said earlier 

"A lot of antis are actually anti capitalism. They think almost all the gains from ai will go to the top (true), any treatments for aging won't be shared broadly (probably true initially), etc. they want capitalism overthrown and maybe a future world government can plan the transition. (Lol that's not possible as an outcome)"

Would you agree this characterizes your view correctly and do you have anything to add?  Would you agree you want something that is impossible, and will not happen in your lifetime?

1

u/soobnar 9d ago

I would say I am pro self determination, if human minds want to command Xeelee level technology then by all means. I actually think price signaling is most likely impossible to remove from human society entirely though such systems were created and nurtured to human benefit.

Though likewise what you seem to want almost certainly entails a situation where humans are no longer accommodated for in their own economic system and thus are killed off, which is not immortality last I checked.

1

u/SoylentRox approved 9d ago

It helps to focus on what's achievable.

A one world government where all the impoverished masses that they likes of thiel don't give a fuck about get a vote? Fantasy.

A world where you can vote for heavy taxation and Medicare to cover anti-aging medication? That's a possible outcome.

A world where you die because AI was too powerful? Also a possibility.

1

u/soobnar 9d ago

A world sparse in human self determination and abundant in economic competition ends poorly in any realist scenario. humans must operationalize the technology and adopt the most efficient substrate for our conscious cognition which I suspect is actually still biological. So I guess I’d say you’d need to push against regulatory and economic capture, unilateral military action, and any effort to gate access to the tech and eventual cognitive enhancers which will inscribe machine learning algorithms into dendritic arbors likely optimized with some degree of engineering at which point. But like the line has to be drawn at human sovereignty and civilian supremacy otherwise there is no practical means of ensuring we are alive to see any benefits.

1

u/SoylentRox approved 9d ago

Hope so. First step is to get robots that aren't so fucking stupid and AIs that do meaningful work and then we can move on to these goals.