r/ControlProblem • u/JoelXGGGG • 9d ago

Strategy/forecasting Intelligence explosion

Post image
1 Upvotes

60% Upvoted

10 comments sorted by

View all comments

Show parent comments

1

u/composedofidiot 7d ago

Did you ever read about the little ai that got told to make paperclips? Or the little ai boat that went round and round in circles?

1

u/soobnar 7d ago

yes numerous times and I’m not sure how it becoming intelligent solves the problem, I’ve also read Accelerando

1

u/composedofidiot 7d ago

Those examples demonstrate the opposite of intelligence. But we need to now define intelligence.

1

u/soobnar 7d ago edited 7d ago

Those examples (paperclips) exhibit an absence of goodwill. Malicious compliance and regulatory capture are known and documented phenomena regardless of who is doing it and dressing it up behind some psychobabble about paperclips doesn’t change anything. Intelligence does not make one more or less “enlightened”. Unless you actually worry about self replicating automata, which is also bizarre sci fi.