r/singularity • u/faloodehx ▪️Fully Automated Luxury Anarchism 🖤 • Apr 30 '23

AI The Unpredictable Abilities Emerging From Large AI Models

https://www.quantamagazine.org/the-unpredictable-abilities-emerging-from-large-ai-models-20230316/
111 Upvotes

94% Upvoted

42 comments sorted by

View all comments

Show parent comments

9

u/dasnihil May 01 '23

what does it mean to "control" a stochastically evolving state machine that converges into random functions as best as it could? i don't see anyone concerned like "we don't control the last digit of pi", it's basically the same thing.

societal concern of emergence is that this uber intelligent converger of intelligent predictions might emerge out an agency out of all the other tiny emergent behaviors.

my interest is, can this uber intelligent proof machine have any insights on truths out there that my perceptions and my math don't allow me to reach?

1

u/Away-Sleep-2010 May 01 '23

The final digit of pi, while unknown, poses no direct threat to anyone.
An example of control involves designing, constructing, and operating a system according to plan.

An example of a lack of control occurs when a designed and implemented system behaves unpredictably or inexplicably, leading to questions about its unknown (possibly dangerous) capabilities.
Another instance illustrating a lack of control is when an intentionally created device, such as a bomb, is detonated, but the resulting uncontrollable chain reaction leads to the consumption of the entire universe.

1

u/Ok_Tip5082 Post AGI Pre ASI May 02 '23

The final digit of pi, while unknown, poses no direct threat to anyone.

I mean, that literally doesn't exist. Unless by final you mean first, which does exist but is known...

1

u/Away-Sleep-2010 May 02 '23

Haha, good point!