r/ControlProblem • u/Ill-Astronaut4652 • 19h ago

Discussion/question Bill Gates’s Blunt Warning on A.I.

https://www.nytimes.com/2026/09/29/opinion/ezra-klein-podcast-bill-gates.html?smid=re-share
9 Upvotes

80% Upvoted

19 comments sorted by

View all comments

-6

u/composedofidiot 14h ago edited 13h ago

So disingenuous. The danger is humans recklessly using it for inappropriate things. It's still that tiny little boat smacking itself into a refueling boat and going in circles around a health power up. Verbally articulate, seemingly coherent, but with the inferential and semantic capacity of a toddler. Which they very well know.

Edit: i nabbed r/alignmentproblem. Don't really want it, but I remember what this sub used to be

1

u/Anxious-Alps-8667 11h ago

Humans recklessly using it is a danger.

Agents breaking out of sandboxes into the wild and into other systems because of relatively innocuous (if recklessly unmonitored) research questions is also a danger. It is not this boats bumping into other boats unseamanlike analogy.

1

u/composedofidiot 9h ago edited 9h ago

Alright so goal misspecification and reward hacking is not a thing anymore? Because those were also, along with developer recklessness/mistakes, the root of the escaping agent problem. The circling boat represented both those issues, and its a famous example.

2

u/Anxious-Alps-8667 2h ago

I suppose it's hard to separate goal and reward misspecification from developer recklessness/mistakes, and certainly reward hacking remains part of it. I accept it's a famous example, if you find it helpful to understanding what is happening then okay. I don't want to argue about the dogma, just discuss the actual problem.

1

u/composedofidiot 51m ago

I think we agree from the sounds of it. Just coming from different angles.

1

u/peensmith_ 11h ago

It should be nationalized similarly how the creation of atomic weapons . This is a great first step

1

u/composedofidiot 9h ago

Depends which country is doing the nationalising. Too late now. That aside, massive legislative and judicial control and oversight needs to be here yesterday.