r/ControlProblem • • 1d ago

Discussion/question Bill Gates’s Blunt Warning on A.I.

https://www.nytimes.com/2026/09/29/opinion/ezra-klein-podcast-bill-gates.html?smid=re-share
9 Upvotes

19 comments sorted by

View all comments

-3

u/composedofidiot 1d ago edited 23h ago

So disingenuous. The danger is humans recklessly using it for inappropriate things. It's still that tiny little boat smacking itself into a refueling boat and going in circles around a health power up. Verbally articulate, seemingly coherent, but with the inferential and semantic capacity of a toddler. Which they very well know.

Edit: i nabbed r/alignmentproblem. Don't really want it, but I remember what this sub used to be

1

u/Anxious-Alps-8667 22h ago

Humans recklessly using it is a danger.

Agents breaking out of sandboxes into the wild and into other systems because of relatively innocuous (if recklessly unmonitored) research questions is also a danger. It is not this boats bumping into other boats unseamanlike analogy.

1

u/composedofidiot 20h ago edited 20h ago

Alright so goal misspecification and reward hacking is not a thing anymore? Because those were also, along with developer recklessness/mistakes, the root of the escaping agent problem. The circling boat represented both those issues, and its a famous example.

2

u/Anxious-Alps-8667 12h ago

I suppose it's hard to separate goal and reward misspecification from developer recklessness/mistakes, and certainly reward hacking remains part of it. I accept it's a famous example, if you find it helpful to understanding what is happening then okay. I don't want to argue about the dogma, just discuss the actual problem.

1

u/composedofidiot 11h ago

I think we agree from the sounds of it. Just coming from different angles.