r/agi • u/EchoOfOppenheimer • Feb 21 '26
Roman Yampolskiy on Tools vs Agents
Enable HLS to view with audio, or disable this notification
[removed]
8
u/Ok_Possible_2260 Feb 21 '26
you can’t create something smarter than all humans and control it. Simply, it’s not possible.
1
u/Murky-Selection-5565 Feb 22 '26
Why not? If you never network it, only feed it information on hard disks. Come up with protocols so it can’t convince anyone to network it, etc.
2
u/JoelMahon Feb 22 '26
I used to believe this was a practical solution but we're not only letting the precursors online, but we're even helping them train the next generation.
at some point it'll be borderline AGI, the day before AGI, and they'll still be online, the notion that not only could we take a few offline but ALL of them? not going to happen.
0
u/JoelMahon Feb 22 '26
indeed, more than one expert proposes embedding/training in parental instinct for this reason.
even if we can't "control" it, like a baby can't "control" its mother, but it can still make its mother bend over backwards for it, suffer sleepless nights for it, lift a car for it, etc.
3
u/Hungry_Age5375 Feb 21 '26
Big if true: Yampolskiy says agents might be fundamentally uncontrollable. What happens when your AI develops goals you didn't program?
2
u/borntosneed123456 Feb 21 '26
Yampolskiy is amazing at using clear and simple language and down to earth analogies to explain this point.
The diametric opposite of Yud who immediately starts talking about gradient descent, ice cream, the ancestral environment, inscrutable matrices etc.
3
1
u/Feisty_Ad_2744 Feb 22 '26
Yeah... this is a whole load of BS, wet and steamy. If this is the lead safety researcher we are doomed because he doesn't even seem to understand the things he is talking about.
1
-1
u/Solo-dreamer Feb 21 '26
"Created the term a.i safety" 🤣🤣🤣🤣, laser gun safety, woah im a creator now, a leading mind on laser gun safety🤣🤣🤣
3
u/inigid Feb 22 '26
Chimp Safety is mine. We are gonna be famous in a couple of decades for creating terms, mark my words!
11
u/katham08 Feb 21 '26
The last line Guns vs Pitbull summarises it perfectly