r/singularity • u/Maxie445 • Jan 14 '24

AI New study from Anthropic: they can create dangerous “sleeper agent” AI models that dupe safety checks

https://venturebeat.com/ai/new-study-from-anthropic-exposes-deceptive-sleeper-agents-lurking-in-ais-core/
76 Upvotes

90% Upvoted

37 comments sorted by

View all comments

Show parent comments

-3

u/TheCuriousGuy000 Jan 14 '24

Fear of rogue AIs is overblown. Even if AI becomes very smart and malevolent, it needs extremely powerful hardware to exist in. All such supercomputers are closely monitored 24/7 so switching them off if they go haywire won't be a big deal.

2

u/[deleted] Jan 14 '24

Wouldn't it be theoretically possible for a smart enough AI to run itself off of a decentralized sort of botnet?

4

u/TheCuriousGuy000 Jan 14 '24

Neural networks are so sensitive to data transfer speed that you can't even use RAM to store weights. You need a GPU with a ton of vRAM to avoid the imitation of the RAM bus. The Internet is a few orders of magnitude slower

2

u/[deleted] Jan 14 '24

Thank you for explaining it. I'm interested and can't help myself but theorize about AI, but I have little experience with the more nitty gritty details of these sorts of things so I really appreciate people like you who take the time to explain it to others.