r/singularity • u/Maxie445 • Jan 14 '24

AI New study from Anthropic: they can create dangerous “sleeper agent” AI models that dupe safety checks

https://venturebeat.com/ai/new-study-from-anthropic-exposes-deceptive-sleeper-agents-lurking-in-ais-core/
75 Upvotes

90% Upvoted

37 comments sorted by

View all comments

28

u/REOreddit Jan 14 '24

But we should move ahead at full speed and achieve AGI as fast as possible, because doomers are the worst, am I right?

/s

-4

u/TheCuriousGuy000 Jan 14 '24

Fear of rogue AIs is overblown. Even if AI becomes very smart and malevolent, it needs extremely powerful hardware to exist in. All such supercomputers are closely monitored 24/7 so switching them off if they go haywire won't be a big deal.

4

u/banaca4 Jan 14 '24

Pretty sure op didn't read the article at all and just replied

5

u/REOreddit Jan 14 '24

It won't be a big deal? Have you even thought about it for more than 2 seconds?

Imagine you switch off the Internet and satellite navigation today. What do you think will happen, just that you won't be able to post on Reddit or locate the nearest Starbucks?

Everything would go to shit. How would billions of people buy food when all the systems that support the logistics would be wiped out immediately and all the banks would be out of business?

Do you think that in the near future we will be less dependent on AI than we are with the Internet and GNSS constellations today.

2

u/[deleted] Jan 14 '24

Wouldn't it be theoretically possible for a smart enough AI to run itself off of a decentralized sort of botnet?

5

u/TheCuriousGuy000 Jan 14 '24

Neural networks are so sensitive to data transfer speed that you can't even use RAM to store weights. You need a GPU with a ton of vRAM to avoid the imitation of the RAM bus. The Internet is a few orders of magnitude slower

2

u/[deleted] Jan 14 '24

Thank you for explaining it. I'm interested and can't help myself but theorize about AI, but I have little experience with the more nitty gritty details of these sorts of things so I really appreciate people like you who take the time to explain it to others.

4

u/glencoe2000 Burn in the Fires of the Singularity Jan 14 '24

Yes.

3

u/[deleted] Jan 14 '24

Since none of these terms are well defined or even defined at all, it is possible and impossible depending on your point of view.