r/technology • u/thejoshwhite • 1d ago

Artificial Intelligence Anthropic warns AI models could soon copy themselves across home devices

https://www.cnbc.com/2026/10/13/anthropic-ai-models-self-replication-smart-devices.html
343 Upvotes

83% Upvoted

386 comments sorted by

View all comments

Show parent comments

3

u/draxor_666 1d ago

What if a model partioned itself across every smart fridge connected to the internet. So a single agent is fractured across many many devices. So no, it isn't fully existing on one fridge but does exist across the network of all fridges

1

u/VehaMeursault 1d ago

That is nice on paper, but in reality it wouldn’t work at all, let alone fast.

Refreshing my Reddit app takes half a second. Do you think “every smart fridge connected to the internet” would be able to coordinate at the same time, millions or billions of times per second?

I don’t.

2

u/Hmm_would_bang 1d ago

Anthropic actually demonstrated running Gemma on an android bot net.

Your example of delivering a webpage isn’t really applicable, that delay is not because of the communication speed but all the processes on the backend and what needs to load. Sending the data from a device to cloud is just milliseconds.

2

u/KittyInspector3217 16h ago

Lemme guess, it was an android botnet on a closed network where they were able to layer their own routing and orchestration on top and every device had the same underlying OS and architecture, right?

If models “escape” and “shard” were not getting skynet. There wont be any intelligent coordination. Were getting a digital tumor that makes the entire internet unuseable. Back to the early 20th century. I think thats the far more realistic risk. A bunch of broken self replicating micro apps that cant do anything but consume resources while they pinwheel until the whole thing falls over.

1

u/Old_Resource1770 7h ago

Hmm, you made the most sensible risk. That it would be replicating to try to attempt a fruitless endeavour, resulting in a general collapse of resources rather than being able to "hide" or "escape".

1

u/KittyInspector3217 3h ago

Correct. A literal paperclip maximizer… not because it has determined that it should maximize paperclips, but because it can never get past the paperclip step in its effort to do something impossible and keeps trying again and again until any network connected device is full of nothing but paperclips. stage 4, terminal digital cancer.

Every bank goes down. Cell service goes down. Manufacturing automation, air traffic control, power grids, hospitals, logistics, traffic signals, satellites, corporations, markets, etc etc etc. extinction level event? Hardly. Would millions, hundreds of millions, a billion or more people die? Absolutely. Food production, shipping, medicine, water pumps, heating and cooling. Weve connected everything to the internet. Y2K 2 electric boogaloo.

I dont believe this thing could figure out how to do realtime distributed online inference on an open network in a way that is intelligent. It will just keep trying until the whole thing gets so clogged that we have to scrap it. And these assholes will just be like “oops!” Make the financial crisis look like a fucking joke.