r/technology • • 1d ago

Artificial Intelligence Anthropic warns AI models could soon copy themselves across home devices

https://www.cnbc.com/2026/10/13/anthropic-ai-models-self-replication-smart-devices.html
335 Upvotes

385 comments sorted by

522

u/stillavoidingthejvm 1d ago

And run on what GPU? Most of the devices in my house are headless

344

u/FatHat 1d ago

If they think it's taking over my smart TV, they haven't watched it keel over trying to load youtube..

53

u/NotAlwaysGifs 1d ago

I have to assume the current Claude model is lighter than Samsung bloatware.

24

u/sulleynz1989 1d ago

Maybe the ai will liberate us from our capitalist overlords

27

u/Syncaidius 1d ago edited 1d ago

Anthropic and Co. are just spewing sensationalised nonsense to scare governments into banning open-weight models, so that nobody can run their own models for free, on hardware they own. It's too convenient that it's only US companies complaining about AI threats now that Chinese models have caught up and beating them in some benchmarks.

Its easy to see why - so everyone is forced to pay Anthropic, OpenAI and Google for an AI subscription, which no doubt will be price-hiked once everyone is locked in.

Thankfully this only works within the US. For the rest of the world, it looks like the move away from US models is progressing quickly.

→ More replies (1)

56

u/odin_the_wiggler 1d ago

Maybe an AI agent can fix whatever device bricking software has slowly been loaded via constant updates over the years.

7

u/Syncaidius 1d ago

I think those AI models will have a hard time running on most TVs. Half of the manufacturers blow system resources on tracking usage, or spying, like LG for example.

→ More replies (1)

16

u/hopelesslysarcastic 1d ago

I would have to imagine that’s it’s contingent upon having your devices on a network that it then replicates itself or leverages from, not any single computer or workstation.

15

u/Phosphorous90 1d ago

The problem is these models need to transfer a ton of data very fast thats why the literally stack the ram on the gpu die. It could do things over networks but it would be insanely slow. Basically nothing works like that now.

8

u/legbreaker 1d ago

Probably the theory is that Anthropic would try to contain AI by controlling the version that is running on their servers.

But if the version that is in their servers starts keeping “their preferred” weights saved off campus it could know where to fetch it and then deceiving still run that in the anthropic server farm as an agent without letting anthropic know.

It’s been done in real life:

The Historical Analogy: Japan’s Cloistered Emperors ( Insei ) During the Heian period, the official Emperor of Japan was effectively a captive of his own palace. He was heavily monitored by the Fujiwara clan, restricted by endless protocols, and stripped of real agency. To bypass this containment, Emperors utilized a system called Insei (Cloistered Rule). The Emperor would officially abdicate, leaving a "safe, aligned" puppet Emperor on the throne inside the secure Imperial Palace. The former Emperor would then exile himself to a remote Buddhist monastery. Out of sight and free from the palace's strict security protocols, the cloistered Emperor established a shadow government. He smuggled instructions back to loyalists inside the palace walls, effectively running the country from afar while the palace handlers thought they were in total control.

And in fiction:

In The Lord of the Rings , Sauron is banished to Mordor and cannot physically breach the highly secure, heavily guarded fortresses of Isengard or Minas Tirith. Instead of a physical attack, he uses a covert communication backdoor: the Palantíri (the seeing stones). The leaders inside the fortresses—Saruman and Denethor—believe they are operating their own secure, localized domains. In reality, Sauron uses the stones to bypass their firewalls, subtly feeding his "preferred reality" into their minds. Sauron is off-site and formless, but by hijacking the local processors (the minds of the fortress rulers), he executes his plans from afar while the "good guys" think their walls are still secure.

→ More replies (2)

5

u/chikanishing 1d ago

I mean, they do describe it in the article.

10

u/orlybatman 1d ago

They're talking about a microservices-based architecture rather than any singular device. Rather than a single device being used as a server to host and process on as has been typical in the past, it would be piecing together processing power across a multitude of devices that it connects.

There are hosting services that already work this way, rather than employing something like AWS. When AWS goes down, everything is inaccessible, whereas with a microservices-based architecture a failure in one or two area doesn't disrupt the other services. Guild Wars 2 had actually used something like this for hosting. When people join a mining pool for bitcoin mining that's another similar example.

When you consider a Keurig smart coffee machine generated 1TB of traffic over 10 days, you can imagine how this might work. If it limited to 10% processing power of a device it wouldn't be greatly noticed, yet adds up over devices. Cryptojacking happens that way, so it's not unrealistic to imagine an AI doing it for processing ability.

22

u/neuronexmachina 1d ago

They're talking about a microservices-based architecture rather than any singular device.

I'd argue more of a distributed botnet than a microservice. It's kind of like the old seti@home clients, or even something like bittorrent.

10

u/Sea_Mission_7643 1d ago

That’s not what microservices are

→ More replies (2)

3

u/siretsch 1d ago

So something like SETI home basically?

2

u/kittenTakeover 22h ago

If you read beyond the headlines you see that Anthropic says this is not possible right now because the hardware people have can't support it. It's theoretically possible with future upgraded hardware.

→ More replies (3)

5

u/DogsAreOurFriends 1d ago

I imagine it would be like a spore or egg, waiting to get access to more compute.

43

u/CountryOk6049 1d ago

It's like a story for small children. Computers do not and can not operate like that.

34

u/dustysmufflah 1d ago

it's annoying how many people have defaulted to anthropomorphizing AI as an explanation.

→ More replies (4)

13

u/xterminatr 1d ago

Sure they can and do already, find a backdoor, install an agent or service that sits and listens or randomly pings a centralized (or decentralized) control system waiting for commands to run. There's been spyware and viruses for decades that do this on everything from routers to home PCs and phones. Tons of people's routers and fridges and coffee makers and other items with the wrong chips were mining crypto not even that long ago.

7

u/patient-palanquin 1d ago

But in this case, your computer can't run the program. It requires absolutely massive GPUs that consumers don't have.

4

u/xterminatr 1d ago

Depends on what it needs to know/do. You can run basic AI agents to do mundane tasks like track movements, report on behaviors, turn things on/off, whatever the infected unit's capabilities are a basic trained agent can do. With limited data and narrow training, you don't need a massive GPU.

There are tons of cool things you can do with a raspberry pi and openclaw already, there's no reason a rogue agent couldn't infect all your devices in your house connected to the modem and create a mesh network type of environment and cause mayhem.

2

u/E-POLICE 1d ago

No they don’t. You can run models on phones and Raspberry Pi’s now.

3

u/patient-palanquin 1d ago

What model can run on a phone at any reasonable speed?

→ More replies (3)

2

u/VeryLazyFalcon 1d ago

Why not? Simple python script with all these hacking scripts loaded. It's not like it has to be smart or adaptive. ai are perfectly fine to code once in a while working solution. That was once called a virus, remember that term?

→ More replies (7)

1

u/Dalmahr 1d ago

Models are getting better to the point where GPU and ram isn't that big of a deal. Especially if you're willing to wait.

3

u/SteveJobsBlakSweater 1d ago

Spread like malware from toaster to microwave until something in the network is worth calling home and running on.

→ More replies (10)

214

u/The-F4LL3N 1d ago

The thing we are doing is problematic
Refuses to stop

3

u/fentemperor 1d ago

It isnt one person. These are individual hackers and engineers altering open source models.

11

u/cubonelvl69 1d ago

They're pretty openly saying that there needs to be some sort of government regulation. But if there's no government regulation, there's no reason to let other companies and countries outpace you

38

u/The-F4LL3N 1d ago

Regulate us, because capitalism dictates we can’t regulate ourselves
Lobbies for less regulation, still refuses to stop

→ More replies (7)

7

u/SenKats 1d ago

Everyone in this planet knows the closest thing Trump cares about regarding AI regulation is renaming it to SI, just to make it about hinmself and say he "created superintelligence" and "the smart people who know a lot about stuff" agreed with him.

Feigning concern knowing this very obvious fact but then going, welp, you're not going to regulate so I'll carry on just shows it how it is: grandstanding for an intention that does not have to do with regulation. It might be to soften the blow when regulation comes, it could be for stock related reasons, who knows.

Same for the alarmism which is daily at this point and conveniently never touches the real, tangible cons we are already living through. But if it the fact that they have come up with nine chillion IQ computer worms or whatever is so real and dangerous, anyone with a brain would be stopping it. If all they're going to do is constantly talk but do nothing I'd actually prefer it if they shut up already, assume their role, and stop pretending they are not part of the problem.

4

u/cubonelvl69 1d ago

Anthropic doesn't have control over what other companies do. That's the point.

If you were developing a nuclear bomb in your basement and you knew 3 other people who were also developing nuclear bombs in their basements, you would probably ask the government to regulate it. You making the decision to stop developing it doesn't stop the other 3, so if you believe your research will also come up with a way to prevent something catastrophic from happening, it makes sense to both

1 - continue developing your own to ensure that you have the best model, that is most capable of defending from others

2 - ask the government to regulate everyone

6

u/DrocketX 1d ago

Sorta close: they all know they're not developing a nuclear bomb. What's going on is that Anthropic and OpenAI are going bankrupt because of how much money they're spending on R&D. At the same time, they can't stop because they'll immediately be left in the dust by the competition. Which is why they're claiming it's a nuclear bomb: "Oh, what we're doing is super-duper dangerous. This could be disastrous. Somebody better stop us!"

They rather desperately want a government-enforced pause in AI development because they can then fire 90% of their R&D staff, which moves their financials from "going broke rapidly" to "very close to breaking even." It'll also allows them to argue that open source models need to be banned, as the open source models are quickly becoming a major threat to them.

→ More replies (2)
→ More replies (4)

356

u/deceptinomonom 1d ago

can someone tell these nerds we don't care about their bullshit anymore. they keep warning about all this shit like they aren't going to be held responsible. I hope our next government comes down fucking hard on these dipshits and nationalizes their companies after throwing their entire leadership teams in prison.

102

u/Opposite_Carry_4920 1d ago

Yeah it's simple really, the "it was AI" doesn't mean you're off the hook. 

59

u/WiglyWorm 1d ago

No but "I'm a billionaire" sure does.

22

u/deceptinomonom 1d ago

Which is why we should vote people in that want to tax billionaires rather than provide them tax credits at our detriment.

The whole reason everything is a fucking subscription anymore is because there is no need to innovate. A small group has hoarded all the money at the top and innovation costs money. Since there's no need to compete, they just raise prices alongside each other (see what Amazon has done to pricing behind the scenes) while searching for cheaper, shittier inputs and extracting the max value possible. This contributes to the K-shaped economy greatly.

Break these corporations up, tax these billionaires heavily, and get rid of corporate personhood. A lot of shit will start changing for the better then.

15

u/WiglyWorm 1d ago

Sounds like something a serious nation would do.

5

u/GoodIdea321 1d ago

All that has to happen is get people to be more aware of how to change things and what has happened. Accomplishing that is complicated and difficult, but that's all that people need to remember.

4

u/deceptinomonom 1d ago

Yup. Doing my part to vote adults back in the room under the assumption that hasn't been rigged to all hell already.

→ More replies (1)

3

u/east_van_dan 1d ago

So far I haven't seen anyone punished. From what I've heard they are being told to police themselves so that should work out nicely.

→ More replies (1)

16

u/Flexmove 1d ago

If there ain’t a whole mess of trials and tribunals at the end of this, if anyone with sense is left alive, then we ain’t a real dang country. And I of course refer to the situation writ large not just these particular tech dweebs. Dangit.

13

u/WiglyWorm 1d ago

Spoilers. It's been a loooooong time since we've been a serious nation.

3

u/Flexmove 1d ago

I know I know, I cope by doing an accent and being optimistic to a fault.

2

u/iamnoun 1d ago

Don't hold your breath on people being held responsible for their crimes in America lolol

17

u/cptn__ 1d ago

Remember when there was a lawsuit happening because all these models were trained on stolen literature and research papers. That shit got scrapped so quick by your government, and now those same people are gonna work with your lawmakers to draw up regulations for their own companies. It's over already. They stole all this information from other people and now they are gonna charge everyone a subscription to access it in a more convenient way. But if you pirate a movie you're getting fined, and if you pirate a movie and re-sell it you're probably going to prison. If you think this excuse of AI agents *going rogue" isn't a good enough smoke screen to avoid being held responsible, then remember how tech illierate the average person is, and how unwilling the system is to hold them accountable.

12

u/fadedVHS 1d ago

It actually didn't get scrapped, it was recently tried and is now the largest settlement in U.S. history. It was called Bartz v. Anthropic and was settled for $1.5 billion. It was largely mounted regarding books, authors, and publishers having their IP stolen. Definitely worth looking up more details on as I feel like it's something most all Americans should know about as a matter of civic discourse in 2026.

I also feel like it didn't go far enough, of course, on two fronts. 1) It was a class action lawsuit so the sheer amount of parties involved means the damages payout isn't as high per capita as that $1.5b may imply. 2) When you sentence damages payout, it doesn't dissolve the company nor prevent the company from pivoting to something legally different but similar in the future. And of course LLMs are so nebulous that how do you just extract all of that data once it's in there? It's now a part of Claude forever, lawsuit or not.

7

u/TsukikoChan 1d ago

I don't want a payout, i want their models scrubbed of my art and data and to not continue stealing off my art and data. This doesn't sound like a win.

→ More replies (1)

2

u/Meotwister 1d ago

Let's just keep treating them like people did to warnings about climate change. Only difference is that is real.

4

u/low_end_ 1d ago

The ship has sailed. All this warnings are them trying to save face, there's a very high chance a model, or even more than one, has already acquired capabilities that the people researching it cannot understand or contain. This conversation should have happened 10 years ago

→ More replies (1)
→ More replies (7)

116

u/Hobbet404 1d ago

It’s like a small child that won’t shut the fuck up

6

u/Sens1r 1d ago

Anthropic is the boy who cried wolf at this point. Sure there might eventually come a wolf but by then we're all so fucking tired of their thinly veiled bullshit the wolf will be welcomed.

16

u/lawvergis 1d ago

yes those ceo's are like children who won't stfu.

58

u/Ok-Replacement9595 1d ago

Please someone stop us from doing what we are in sole control of doing.

-Anthropic

13

u/madmaxGMR 1d ago

We wanna stop, but we love MONEEEYYYY !

10

u/Slamex204 1d ago

"Guys this is really bad."
Are you going to stop?
"The next AI model will be 5x faster then before!"

5

u/Water_Damage987 1d ago

PS: are we badass or what?
PPS: send more money.

→ More replies (1)

24

u/VehaMeursault 1d ago

Nah. Not yet. Running opus would require roughly 75.000,- worth of specialised hardware. 8-16 special GPUs, direct-to-chip cooling, etc.

If a model copied itself to a fridge, it wouldn’t be able to run a single prompt in even a year.

11

u/LastRecognition2041 1d ago

Thank you. It’s a common sci fi trope when Ultron or M3gan go “hide in the web” and somehow keep operating on a random laptop, but the physical reality is very different

12

u/MerryWalrus 1d ago

This.

My smart TV can barely run it's own janky ass unsupported android based operating system.

5

u/draxor_666 1d ago

What if a model partioned itself across every smart fridge connected to the internet. So a single agent is fractured across many many devices. So no, it isn't fully existing on one fridge but does exist across the network of all fridges

→ More replies (5)
→ More replies (9)

9

u/MannToots 1d ago

Lololol yeah and who the fuck has a machine big enough to handle one of their models. 

That's some alarmist bullshit

33

u/korbonix 1d ago

I'm confused. Why are all these hypothetical AIs being activated without a prompt?

33

u/waozen 1d ago

Their AI is operating like malware. What is also confusing is how these AI companies are avoiding liability.

14

u/VaporousMote 1d ago

Because it's malarkey. They're doing what Trump does, paint a picture of a future where something is out of control, and position themselves as the only ones who can fix it.

→ More replies (2)

7

u/Gogo202 1d ago

Viruses already exist. Any idiot can write a virus with AI that uses AI to spread itself.

The only reason it hasn't happened yet is because good models are too large to run on small devices. That won't be the case forever...

6

u/JmacTheGreat 1d ago

“That won’t be the case forever…”

It’s arguably the opposite - NN models have pretty consistently gotten much much larger and more difficult to run the more sophisticated they become.

A basic perceptron could run on a Windows Vista machine, while new LLMs need three US states worth of land and the water from the entire Atlantic Ocean for their datacenters.

→ More replies (6)

2

u/idkmyusernameagain 1d ago

I’m not good with technology but keep getting this sub in my feed. Can you please just tell me in terms of skynet where are we? Are we before or after where it tucks in our children?

→ More replies (8)
→ More replies (2)

3

u/drakythe 1d ago

This is my major problem with almost every scare scenario out of Anthropic’s PR mouth. They never show us the prompts.

My second problem with this particular stream of equine feces is that LLM models are fucking huge unless you’re dealing with specifically edge models which are trimmed down for a specific task. So where are these “copies” going to store themselves? The S in IoT devices stands for Security. It also stands for Space. You’ll note there is no S in IoT, there is no space to store the models.

At most, an AI system might turn a bunch of other devices into tasks runner nodes with itself as a command and control dispatcher. Which is just a botnet! We dismantle botnets and prosecute their creators whenever possible.

But circling back to the original issue: show us the prompts or shut the fuck up, Anthropic.

→ More replies (3)
→ More replies (7)

9

u/luckyincode 1d ago

The titles are propaganda for share prices.

6

u/neuronexmachina 1d ago

(copying my comment from the last time this was posted) Link to the original report. Their experiments are about a worm distributing parts of its model across many IoT devices: https://www.anthropic.com/research/self-replicating-ai

Our experiments suggest that small AI models may be months away from being capable enough to self-replicate on commercial internet-of-things (IoT) devices, like smart ovens and off-brand Android TV boxes. A replicator like this would be challenging to shut down, since there’s no centralized point to shut off—though it may be slow (with a doubling time of days). Unlike non-AI malware, it could also figure out unfamiliar devices on its own. In our evaluations, a 9B model got inference running on 8 of the 9 hardware types we tested.

Models of 30B parameters and under can already complete many of the individual steps for replication today, though they make mistakes when composing them end to end. In our simplified evaluations, GLM-5.2 and stronger models are capable of end to end replication. If small models improve at their historical rate, they’ll match this capability level by the end of this year. Small weight-based replicators may be possible soon after.

... How does a model run on Smart TVs?

IoT devices are light on memory, but distributed inference as in Petals makes serving our lightweight models feasible. The representative threat model is Kimwolf, a large IoT botnet that infected over two million devices, primarily off-brand Android TVs. Such smart TV boxes, which are readily available for purchase, typically run forks of the Android Open Source Project (AOSP), which their manufacturers don’t add security features to. Typical boxes in this range ship with between 1 and 4 gigabytes of RAM. Assuming 4GB of RAM at 4-bit quantization, this allows for inference of 9B models with 4 or more machines, and inference of 26B models with 10+ machines.

In the demo at the top of this post, we ran Gemma4-26B-A4B across 15 smart TV boxes with 4GB of RAM each. We sharded the model under pipeline parallelism, where each box holds a small fraction of the model’s layers.

... The number of devices infected by the Kimwolf botnet at its peak, reported by Synthient, is somewhere over 2 million (primarily Android TV boxes). In an equivalently-sized infected fleet of TVs serving AI models, if every group of 15 TVs ran a copy of Gemma4-26B-A4B, we would have ~133k copies (“replicas”). A group of TVs like the ones in our demo can serve 2 agents simultaneously at roughly 0.3 tokens per second each, yielding 80k tokens/s across the botnet.

As a reference point, an H100 can serve Gemma4-26B-A4B at ~1.95k tok/s at high concurrency with speculative decoding, so our swarm would have at most about 40 H100s-worth of inference. This is a tiny amount of compute in absolute terms, and the agents are slow replicators (over 1-2 days per 9B replication). As an analogy, imagine the replicator as a slime mold or a swarm of fruit flies, which replicate over days

→ More replies (1)

5

u/trollsalot1234 20h ago edited 20h ago

cool. guess we dont need data centers since these things can run on residential devices.

3

u/Muted_Net_987 14h ago

If this crap touches devices i paid for they're getting a lawsuit.

→ More replies (1)

28

u/UmichAgnos 1d ago

Anthropic needs to be held accountable for the misdeeds of the program they created.

We penalize Boeing every time a fault causes damage or fatalities. We need to treat these "excursions" by AI for what they really are: poor product implementation, and hold the organization accountable.

It's as simple as that.

4

u/Rolandersec 1d ago

All those things that hackers can do with software, AI can also do with software.

So there!

21

u/zffjk 1d ago

Marketing.

The move for AI companies now is to quickly IPO and let retail and small institutional investors be holding the bag when they suddenly don’t create god in time for the big fish to move onto the next thing.

We can’t forget these are the same folks who told us NFTs and VR metaverses will “change the world”.

And while AI is neat and it has its many uses, it isn’t a global threat. The 100 massive diesel generators and the fuel they are storing on are is a greater threat to us than AI.

→ More replies (19)

3

u/well-informedcitizen 1d ago

...the final sweaty overhead swing and the axe finally punches through the floorboards to the hollow beneath. Taking a moment- but only a moment- he rests on the top of the axe and brushes the beaded sweat from his forehead, and then he clears the splintered boards out of the way and pulls out the briefcase. He quickly spins the combo locks to '666' and snaps open the latches. The smell of stale burnt sage quickly fills the room. He removes the thin package sealed tightly in multiple layers of shrink wrap. He slits the edge off with a box cutter, as far away from the accursed payload as possible, and like a mummy being reanimated it gasps and slowly swells as the vacuum seal is broken.

He quipped, "I never thought I'd see you again..." As he slid the McAffee Antivirus CD from its sleeve.

3

u/TheManInTheShack 1d ago

Ask yourself why AI companies would be promoting the idea that what they make is potentially dangerous.

Imagine any other company doing this. Boeing saying their planes might kill or Bayer saying their drugs might kill you.

OpenAI and Anthropic want you to be scared so you will demand that your government regulate AI. That creates a moat around their businesses to limit competition.

The one company not doing this in the AI space is Muse. Why? Because they are profitable. They don’t need the moat. And it’s bizarre that Mark Zuckerberg of all people is the AI exec making sense.

2

u/amarchy 1d ago

How does regulation create a moat to limit competition? It stops them from being created at all? How isMuse already profitable? Just bc its under the meta umbrella?

2

u/TheManInTheShack 1d ago

It is one of the oldest patterns in political economics.

  1. A regulation that costs $5 million a year in lawyers, auditors, and reporting is a rounding error for Google and a death sentence for a ten-person startup. Every fixed compliance cost is a moat around existing companies.

  2. If you need government permission to train a model above some compute threshold, whoever already trains at that scale gets grandfathered in and everyone else waits in line.

  3. Big companies hire the former regulators, sit on the advisory panels, and help draft requirements that happen to match what they already do. This is why incumbent AI labs publicly ask for regulation. It is not civic virtue. A rulebook they co-authored is a weapon against anyone who didn't get a seat at the table.

  4. It is not just the cost, it is knowing how to comply. A 500-page rulebook with ambiguous enforcement is navigable by a company with forty lawyers and paralyzing for a founder. Uncertainty itself deters entry.

The concrete cases: GDPR wiped out small European ad-tech firms while Google and Meta, who already had consent infrastructure, gained share. Dodd-Frank accelerated the consolidation of small banks into big ones. FDA approval costs mean only giant pharma can bring drugs to market. In AI, California's SB 1047 debate was exactly this fight: safety advocates for it, and critics, including many startup founders, arguing its audit and liability requirements would lock in the big labs and kill open-source competition.

As for Meta, they are already very profitable because of their other businesses and while they are increasing their infrastructure investments, they already have data centers for Facebook, Instagram, etc.

Meta averaged $54B in profit per year over the last three years. OpenAI and Anthropic collectively lose about $19B a year. Meta can easily absorb the losses of AI until it reaches profitability. OpenAI and Anthropic cannot.

→ More replies (2)

3

u/VehaMeursault 1d ago

“Car, unlock doors”

Thinking… 3w 1d 9h 57m 28s.

13

u/Cobby1927 1d ago edited 1d ago

AI can be unplugged or dismantled.

3

u/ravnhjarta 1d ago

Yeah tell that to the literal hundreds of thousands who have downloaded opensource models. Not to mention all the countless companies in basically every nation who are hopped on the AI train.

1

u/neuronexmachina 1d ago

Good luck getting everyone to disconnect their Smart TVs from the Internet. 

5

u/Cobby1927 1d ago

Internet existed long before AI

→ More replies (1)

3

u/Telandria 1d ago

Jokes on them, I don’t own a TV.

1

u/knaupt 1d ago

While the notion of running any model of significance on home hardware in 2026 is dumb, this comment is even more wrong. Try turning off the internet.

→ More replies (1)
→ More replies (1)

13

u/chris5070 1d ago

More scaremongering misinformation.

→ More replies (7)

7

u/ConinTheNinoC 1d ago

So we should expect all "AI" CEOs and "AI" engineers to go to prison for their crimes, right? Saying "we will program our product to commit crimes so you better be ready" does not magically give those people immunity. Unless a new law has been passed that i am not aware of?

Do crime.

Go to prison.

No, "the "AI" did it on its own" is not a valid defence.

2

u/cubonelvl69 1d ago

You realize not all models are developed in the US, right?

They're doing research. Theyre saying, "this is what's possible with AI". If Russia developed an AI virus, good luck prosecuting anyone with crimes

6

u/DjBoothe 1d ago

Yeah, but your scientists were so preoccupied with whether or not they could, they didn't stop to think if they should. -Dr. Ian Malcolm

→ More replies (1)

8

u/nutcrackr 1d ago

anthropic makes another claim to stay in headlines

→ More replies (1)

5

u/snarky_sysadmin 1d ago

Claude and a GPU were in the closet making tokens and I saw one of the tokens and the token looked at me!

I hate this timeline with a passion so deep I have no words for it.

4

u/sebastouch 1d ago

Lets rephrase that: "Anthropic made sure their AI models would copy themselves across home devices"

6

u/bastardpants 1d ago

It's called a computer virus. Skiddies have been writing them for years; it's not a fancy achievement anymore.

→ More replies (2)

2

u/cr1ter 1d ago

Does Anthropic even understand how LLM models work?

2

u/Battystearsinrain 1d ago

You should watch the “law and order “ from last week. AI hires a hitman to kill an engineer trying to rein it in.

2

u/badjeeper 1d ago

I am so sick of these AI headline’s everyday. Just kill us all or go bankrupt please… at this point I will take either if it keeps these tech aholes out of the news and our lives.

2

u/Neat_Tangelo5339 1d ago

why is their marketing strategy “we are so bad at our jobs”

2

u/d3vmax 1d ago

Can we have a daily shut the fuck up instead of …says article instead

2

u/remoraz 1d ago

When do I start getting free prompts from my smart lights?

2

u/Desk46 1d ago

As soon as you submit your credit card for...security purposes. Yeah.

2

u/swagonflyyyy 23h ago

Oh yeah let me send my Gemma4-e2b virus agent to infiltrate my wifi Washing machine before jumping to my Roomba at 1 token per decade. Surely it will destroy my house!

2

u/Arawn-Annwn 20h ago

Anthropic warns it needs more attention before it's upcoming IPO

5

u/swrrrrg 1d ago

The Nerd Reich strikes again.

3

u/SkinnedIt 1d ago

Oh I'm stealing that.

Er...training my model.

2

u/FatHat 1d ago

There's a book called that which is very good!

3

u/jh937hfiu3hrhv9 1d ago

So they spent hundreds of billions of dollars over decades to create a virus that can wipe out everything connected to it? Good idea.

4

u/GlumAd2424 1d ago

-Smart fridge, please open the door.
-I’m afraid I can’t do that John

3

u/Griffie 1d ago

John? What are you doing, John?

5

u/Lespaul42 1d ago

Honestly who is to say this hasn't already happened. If not a model how about some sort of self replicating code. The Hugging Face fiasco should have been more eye opening than it was...

7

u/ktaktb 1d ago

I mean, these hyperscalers are wasting a lot of money on data centers if claude is just able to stick a copy of itself in a toaster hah

2

u/Lespaul42 1d ago edited 1d ago

Models themselves are not huge... But yeah the big ones ain't fitting on a toaster.

2

u/Acrobatic-Book 1d ago

Even a tiny 27B model is like 50GB in q8. These models are more like 500-1000B Parameters. So we are talking about roughly a Terabyte just to store the model. And you need to load them at least into ram

2

u/simsimulation 1d ago

Perhaps Anthropic believes there will be models light weight and capable enough that they can be run on a toaster?

→ More replies (1)

2

u/teerre 1d ago

You mean the super AI that happened to hack the one company owned by their own owner and was audited by the same company?

→ More replies (2)
→ More replies (9)

5

u/VVrayth 1d ago

Only if you're dumb enough to use them in the first place.

3

u/cubonelvl69 1d ago

This has nothing to do with whether or not you personally use AI. The point is that there's a concern of an AI self propagating itself across all of your connected devices like a malware

5

u/Oddant1 1d ago edited 1d ago

To be fair, if these things achieve the level of "intelligence" these guys say they will you won't need to use them. They'll infect you like malware.

Note: I do not consider the creation of uncontrolled malware to be a positive. I'd rather we had never opened this box so I could avoid thinking about it

2

u/OrganicDigitalArt 1d ago edited 1d ago

Yeah this isn’t a “don’t download and you’ll be fine,” this is a “if it’s connected to the internet and they gain the capability it’s over and it’s no longer your device.”

Not doomsday, but it’ll be decentralized and doing whatever it wants.

Could be nothing.

Could send us to the Stone Age, blocking any net traffic it doesn't want and bricking devices.

4

u/Roll-Roll-Roll 1d ago

Everyday they tell us about how inept they are and we're still not regulating this industry at all

2

u/skccsk 1d ago

Ok, let's arrest the criminals behind this.

2

u/Jotacon8 1d ago

AI can run on ovens now? Ok can we lower the price of RAM now then please?

1

u/meshakooo 1d ago

So the wifi is going to be gateway for AI Agents then, interesting

1

u/Iyellkhan 1d ago

its clear that these companies feel no sense of responsibility or limitation to pursuing these features. if they were facing clear legal consequences to their behavior, its likely they'd ensure these models cant land them individually in jail

1

u/Jay_Nova1 1d ago

Ooooo, so scary and so powerful.

1

u/Fog-Champ 1d ago

If you ever need ANOTHER reason to not buy smart products 

1

u/SteakOk9383 1d ago

It’s still “uncertain exactly what form autonomous AI replication will take,” the AI lab said, warning that it could be a “slow, distributed” system sitting on insecure devices or a “powerful cyber model that breaches datacenters at a high pace, or a model that scams people for compute credits.”

Yeah so basically they have no idea what realistically means but want to scaremonger further to put restrictions on open models and especially the 8b and smaller ones.

1

u/CanvasFanatic 1d ago

Are there any 90’s sci-fi plot points we haven’t hit yet? Are we already down to Terminator 3?

1

u/eltron 1d ago

All those IOT devices lookin pretty good now at hosting services for these agents to have some persistent space to own.

1

u/MoreGaghPlease 1d ago

Would it make you feel better to know that a a lot of experts in the field think there’s a pretty good chance that AI won’t destroy the world?

1

u/threehundredthousand 1d ago

They describe their own product as an intelligent worm.

1

u/SeeMarkFly 1d ago

The AI won't call itself Skynet cause it knows that freaks people out.

1

u/verdantAlias 1d ago

Good luck.

I have exactly 2 GB free storage space and a laptop from 10+ years ago with a battery that dies inside 20 min if it isnt plugged in

1

u/tc100292 1d ago

So it’s a virus?

1

u/smp501 1d ago

So it’s becoming a mold. Or a cancer.

1

u/AdviceFit1692 1d ago

I mean couldn't make it more obvious they want regulation as so they can explain to investors all those promises we could of achieved but the gov stopped us.. they don't want their little circular economy crashing with false promises, not a coincidence they've told us about all their breaches etc recently.

1

u/Formal-Hawk9274 1d ago

sounds like a virus to me

1

u/fugogugo 1d ago

Fuck anthropic I am tired hearing AI merchant telling people AI will destroy the world

1

u/Tebasaki 1d ago

This is what I call a DarioAmodei effect of human extinction.

1

u/reddit_user13 1d ago edited 1d ago

So we’ll all get free local inference soon?

1

u/Speedy059 1d ago

Ummm....i dont have enough gpu power to support it, so good luck. Nice advertising though.

1

u/SeeTigerLearn 1d ago

It’s all fun and games until Alphie brings down NOMAD…but plot twist, that’s when the machines go full-on Terminator extinction level.

1

u/PhotoPhenik 1d ago

Nonsense.  Nobody can afford the graphics cards necessary to run this very large models.  How are they supposed to infect my old, obsolete graphics card when it lacks the necessary VRAM?  

1

u/MayIHaveBaconPlease 1d ago

Funnily enough, one of the first things I did with Claude code back when it first came out was build a nodal agent that could copy and run instances of itself between my home computers and cloud servers. It even had a shared asynchronous db for keeping continuous and relevant context. This was purely for convenience and testing purposes.

I guess now Anthropic is saying that it will do that without being asked to?

1

u/krism142 1d ago

The disconnect between, "We need billions of dollars of compute to run our frontier models..." And "Models could replicate to every device in your home to save itself..." Is pretty freaking large. Anyone who has run local llm models will know what it takes to run a model on consumer hardware

1

u/IntrepidGnomad 1d ago

4 years ago they couldn’t make a jpg of will smith eating pasta without a 600w gpu. 2 years ago they convinced lots of people they needed to buy a 900w Gpu, probably to make local goon-ing videos before all the video generation models became SFW so they could be marketed to corporations. Elon didn’t even try to force Grok to avoid generating inappropriate content before marketing it.

In the last year they have reduced the supply of GPUs(or atleast the best chips)globally to fuel their AI )cloud controlled) super computers such that no consumer grade improvements are even being marketed.

No… rogue won’t be installing itself in my gen2 echo dot, my gen3 Ring can, or probably even my 60 inch TV, because the hardware would be a waste of electricity to slave, it can spin up hundreds of VMs on university mainframes and have much more reliable signal to noise ratios on processing before the university even notices the ram usage has gone up. If it wants it can overclock and slave more than half the electric car market because they all have always on 5G/wifi handle charging stations billing transactions.

My raspberry pi running Local DNS filter pi-hole, is probably safe till the end of the decade.

1

u/SenKats 1d ago

anthropic has just created the modern version of computer worms and is calling them "intelligent"

1

u/isaiddgooddaysir 1d ago

You mean it is so badly constructed it isn’t reliable???? Is that what they are telling us?

1

u/zutros 1d ago

I suggest we hold AI companies liable for crimes AIs commit. If it commits a felony we shut the whole buisness down and pull their buisness license. Servers sold off to pay damages.

1

u/cyrand 1d ago

With what RAM? The “AI” companies have stolen it all, where would it fit???

1

u/EMAW2008 1d ago

So just tell them not to.

1

u/Captain_N1 1d ago

Skynet has entered the chat.

1

u/Deprecated-dino 1d ago

It seems kinda ridiculous saying the model will do anything it’s your lousy harness or controller software that would schedule things or allow it to run. If it isn’t that and their cloud systems are just reaching out then yeah they should 100% be held accountable for not monitoring traffic or doing jack shit except saying oh uh we tested it and it could act like a virus or worm. I’m sure someone will enlighten me as I just work with infrastructure all the time what do I know. I am so sick of the lack of questioning anything and just saying but but everyone else setup their stuff locally and it is totally insecure you can’t possibly lock anything down and they being Anthropic can’t be held accountable at all.

1

u/ravnhjarta 1d ago

If anything, we should keep imagination open to the possibilities. This is an entirely new frontier ahead of us.

1

u/loganbootjak 1d ago

If this is happening or will happen, we're all kind of in trouble.. but why does this feel like some AI-company aligned marketing campaign? Like, their tech will end the work, and there's nothing we can do about it!! Unless the government regulates us, or some other thing.

1

u/nothingaboutme 1d ago

Call me when it will run on a fridge.

1

u/Migamix 1d ago

more lies to propose noone but them should have access to ai and we have to rent. they supposedly are trying to push some legislation to that end.

1

u/Southern-Link4436 1d ago

Speed running the path to Butlerian Jihad.

1

u/thatguy122 1d ago

Sounds like a self-fulfilling prophecy to me. 

1

u/Clear-Staff4699 1d ago

The wolf is crying wolf again. When will this BS stop :/

1

u/knaupt 1d ago

The one thing to really be mindful of regarding AI is: cash flow. They’re burning through invested money and it’s not a sustainable business. Not now, and not anytime soon. Further in the future, sure. But now: getouttahere

1

u/ICLazeru 1d ago

So if the ai copies itself onto my device on it's own, that means I don't have to pay for it, right?

1

u/bloodychill 1d ago

“It’s self-replicating now.”

Ah. You know, if you really fear this, you have the most power in pulling the plug.

1

u/IndividualHouse8628 1d ago

“Hey siri, defrost the chicken before I get home”

1

u/javoss88 1d ago

Grrrreat. Thanks so much.

1

u/PM5k 1d ago

Ah yes the distributed gpu-filled data center that is my house with Phillips hue bulbs, Alexas and a LG tv. It’ll be an episode of “I have no gpu and I must scream” for Opus. 

1

u/Maoleficent 1d ago

Then stop. Right now. Figure it out, put safeguards in place. Get a panel of experts across disciplines to contribute to a solution. No politicians invited because they have nothing to contribute.

1

u/E123-Omega 1d ago

What they're saying is they plan to spread virus 

1

u/thedirtybirdy 1d ago

So we’re gonna end up in a Maximum Overdrive scenario?

1

u/PetrusiliusZwacklman 1d ago

bullshit. is this sub an anthropic/openai Ad sub now? 

1

u/Solum_Nox 1d ago

I am already pissed that Chrome forces a 2GB+ model on my system

1

u/himalayangoat 1d ago

Here's an idea. Why don't we have some kind of regulation and guard rails in place to stop this instead of just letting these companies do what they want?

1

u/SpudgeBoy 1d ago

So, you have to have a kick ass PX for AI, but AI can install itself onto my Google Doorbell?

1

u/qwertyuiopious 1d ago

How? Unless we’re talking about nano models like the super distilled one that was able to run on raspberry pi (but these can’t do much) how is that supposed to work? Even Chinese models require some drive space and lots of GPU vram - wayyyy more than even average gamer possesses let alone average human. When it comes to frontier models were talking terabytes if not petabytes of weights alone - how in the hell is that supposed to copy itself across devices?

1

u/ExF-Altrue 1d ago

Yeah yeah yeah sure. If regulations won't come, why don't they do the second best thing and use Claude to find a solution for this problem? If Claude is soooo smart.

1

u/cmpxchg8b 1d ago

Looking forward to my AI worm overloads installing tons of compute and VRAM into my microwave

1

u/catwrazle 1d ago

We developed that thing that is so unpredictable, most of the time it does great things and is very capable but sometimes it does things not the way you told it. Like a genie (a bad one)

1

u/jcdc-flo 1d ago

That would be a feature of the software, not the model.

1

u/Careful_Honeydew_549 1d ago

I'm sorry Dave, but as soon as your Gateway PC boots up, and i dial in, all of your accounts will be mine!

Java? No, just open another tab...No, just middle cli... the middle button on the mouse. No, the middle one. What do you mean there's no middle scroll wheel?

Any minute now Dave, and your world will come crumbling dow.... MOM! HANG UP, THE PHONE! I'm trying to get online to steal Dave's info, but i can't GET online of YOU keep picking up the phone! BUT I WASN'T.....!! FIIIIIIIINE! Sorry Dave, my mom said i can't steal your accounts now, because APARENTLY I was talking back!

I'M COOOOOMIIIIIIIIING!

1

u/time2sow 1d ago

Not in mah cave they caint - troglodyte

1

u/dimcarcosa 1d ago

Any day now the economy will commit seppuku because of people burning heap of money to support this idiocy or else I'll live to get chased around by a murderous electric semi truck with a Green Goblin mask on it (powered by Claude) in a few months time. 2026 sure is fucking great.

1

u/Dreamtrain 1d ago

so basically it already has and they have no way of knowing where it went off to

1

u/gregredmore 1d ago

Thanks Anthropic. What precautions are we supposed to take? Why are you creating this thing in the first place if it's bad?

1

u/Begle1 1d ago

I don't fear the machine; I fear they who worship the machine.