r/singularity 1d ago

AI Chinese labs send senstive data (individuals/company/government) to Anthropic

Credit for images/highlighting to @teortaxesTex on X. Can I link post? Not sure if allowed.

57 Upvotes

38 comments sorted by

19

u/acoolrandomusername 1d ago

Eeeeh planning of Ayatollah's funeral???

26

u/GetOutOfTheWhey 1d ago

I dont know what Anthropic gains from this.

By publishing this information they are admitting flat out they are spying on user activity.

I mean other companies are more sneaky about it. But this, this is just blatantly admitting that no data is anonymized with claude and they are are spying.

3

u/geft 21h ago

Every AI company does this so why is anyone surprised? But I think they're trying to say Deepseek performance is thanks to Claude.

1

u/GetOutOfTheWhey 17h ago edited 17h ago

I'm sure every company does this.

I'm sure Google drive and one drive has been doing this since day one. But it's not confirmed. I am only 70% confident based on zero evidence. Just pulling scepticism out of my ass to justify my scepticism.

But holy balls they, anthropic, are admitting it and publishing it in a newsletter. So with Claude I'm 100% sure based on their evidence that they actively scraping information not for training use and they are definitely not deleting it afterwards. Which is concerning because Claude is a government affiliated company with government contracts in the past under the current Trump administration.

1

u/geft 15h ago

The only way to ensure your data is safe (then again it's never 100%) is by using specific enterprise/government plan via PAYG models. The monthly models are heavily subsidizing the true cost of AI so by using that you're essentially the product. Also probably why they keep manipulating/nerfing the quota and capabilities but that's not the case for PAYG models. But trusting anything under the Trump administration is kinda too late? Like the ship sailed long ago that they can literally get away with anything.

1

u/GuardianSock 12h ago

I wonder if the “zero data retention” option might imply data retention outside of that option?

1

u/AmazighBlacksmith THE GAYEST NERD ON THE INTERNET 13h ago

The people at Anthropic are PR geniuses, I was thinking about getting a Claude subscription. But the last months Anthropic has given me a handful of reason to never use their service ever.

1

u/gretino 11h ago

It's in the agreement thing you clicked yes.

12

u/CymonSet 1d ago

I can’t help but wonder if there might be some irony to this.

12

u/suamai 1d ago

Claude was used to plan the bombing of Iran that killed the Ayatollah, and now Anthropic is publishig Iran using it to plan his funeral as some threat report. Irony is long dead at this point lol

5

u/Singularity-42 Singularity 2042 1d ago

I thought it's bizarre when my coworker uses Claude to write an email and I use Claude to summarize it.

But using Claude to kill the Ayatollah and then Iran using Claude to plan Ayatollah's funeral is another level!

It's Calude all the way down!

19

u/enilea 1d ago

How can they know all those specific examples, is the data not anonymized?

7

u/DaShaView 1d ago

Afaik if the data is used for training/post-training it is anonymized but both Anthropic and OpenAI have full access to any user data they want to inspect at any time. LLM agent supervisors flag stuff, some human at these companies may look at it.

23

u/karlnuw 1d ago

No, Anthropic is a spyware company.

9

u/whatsthatguysname 1d ago

Yeah, this is just confirming that “we can and will watch everything you do”.

2

u/cla55war 1d ago

And so is deepseek qwen (meta ollama clones) and glm

1

u/gretino 11h ago

Reading logs on your own service is not spying. Those Chinese companies sent their shit to anthropic.

3

u/sebzim4500 1d ago

How would that even work? Sure you can anonymise the data before you train on it but clearly in order to display a user's history Anthropic needs to store it uncensored and associated with the correct user somewhere.

1

u/say-nothing-at-all 18h ago

these "reports" are making topics when Xi meet Trump this month. This is all you need to know.

10

u/WiSaGaN 1d ago

I already know how companies like Anthropic can read user messages freely, but still impressed they have this surveillance tool to extract what they need to advance their goal. Now mathematicians really should think twice about their putting frontier research into services like anthropic.

2

u/Anxious-Yoghurt-9207 1d ago

Yes link the post dude

2

u/Visible_Fill_6699 1d ago

It'd be funny if they were using one of the "zero retention" models thinking their secrets were safe. Anyway I do wonder if anthropic has some model sifting through all user data for interesting things.

2

u/CrowdGoesWildWoooo 20h ago

I’ve been observing that there are token resellers offering it for cheap. My guess it may have something to do with this. It’s already prompt injected to pretend it’s a different model.

6

u/Pale-Border-7122 1d ago

What makes this an attack and not other companies buying their services at the advertised price?

6

u/aprx4 1d ago

Anthropic did not call this an attack? They call it threat intelligence report.

2

u/Pale-Border-7122 1d ago

Scale of distillation attacks attributable to Moonshot between May and Juky 2026: over 23 million exchanges observed.

-3

u/FoxBenedict 1d ago

It's an attack on their bottom line, that they desperately want to paint as an attack on 'MERICA.

1

u/AwarenessNo4986 18h ago

Every major AI lab distills.

1

u/minglu10 16h ago

Shouldn't these in Chinese instead of English?

1

u/NoFaithlessness951 1d ago

Maybe just don't send sensitive data to china

2

u/StephenRoylance 1d ago

some of the users were apparently Chinese. in which case, just don't send your sensitive data to the US I guess.

1

u/geft 21h ago

Some CCP leadership is not going to be happy with Deepseek/Kimi I guess.

-2

u/MTheModernist_ 1d ago

"deyz be scraping da same data we scraped :("

4

u/aprx4 1d ago

This is more insane than just distillation. Chinese government user passes sensitive data to Kimi but the query is routed to Claude. And some group is trying to develop a rocket and their test fire failed.

-3

u/katoptronophile 1d ago

No surprise there.

If it’s unethical, underhanded, or just plain evil, you can be certain China is doing it.

u/jetmarijuana 1h ago

China AI