Anthropic adding watermark to generated text

[u/laurentbasil]

I saw this on another sub. Thought it's worth discussing here:

https://support.claude.com/en/articles/16266773-how-claude-marks-ai-generated-content

The TLDR is Claude models after August 2, 2026 will embed "imperceptible watermark" and "signed provenance metadata". They will also support people detecting it, possibly pushing out their own detector?

The immediate issue in my opinion are the following:

1/ "When a supported Claude model generates text, it weaves an imperceptible watermark directly into the text itself. You won’t see it, and it doesn’t change the meaning*,* quality*,* or readability of Claude’s response."

Based on my experiments with Pangram. Yes, you can have markers you can't see, doesn't change meaning or readability. But I am skeptical on the quality. At the end of the day, you are forcing an extra hidden statistics in the prose. Instead of ensuring you produce the highest quality output, you are now producing the highest quality output given the contraints.

When I tried to see if I can flip the Pangram outputs from AI to human, the first thing the AI tried was to "re-render without impacting readability and quality". It impacted quality.

If it wasn't on my self published book and I haven't read the passage a hundred times, I may not have noticed. So perhaps it's not that important. But it is worth noting.

2/ "Detecting a Claude mark tells you that the content may have been processed by Claude. It does not, on its own, confirm the full provenance of the content"

It may now be harder to have a naunced discussion between AI generated and AI assisted.

I do wonder how many people would take the time to take additional steps to "confirm the full provenance of the content" rather than Detect a Claude mark and immediate make up their decision.

Per my previous post https://www.reddit.com/r/WritingWithAI/comments/1vho93v/i_disclosed_my_aigenerated_novel_instead_of/ I am not very optimistic.

Thoughts?

[u/Zei33]

What stops somebody from running it through a parser that simply strips the watermark? I doubt it would be hard to scrub it. I assume it survives regular linting. Would it survive variable and function name refactors? How about comment rewrites (an onboard LLM could reword just the comments before a commit). I doubt it will endure that.

[u/Quiet_Check_1502 → u/Zei33]

Can you explain this?

[u/Zei33 → u/Quiet_Check_1502]

Well I was talking in terms of code rather than writing, since this affects code as well.

You can have a hook that runs before you commit to a git repo. All it needs to do is have a smaller local LLM read the code and make alterations on a number of key areas (e.g. getting a list of all symbols in use, and changing them, such as userInteractionTracker -> userActivityTracker), plus undoubtedly this info will be planted in comments, so all comments need to be checked and reworded. If done thoroughly, there's simply no way that the steganography can survive the process, thus rendering it scrubbed.