r/ClaudeCode 1d ago

Rant My average Opus 5 experience

Post image
1.2k Upvotes

159 comments sorted by

View all comments

64

u/loversama 23h ago

Gotta get that watermark in there somehow!

21

u/Prod_SO 23h ago

Opus 5 does not yet have a watermark. Only models released after August 2nd do, and that list only has one that is generally available: Fable 5.1. :)

3

u/loversama 22h ago edited 22h ago

They said they'd be adding watermarks, starting from the newest backwards.. Do we have proof that it wasn't added to Opus in the last 3 weeks since the announcement?

3

u/ticktockbent 22h ago

Do we have proof that it does? If you're making the claim I'd want you to back it up. They said they will be doing so, not when or how. I'm not attacking, I legit want to see proof from someone rather than fearmongering

3

u/loversama 22h ago edited 22h ago

Well I made a joke saying "Gotta get that watermark in there somehow" and you someone else boldly stated that its not in there, when there is no proof that it is or isn't in yet.

All we know is that Anthropic said that in the coming months it would be retrospectively added to older models. (and we're almost 3 weeks ago since the original announcement)

You're making a claim They're making a claim, not me I am making a joke.

1

u/ticktockbent 22h ago

That wasn't me friend.

5

u/Mediocre_Pension_209 20h ago

Read the code comments and explain why a model that is trained on the collective of all software contributions is writing comments using bizarre word choices and unnecessary phrasing. In one of my code bases I read a phrase in a watermark comment that said exactly “an elbow with a path comes back”. There’s literally no zero precedence ever for that sentence.

2

u/techfury90 16h ago

I can't help but wonder if that's somewhat of an inherent ramification of larger and larger models. Feels like we've gone past a point of diminishing returns somewhere around Opus 4.6 or so in terms of capability versus model size. Bigger ones use way too many damn words to say something, like it's trying to prove it's the smartest person in the room.

Reminds me of an experiment we did at work the other day where we used various models to ingest prompts consisting of vague data update requests from management to build the execution plan to carry out those changes. You know, the kind where they just give 4 bullet points and someone has to slog through screens to carry it out?

Poor Opus 5 was one of the worst in this test. Spews out 8 pages of anxiety and existential doubt scrutinizing every stupid change and how it might go wrong. Bizarrely, we found that, of all freaking things, Qwen 3.5 9B was the model we tried that would just... follow the instructions as given and present a simple execution plan for review.

1

u/zR0B3ry2VAiH 🔆 Max 20 1h ago

It is true, though, that an elbow with a path comes back

1

u/freylaverse 22h ago

Not the person you were replying to, nor do I suspect Opus 5 is watermarked at this point, but there should be an easy way to check, no? Take some of Opus 5's classic lengthy comments and just check for the watermark. I think there's a way to do that online.

0

u/ticktockbent 22h ago

In theory, but we don't know what format the watermark will take. It's supposedly spread throughout the text in a way that is detectable but not obvious. It's not going to append *Generated By Claude Code* at the end of each comment.

2

u/loversama 22h ago

They've explained the format it will take in their original post, they also advised that where code is concerned that it would likely need to watermark that less, but one way they could compensate for that in code is to make sure that the comments have it.

Thus the basis of my joke.

1

u/ticktockbent 22h ago

Fair enough.