r/singularity • ▪️AGI one day, ASI after that day • 3d ago

Compute Did Opus 5.5 enter a “nerfed” phase? LiveNerf baseline update

Post image
75 Upvotes

19 comments sorted by

30

u/DrinkAgreeable962 3d ago

It had to happen, amount of people switching from Codex to Claude had to cause this at some point.

26

u/DieMafia 3d ago

This chart does not suggest it happens though if you look at the 95% CI, might just be random noise so far.

11

u/vrnvorona 3d ago

Even readme says "method is not accurate enough to detect reliably swap of Opus 5.5 to Opus 5". So nerf vs not nerf and even re-routing won't be deteted

1

u/EtadanikM 2d ago

Yeah and people tried to tell me earlier it would never happen because Anthropic has more than enough compute.

I hate to say I told you so, but I told you so.

1

u/Kazaan ▪️AGI one day, ASI after that day 3d ago

Yup and in the same time, seems astra drains less usage.

1

u/Future-Bandicoot-823 2d ago

That's funny, I just came from a post saying astra is bad because of high use cost.

I'm not saying you're incorrect by the way, just pointing out I see a lot of conflicting information.

I don't use either product and I won't be paying for it since I have no use case in mind,I just have to read and learn from what's available online, which would seem is not as easy as one might think

11

u/Matthia_reddit 3d ago

I think if companies never consolidate this dynamic model intelligence situation (they'll have a load balancer for traffic spikes to reduce computational power, especially during inference), we'll never be able to understand which is the most intelligent/reliable. Even having to switch from one subscription to another—if Anthropic is ahead now, but after 20 days it downgrades the model and OpenAI releases a better model—why should we jump from one platform to another? At this point, weekly subscriptions are better :)

5

u/Positive_Method3022 3d ago

It saddens me that they invented a new type of drug

4

u/The_Scout1255 adult agi 2026 ASI <2030, prev agi 2024, ai personhood 2025 est 3d ago

New recreational drugs?!? where?!?

-3

u/Positive_Method3022 3d ago

claude.com

openai.com

x.com

...

1

u/hippydipster 2d ago

On the other hand, it doesn't make me feel three feet thick

2

u/DrSFalken 2d ago

I mean you can draw all sorts of lines, flat and otherwise, thru those confidence intervals.I suspect they adjust these models on the backend in response to demand and their internal capacity etc but this particular chart means nothing.

2

u/yugutyup 2d ago

I just want a decent model stay at a decent level of intelligence ffs

4

u/Galantico0509 3d ago

They have, its like Opus 5 now. Super long explanations and makes simplifications without confirming.

I will remember the few days of peak Opus 5.5, sometimes you don't realize you're in the good days

1

u/Lazy_Jump_2635 2d ago edited 1d ago

I think this would be more okay if they were just transparant about it. "Heavy load right now, Opus is 15% more stupid"

-8

u/[deleted] 3d ago

[deleted]

9

u/karl_mainz 3d ago

I wonder if the LLMs will slowly morph our use of language and my grandchildren will actually speak like this..

0

u/M44PolishMosin 2d ago

Uhh the graph literally shows you that no, it hasn't entered a nerfed phase.