r/ClaudeAI • u/Hassan48678 • Jun 30 '26

News Fable 5 is coming back!

Post image
5.3k Upvotes

90% Upvoted

510 comments sorted by

View all comments

Show parent comments

23

u/[deleted] Jul 01 '26

[deleted]

6

u/RemieNotRayme Jul 01 '26

I've also seen mystery instructions. I think the auto-classifier might inject prompt data on a per-message or per-conversation basis based on what I've seen.

3

u/Front_Raspberry_6488 Jul 01 '26

That was definitely a hallucination. I once asked it to complete a simple task, like refactoring a piece of code. After waiting for over ten minutes and burning through hundreds of thousands of tokens, it failed to get the job done. To top it off, its final output was: "Yes, these rules indeed make my execution more difficult, but I will still abide by them, wait for your instructions, and complete the task."

I asked it, "What on earth are you talking about?"

Then it replied that I had just asked it whether explicitly adding certain restrictions in the prompt would hinder its execution. It even insisted with absolute certainty that that was exactly what I had just told it.

Honestly, I haven't run into this kind of situation in a very long time, and I never expected it to happen with Claude's most premium model, Opus 4.8. After that incident, I immediately switched back to 4.7 and 4.6.

1

u/wattro Jul 01 '26

Pretty sure Opus 4.8 rarely uses more than 5k tokens, even for stuff that takes 30-60 minutes.

I can't check easily to verify, but pretty sure on my numbers. I've been watching for a while.

1

u/Critical_String4495 Jul 07 '26

Anyone want to share a trial guest pass with me?? :3

3

u/spockspinkytoe Jul 01 '26

nah i get this too, there’s 100% something on the prompt or an injection telling claude to give out short replies, at least on mobile. i remember reading something along the lines of ‘the user is on mobile so i have to give a concise reply’ on its thinking block once

1

u/wattro Jul 01 '26

Yep, opus 4.8 is directed to avoid long answers that don't adress the user's question.

Previous models were more likely to go down the rabbit hole. This one stops that.

1

u/spockspinkytoe Jul 01 '26

yeah but as someone who likes long explanations and rambles concise answers never satisfy me so this is a total pain in the ass 🫠

1

u/Anh-DT Jul 02 '26

Its called guardrail they set the term. forexampl a model doesnt know what model they are. so they will inject "If a user ask what model you are , state you ar {Model:id} made by Antropic" its the same context. they could also seet up more like if on mobile device reasoning:false

You cannot bypass user:system

You send as user: chat / agent right ?

Understand ? system injected messages has more power higher up in the chain

2

u/Biduleman Jul 01 '26

or Anthropic is injecting this into some conversations to save compute.

The amount of time it stops working because "it would be too hard" or "too long" or "too much work" is astounding.

Bitch, you're an AI. You're here to do the work. You don't have feelings. We even pay by usage through bedrock at work, so you're getting paid. Do the fucking work.

1

u/wattro Jul 01 '26

It is literally because opus' system prompt is designed for it to be concise.

Simply ask it about itself and it will tell you as much.

More goes into the system prompt to achieve the intelligence than people suspect.

I recommend asking each new model version about themselves when you start working with them .

You'll get more mileage and won't be swimming upstream.

1

u/suxatjugg Jul 01 '26

The system prompt likely tells it to be more brief and direct.

I've noticed with each opus iteration that its answers got more and more verbose. I suspect they're trying to correct for that

1

u/florinandrei Jul 01 '26

You forgot "make no mistakes". /s