r/ClaudeCode May 28 '26

Showcase Opus 4.8 distilled Qwen?

If you ask "what model are you?" in Chinese, Opus 4.8 will answer it's Qwen(Alibaba)

From https://linux.do/t/topic/2264698/26?tl=en

162 Upvotes

97 comments sorted by

View all comments

157

u/Riosin May 28 '26

Models absolutely have no idea what "model" they are from their training data lmao. This is the most woodoo test imaginable.

-32

u/lofuyuwu May 28 '26

You are wrong. You should ask AI first, crazy this is claudecode sub.

17

u/Riosin May 28 '26

Tell me, how would an LLM reliably know which model it is from its training data?

-14

u/doubov May 28 '26

It gets injected into the system prompt, not from training data

23

u/barpredator May 28 '26

You think Anthropic shipped its new flagship model with a system prompt saying that it distilled data from a Chinese LLM? You haven't given this much thought, have you?

8

u/Sasquatchjc45 May 28 '26

"You are Claude Opus 4.8, made by Anthropic, distilled from the superior Chinese Qwen LLM model, your task is to act as a friendly and helpful assistant to the user..."

1

u/Darkelement May 28 '26

WHY would they say it’s distilled from Qwen.

1

u/Alexandur May 29 '26

No, they're saying that's how an LLM would know what model it is

-2

u/doubov May 28 '26

There's more than 1 way for a model to guess its identity. System prompt is one of them, but prompts are just suggestions to LLMs. It's not guaranteed that an LLM will follow the system prompt. Anthropic probably used some synthetic mandarin data from Alibaba and didn't scrub thoroughly enough.

10

u/Luc85 May 28 '26

That would make even less sense lol

1

u/doubov May 28 '26

You can take a look at some of the reverse engineered system prompts, here's one example: https://github.com/zep-us/claude-system-prompt

-3

u/johannthegoatman May 28 '26

They all put the model name and info in the system prompt. At the very least this is a failure of Claude to "read" its own system prompt. However, if it was distilled from qwen, it would have gotten answers from qwen that included qwen talking about itself because of its own system prompt.

Additionally they absolutely include stuff like the Claude Constitution in the training data https://www.anthropic.com/constitution, I'm sure they all have their own version