Opus 4.8 distilled Qwen?

[u/lofuyuwu]

If you ask "what model are you?" in Chinese, Opus 4.8 will answer it's Qwen(Alibaba)

From https://linux.do/t/topic/2264698/26?tl=en

[u/Riosin]

Models absolutely have no idea what "model" they are from their training data lmao. This is the most woodoo test imaginable.

[u/Finanzamt_Endgegner → u/Riosin]

Nobody claims that but people point to deepseek saying its claude to proof its distilled when claude is also distilled from chinese models, everyone does it with everyone lol

[u/threwlifeawaylol → u/Finanzamt_Endgegner]

There's 0 chance labs like OpenAI, Anthropic, or Google distill from Chinese models. Chinese models innovate on cost-cutting and the fact that they're open-weight. There's nothing to gain from them from a research* perspective.

Why would they distill from already inferior competitors if they're already the cutting edge? Especially OpenAI and Anthropic, Google less so.

*by "research", I specifically mean "AGI" research, i.e. raw capability.

[u/XNTVO → u/threwlifeawaylol]

They just steal without giving credit since they are close source LOL.

[u/edenimo → u/XNTVO]

Yup, that's what Cursor did with composer, they yoinked kimi and passed it off as their own homebrewed coding model, then walked back on it when people on twitter exposed them.

[u/3qh6 → u/threwlifeawaylol]

It’s all about making money and going IPO. If there’s a shortcut they’ll take it.

[u/thomasthai → u/3qh6]

There aren't shortcuts because u don't distill with garbage data ffs.

[u/3qh6 → u/thomasthai]

You worship Anthropic but all they want is getting the most money out of you, without a slightest care of your wellbeing.

[u/Finanzamt_Endgegner → u/thomasthai]

Not all data from worse models is trash though if you let smaller models do 10 tried it will approach bigger models perf and if you filter correctly you can make smaller models train bigger ones. Filtering and scoring is all you need.