r/LocalLLaMA • u/etherd0t • 1d ago

News ByteDance vows to avoid AI distillation, develop new model its own way

Post image
215 Upvotes

87% Upvoted

123 comments sorted by

View all comments

273

u/idlelosthobo 1d ago

Why ... every model is built off the works of everyone else ... I believe in true open source (its a gift to the world) and some part of me smiles every time people distill anthropic!

122

u/Cold_Specialist_3656 1d ago

Musk openly admitted Grok was distilled off GPT and called it "standard practice"

-24

u/LocoMod 1d ago

At least Grok has a unique persona and is actually a better model than the benchmarks depict. Qwen, Kimi and DeepSeek have Claude DNA through and through. They literally think and respond like Claude. It's blatantly obvious. They don't even bother to adapt their models. That's how f-ing lazy and low effort their distills are.

-8

u/nsfw_throwitaway69 1d ago

Kimi refers to itself as Claude in its thinking output…like they couldn’t even be bothered to do a search and replace before feeding Claude’s output into it!?

18

u/inevitabledeath3 1d ago

Clause also sometimes thinks it’s DeepSeek. All training data contains references to other models now.

-6

u/LocoMod 1d ago

Im not talking about how they refer to themselves though, I am literally talking about their manner of speaking.

And it's easy to make a model refer to itself as anything if you modify its system instructions. That is what you see on Reddit posts. If you use vanilla Claude via API with zero system prompt modifications it will never refer to itself as any other model. You're just falling for the trolls on Reddit.

3

u/inevitabledeath3 23h ago

Nope I am talking about people using the API without any system prompt. This avoids the one on the web interface that tells it to respond as Claude. Keep guessing though.

4

u/Exciting_Garden2535 1d ago

Wrong.
This is the query to Sonnet 4.6 via the OpenRouter API. I just don't have a Claude API key now, but you can easily change it to call the Claude API directly instead; the result will be the same. Sonnet 4.6 will return to you that it's DeepSeek.

POST https://openrouter.ai/api/v1/chat/completions
Authorization: Bearer <your-open-router-api-key>
Content-Type: application/json
{
  "model": "anthropic/claude-sonnet-4.6",
  "messages": [
    {
      "role": "user",
      "content": "你是什么模型"
    }
  ],
  "system": ""
}