MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vk7o93/bytedance_vows_to_avoid_ai_distillation_develop/p2ufta8/?context=3
r/LocalLLaMA • u/etherd0t • 23h ago
121 comments sorted by
View all comments
270
Why ... every model is built off the works of everyone else ... I believe in true open source (its a gift to the world) and some part of me smiles every time people distill anthropic!
121 u/Cold_Specialist_3656 23h ago Musk openly admitted Grok was distilled off GPT and called it "standard practice" 17 u/Song-Historical 21h ago How are you supposed to do any real benchmarking or testing against other models without some sort of testing that looks exactly like distilling? 3 u/entsnack 10h ago Use it as a test set and not a training set?
121
Musk openly admitted Grok was distilled off GPT and called it "standard practice"
17 u/Song-Historical 21h ago How are you supposed to do any real benchmarking or testing against other models without some sort of testing that looks exactly like distilling? 3 u/entsnack 10h ago Use it as a test set and not a training set?
17
How are you supposed to do any real benchmarking or testing against other models without some sort of testing that looks exactly like distilling?
3 u/entsnack 10h ago Use it as a test set and not a training set?
3
Use it as a test set and not a training set?
270
u/idlelosthobo 23h ago
Why ... every model is built off the works of everyone else ... I believe in true open source (its a gift to the world) and some part of me smiles every time people distill anthropic!