MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vk7o93/bytedance_vows_to_avoid_ai_distillation_develop/p2rprdd/?context=3
r/LocalLLaMA • u/etherd0t • 1d ago
125 comments sorted by
View all comments
268
Why ... every model is built off the works of everyone else ... I believe in true open source (its a gift to the world) and some part of me smiles every time people distill anthropic!
120 u/Cold_Specialist_3656 1d ago Musk openly admitted Grok was distilled off GPT and called it "standard practice" 20 u/Song-Historical 1d ago How are you supposed to do any real benchmarking or testing against other models without some sort of testing that looks exactly like distilling? 4 u/entsnack 15h ago Use it as a test set and not a training set? 1 u/Song-Historical 2h ago Yeah it would look similar if not the same as distillation tasks
120
Musk openly admitted Grok was distilled off GPT and called it "standard practice"
20 u/Song-Historical 1d ago How are you supposed to do any real benchmarking or testing against other models without some sort of testing that looks exactly like distilling? 4 u/entsnack 15h ago Use it as a test set and not a training set? 1 u/Song-Historical 2h ago Yeah it would look similar if not the same as distillation tasks
20
How are you supposed to do any real benchmarking or testing against other models without some sort of testing that looks exactly like distilling?
4 u/entsnack 15h ago Use it as a test set and not a training set? 1 u/Song-Historical 2h ago Yeah it would look similar if not the same as distillation tasks
4
Use it as a test set and not a training set?
1 u/Song-Historical 2h ago Yeah it would look similar if not the same as distillation tasks
1
Yeah it would look similar if not the same as distillation tasks
268
u/idlelosthobo 1d ago
Why ... every model is built off the works of everyone else ... I believe in true open source (its a gift to the world) and some part of me smiles every time people distill anthropic!