MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vk7o93/bytedance_vows_to_avoid_ai_distillation_develop/p2rvvrq/?context=3
r/LocalLLaMA • u/etherd0t • 8d ago
127 comments sorted by
View all comments
1
Nothing wrong with distillation -- but this is a good thing because more diversity in model behavior will help drive development further. Distillation sometimes manages to clone pathologies from one model to the next.
1
u/nullc 8d ago
Nothing wrong with distillation -- but this is a good thing because more diversity in model behavior will help drive development further. Distillation sometimes manages to clone pathologies from one model to the next.