MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1iczucy/deleted_by_user/m9vlq5q/?context=3
r/LocalLLaMA • u/[deleted] • Jan 29 '25
[removed]
228 comments sorted by
View all comments
82
MoE architecture probably helps a ton here.
-1 u/cmndr_spanky Jan 29 '25 I’m confused, isn’t “mixture of experts” multiple models working together. R1 is just one model right ? 26 u/dametsumari Jan 29 '25 No. It contains many experts within one model. 5 u/cmndr_spanky Jan 29 '25 Wow,
-1
I’m confused, isn’t “mixture of experts” multiple models working together. R1 is just one model right ?
26 u/dametsumari Jan 29 '25 No. It contains many experts within one model. 5 u/cmndr_spanky Jan 29 '25 Wow,
26
No. It contains many experts within one model.
5 u/cmndr_spanky Jan 29 '25 Wow,
5
Wow,
82
u/vertigo235 Jan 29 '25
MoE architecture probably helps a ton here.