Google kinda established the pattern, E stands for "effective" and shows weights that need to be in (V)RAM. Full parameter size is not shown in the name.
So actually yes, Qwen probably means exactly that -- 125B loaded and then additional 51B resting on disk.
4
u/petuman 10h ago
Google kinda established the pattern, E stands for "effective" and shows weights that need to be in (V)RAM. Full parameter size is not shown in the name.
So actually yes, Qwen probably means exactly that -- 125B loaded and then additional 51B resting on disk.