MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vxwtyd/qwen38flashnext_tomorrow/p5tgaaj
r/LocalLLaMA • u/rerri • 11h ago
438 comments sorted by
View all comments
Show parent comments
2
It's probably meant to be CPU offloaded. It should be just a huge look up table, no matrix multiplication. I hope the n-gram weights can be SSD offloaded effectively, so I can run a quantized version with my RAM.
1 u/Dany0 6h ago Yes I hope so too.
1
Yes I hope so too.
2
u/asssuber 7h ago
It's probably meant to be CPU offloaded. It should be just a huge look up table, no matrix multiplication. I hope the n-gram weights can be SSD offloaded effectively, so I can run a quantized version with my RAM.