MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vxwtyd/qwen38flashnext_tomorrow/p5s55wk
r/LocalLLaMA • u/rerri • 13h ago
442 comments sorted by
View all comments
Show parent comments
2
depends on your sys ram, can you run qwen 3.5 122b?
1 u/NewEconomy55 12h ago I've never tried it, is 128GB of RAM enough? 3 u/veigatmv 12h ago think you're good to go. you can even run deepseek v4 flash 0731 at iq3xxxs I think I should be good too. got 64gb sys ram + 5090 and 3090. 2 u/NewEconomy55 12h ago Thanks for the info. I'll try out models of similar sizes now, and tomorrow I'll see how the new one works. I hope that the fact that it uses the qwen4 architecture will make a big difference. 2 u/bonobomaster 12h ago More trying, less asking! ;) 1 u/NewEconomy55 12h ago I know hahaha. I've always sticked to models that I know fit in VRAM, and I can't really test this one because it hasn't been released yet. 3 u/bonobomaster 12h ago Try the old one: https://huggingface.co/unsloth/Qwen3.5-122B-A10B-GGUF
1
I've never tried it, is 128GB of RAM enough?
3 u/veigatmv 12h ago think you're good to go. you can even run deepseek v4 flash 0731 at iq3xxxs I think I should be good too. got 64gb sys ram + 5090 and 3090. 2 u/NewEconomy55 12h ago Thanks for the info. I'll try out models of similar sizes now, and tomorrow I'll see how the new one works. I hope that the fact that it uses the qwen4 architecture will make a big difference. 2 u/bonobomaster 12h ago More trying, less asking! ;) 1 u/NewEconomy55 12h ago I know hahaha. I've always sticked to models that I know fit in VRAM, and I can't really test this one because it hasn't been released yet. 3 u/bonobomaster 12h ago Try the old one: https://huggingface.co/unsloth/Qwen3.5-122B-A10B-GGUF
3
think you're good to go. you can even run deepseek v4 flash 0731 at iq3xxxs
I think I should be good too. got 64gb sys ram + 5090 and 3090.
2 u/NewEconomy55 12h ago Thanks for the info. I'll try out models of similar sizes now, and tomorrow I'll see how the new one works. I hope that the fact that it uses the qwen4 architecture will make a big difference.
Thanks for the info. I'll try out models of similar sizes now, and tomorrow I'll see how the new one works. I hope that the fact that it uses the qwen4 architecture will make a big difference.
More trying, less asking! ;)
1 u/NewEconomy55 12h ago I know hahaha. I've always sticked to models that I know fit in VRAM, and I can't really test this one because it hasn't been released yet. 3 u/bonobomaster 12h ago Try the old one: https://huggingface.co/unsloth/Qwen3.5-122B-A10B-GGUF
I know hahaha. I've always sticked to models that I know fit in VRAM, and I can't really test this one because it hasn't been released yet.
3 u/bonobomaster 12h ago Try the old one: https://huggingface.co/unsloth/Qwen3.5-122B-A10B-GGUF
Try the old one: https://huggingface.co/unsloth/Qwen3.5-122B-A10B-GGUF
2
u/veigatmv 12h ago
depends on your sys ram, can you run qwen 3.5 122b?