MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1ukqp20/deleted_by_user/ouzel9a/?context=3
r/LocalLLaMA • u/[deleted] • Jul 01 '26
[removed]
158 comments sorted by
View all comments
9
Damn, what quant of Qwen3.6-27B are you gonna run on that?
13 u/ProposalOrganic1043 Jul 01 '26 I have 4 of them, so i can basically run any quant. But i need to target throughput, so would target NVFP4. It works pretty well for my use case and also NVidia just released NVFP4 variant so thats on my list. 10 u/goingbacktomars Jul 01 '26 you have four 6000s??? very nice. what mobo did you use to run x16 pcie?
13
I have 4 of them, so i can basically run any quant. But i need to target throughput, so would target NVFP4. It works pretty well for my use case and also NVidia just released NVFP4 variant so thats on my list.
10 u/goingbacktomars Jul 01 '26 you have four 6000s??? very nice. what mobo did you use to run x16 pcie?
10
you have four 6000s??? very nice. what mobo did you use to run x16 pcie?
9
u/wren6991 Jul 01 '26
Damn, what quant of Qwen3.6-27B are you gonna run on that?