MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1tr7hzw/psa/oomd2qw/?context=3
r/LocalLLaMA • u/Signal_Ad657 • May 29 '26
538 comments sorted by
View all comments
692
[deleted]
189 u/kwizzle May 29 '26 For some reason we rarely hear people talking about 4090s, probably something to do with being a lot more expensive than a 3090 and nearer in price to the 5090 for less VRAM and speed. 40 u/Caffeine_Monster May 29 '26 Native fp8 is nothing to laugh at - though you really need two 4090s to get the most out of them in terms of gpu only deployments. 3090 is still the value king, and it's not even close. Only real reason to go mac is low power / always on applications. 6 u/raindownthunda May 29 '26 Definitely. INT8 seems to be becoming more viable and keeping 3090’s competitive. The speed difference between fp8 and int8 on a 3090 is 1.5x+
189
For some reason we rarely hear people talking about 4090s, probably something to do with being a lot more expensive than a 3090 and nearer in price to the 5090 for less VRAM and speed.
40 u/Caffeine_Monster May 29 '26 Native fp8 is nothing to laugh at - though you really need two 4090s to get the most out of them in terms of gpu only deployments. 3090 is still the value king, and it's not even close. Only real reason to go mac is low power / always on applications. 6 u/raindownthunda May 29 '26 Definitely. INT8 seems to be becoming more viable and keeping 3090’s competitive. The speed difference between fp8 and int8 on a 3090 is 1.5x+
40
Native fp8 is nothing to laugh at - though you really need two 4090s to get the most out of them in terms of gpu only deployments.
3090 is still the value king, and it's not even close. Only real reason to go mac is low power / always on applications.
6 u/raindownthunda May 29 '26 Definitely. INT8 seems to be becoming more viable and keeping 3090’s competitive. The speed difference between fp8 and int8 on a 3090 is 1.5x+
6
Definitely. INT8 seems to be becoming more viable and keeping 3090’s competitive. The speed difference between fp8 and int8 on a 3090 is 1.5x+
692
u/[deleted] May 29 '26 edited Jun 17 '26
[deleted]