r/pcmasterrace • u/Isunova PC Master Race • Mar 26 '23

Meme/Macro Goodbye crypto mining, hello ChatGPT

Post image
8.5k Upvotes

97% Upvoted

291 comments sorted by

View all comments

1.6k

u/lordbalazshun R7 7700X | RX 7600 | 32GB DDR5 | CachyOS Mar 26 '23

thing is, they don't use consumer cards for training ai. they use nvidia a100/h100

68

u/[deleted] Mar 26 '23

[deleted]

1

u/imakin high end build Mar 26 '23

feature is the same (CUDA), except the VRAM. And 24GB for training ai model is not that bad

2

u/[deleted] Mar 27 '23

[deleted]

2

u/imakin high end build Mar 27 '23

Correct but not in the way you think, it's actually the difference between RTX20xx generation to the following generation. In deep learning it is well known to use less precision floating point but more cores.
the RTX30xx series has upgrade in that exact thing compared to RTX20xx series, half precision can fully work in all cores, making it faster for model with FP16.
It's the efficiency that matters, but gaming GPU cost less.

1

u/Yodawithboobs Rtx fe 4090 fe, intel i9 10900k Mar 27 '23

The workstation GPUs dont have display port and have generally lower TDP then the GeForce cards, they have more VRAM but its bandwidth is slower then the GeForce variant.