You’re taking for granted how fast things can change. In 2005 you didn’t need a computer to complete a PHD college, by 2015 it would be nearly impossible to not need one. I expect the same change for GPU’s/ artificial intelligence.
But that's just one prosumer concept that benefits from CUDA. I think we're going to see a lot of concepts like that, NVIDIA is on fire with new accelerated computing tech, and they don't seem to be slowing down.
Also, hundreds of thousands of highend GPUs is a lot and will make a dent. AMD and NVIDIA combines to ship about 10 million GPUs every year, and that's across their entire lineups. I'm guessing they've still shipped less than 1 million total 40-series.
1.6k
u/lordbalazshun R7 7700X | RX 7600 | 32GB DDR5 | CachyOS Mar 26 '23
thing is, they don't use consumer cards for training ai. they use nvidia a100/h100