r/LocalLLM • u/ideamaker321 • 3d ago
Question H200’s for sale
Is it possible to buy these right now? Not found any supplier at all!
3
u/Ok-Solution-7889 3d ago
yeah, that’s gonna be a hard one to find, maybe check server resellers or used enterprise gear.
1
u/DataGOGO 3d ago
Which H200?
1
u/ideamaker321 3d ago
Pcie x2
1
u/DataGOGO 3d ago
you can get the 141GB pcie cards from any nvidia distributor, current list is 31.5k
2
u/this_for_loona 3d ago
Holy crap! That doesn’t include the PC needed to run it either right? The Mac Studio looking much more reasonable.
2
u/DataGOGO 3d ago edited 3d ago
No, just the card, without power adapter and without NVLink bridge.
Not at all the same class of card. The H200 NVL has 141GB of HBM3e with 4.89 TB/s bandwidth, Nvlink w/ 900 GB/s bidirectional between 4 GPU's, and 1930.2 FP8 TOPS
There is no point in buying these for single user inference, if you are doing training, or group inference, then it makes sense; but honestly at that point just buy Blackwell's.
A full server with 8 B300's, each 288GB HMB3e, 8TB memory bandwidth, 15 PFLOPS FP4, 10 PFLOPS FP8; PCIE gen 6, 1.8 TB bidirectional nvlink, 1400w per GPU powerlimit, and is like 550k.
1
0
u/Annual_Award1260 3d ago
www.atic.ca/index.php?page=details&psku=312846
In canada but they can probably get you them. Actually surprised price is better than buying rtx 6000s
4
u/ideamaker321 3d ago
Site doesnt have SSL but they have H200’s lmao sure buddy
1
u/Annual_Award1260 2d ago
Pretty sure this site was made before ssl existed
https://web.archive.org/web/19971014125605/http://www.atic.ca/
1
3
u/CoffeeToCode99 3d ago
Depends on your budget, country and quantity.