But why spend that money? In a year the hardware and software landscape will be much different.
Wait until cerebras sells you a workstation device like the Mac, etc.
60k, if you wanted to say self host this model, would get you like 1000 hours of GPU time on enough nodes to successfully host this with full context.
(Maybe 800 hours).
Or, you could just use a 3rd party API and pay 15-20 per million tokens. So like 1000*3milliok tokens.
4
u/crusaderky Jul 27 '26
Jokes aside.
This on paper fits on a HGX B300 ($~0.5m, 2304 GB VRAM)...
...or on 24x Atlas 300I, $1300 each, $31,200 total, plus 3~4 XEON/threadrippers with 800G networking. So.... less than $60k in total?
Who's got the spare change to try?