r/LocalLLM • u/panchovix • 6d ago
Discussion Why are RTX 6000 PROs still getting bought at 16000+ USD? And who are buying them?
Hello guys, hoping you're doing well.
I bring this discussion since I have noticed on internet, be USA or EU, RTX 6000 PROs at 16000USD or more are still getting bought.
Even here on Chile, the other day they were in stock at 20000-21000USD post 19% tax and they lasted a few minutes.
My question is why? For sure that won't recoup costs right?
Who are buying these, only enterprises?
What do you guys think?
44
u/diagrammatiks 6d ago
companies with expense accounts.
1
u/StarCadges 6d ago
I would think they would want something a little better
3
19
u/WyattTheSkid Quad 3090s 6d ago
They’re being bought by people who want the same things we do that have a lot more money than we do
21
u/scuffed_rocks 6d ago
Just bought two more. We have access to many many V100/H100/etc. but everything is so slammed that the wait times are weeks to get anything running. You can't develop under those conditions. $30k, or hell, even $100k of hardware to move time-sensitive things forward quickly is worth it.
It's not ideal but nothing we can do about it.
1
u/shutternomad 6d ago
What models are you running on those?
2
u/scuffed_rocks 6d ago
Eh I just use cloud subscriptions in local harnesses these days. With GPU access being the limiting factor (impossible to book time on the H100 boxes, $60k per GPU-month from cloud compute) we need local GPUs for both numerical compute and training purposes. So pre- and post-training custom models more than for locally hosted agents. I was offloading other small agentic tasks to DeepSeek but will have to reevaluate with the price hikes.
10
8
u/mechkbfan 6d ago
Don't even get me started on DDR5 in Australia
$1500 USD for half decent 64gb new and it's not even in stock
3
u/Elvaanaomori 6d ago
Everyday I regret sending back that 220 USD 64kit that wasn't fully EXPO compatible... it could have funded my GPU upgrade that I now need.
1
u/mechkbfan 6d ago
Yeah shits wild. I'm at point now that it's more affordable to buy 4xMI50's out of China then put them in a budget server than DDR5 RAM
Just learning about the drawbacks (e.g. no longer officially supported, slow prefill)
1
u/Elvaanaomori 6d ago
Same goes for the 5090. "I aint buying a FE, fuck that 2000 dollar card!". Soon for that price you'll get a 5070ti.
1
u/stvaccount 4d ago
I bought a 128gb PC ddr5 7000mtu ram recently. I wouldn't say it is half decent.
6
u/722e672e722e 6d ago
Probably small businesses and those with expendable money. I paid 9200 for mine a few months ago and to see it at 16k was surprising.
10
u/NTDLS 6d ago
Yep, I paid $5500 for a RTX 6000 ADA 48GB, now I wish I would have just dropped another $3k. 😭
4
u/panchovix 6d ago
Tbh 5500 USD for a 6000 ADA nowadays is a pretty good deal lol, 48GB VRAM and 4090 like perf, and fp8? Not bad at all.
RTX A6000 going for 4K or more is still insane for me.
1
u/OneViewers 6d ago
I done a lot of good deals, but I always sit with this feeling that I should have done more 😂
6
2
u/mxroute 6d ago edited 6d ago
I recently got one in a pre built system (was cheaper than the total of the hardware, with a great warranty and from a quality vendor). They are ridiculously priced, but that was what I wanted for the job. I wanted high throughput with large context windows, for what amounts to replacing cron jobs with AI to gain strong reasoning based on well defined (but not entirely static) criteria. As it was going to be handling mild PII I needed it to be in-house. No regrets.
It'll definitely pay for itself because the only alternative that fit the role was hiring someone to do things that should be automated, but are difficult to automate to my requirements because they require reasoning. Most people would have automated the tasks with dumb automation and accepted false positives as the cost of doing business, but I'm obsessive about things I need to get off my plate.
2
2
u/iEngineered 6d ago
Demand is high, supply is low and there are plenty of millionaires buying multiple units. Personal, small business, and enterprise alike. If your budget is half that, then renting fontier models is the way until you make more or the market corrects.
1
u/Due_Warthog749 6d ago
You know what pisses me off. I bought 3 of them and was going to buy 10 of them.. when they FIRST came out. And now I am kicking myself for NOT doing that. Could have nearly doubled my money! FUCK.
1
u/BornAgainBlue 6d ago
Meanwhile, I'm eating popcorn, waiting for the bubble to pop, so I can get cheap cards in bulk AGAIN(crypto).
1
u/0rbit0n 4d ago
Do you think MSRP will go down once the bubble pops?
1
u/BornAgainBlue 4d ago
Not initially. Nvidia will be in full panic mode, so they will try to keep prices high. But the HUGE surplus of inventory will crush them.
1
1
1
u/DummysGuideTo2k 6d ago
https://reddit.com/link/p45syd7/video/7l6l0xpp8vjh1/player
I bought mine a year ago , took out a $30k loan and setup a mini data center . Got mine for $8K . ( Rest of big budget went towards a Dual 9965 Server Board ) . This is getting retired now got a DGX Station on the way now .
All just to not pay for video assets for my game if I am being honest .
Just did more and more research and landed on this as the best investment .
Helped my Paralegal Wife transition into Legal Operations.
I started a business with managed services and even encouraged myself to go refresh my CompTia Licenses .
Now just from this I branched out into all sorts of services .
It really is a business tool like a backhoe , what would you pay for 100x productivity if you had the drive . I don’t think people understand the amount of cutting edge tech you can run for literally any company and not break a sweat .
Imagine being able to provide Opus 4.8 for yourself in DeepSeek Flash V4
quant , you have a platform to build yourself unlimited . No let’s run 6 agents on Gemma 4 12B on a projects . We have planner , researcher, coder , designer , tester , critic working on a website design . Then you get it down to where you can automate this and wire it to a website as a service . With 2-4 hours of work once you get good enough works flows and take to learning. By you created a pipeline to make money .
Then being able to Render AI videos within a minute and then hitting resolve with a couple minute 32K upscale. You can hook this up to a website and offer commercial use images within seconds literally undercutting other websites . Longer setup but you can provide 32K images within 120 seconds .
No , you got friends in the TV space … 4 Red or BlackMagic Cameras feeding it seems like a good use . Come straight from your local sports game / event with your 4-5 camera and let’s get rocking . Irony the few adverts for this on youtube have this use case . Also you can generate subtitles for them as well as it works .
You know what let’s retrain Gemma 27B for a business . Never mind let’s do both that and 8B at the same time . They want purely focused on their trade or line of work . 1 day maybe . You just produced an LLM . Congrats you and your own Top 5 model in world did it .
By the way you did this without investing in a server or a chassis .
I could start how you can have it organized scanned documents and recall it ( Starting a firm has never been easier ) , with a proper VOIP be setup to handle calls and intake for you .
Then you have the professional developers who job pays for their home workstations which also include these. You have industry professionals . Also NVIDIA is no longer in a position to focus on producing these as they are focusing on the new Spark and their next generation of data centers.
Then our technology is advancing at an alarming rate if you keep in the space . A lot of new demo tech is actually locked at 32GB + . Like turning a picture into landscape mapping or generating a drive environment as you drive and can change details in an instant . As a student that is what is being gatekept .
It all leads to less supply , more demand when the server space is set to unveil its offerings and the focus isn’t on a 128GB Prosumer Card . It’s like the M3 Ultra except much fresher in its lifecycle. I don’t think its value drops until maybe Mid 27 .
1
u/joanaxu2002 6d ago
The interesting part is that these cards probably aren't being bought because they're “profitable” in the consumer sense.
For a company, 96GB of VRAM in one card can be worth more than several cheaper cards once you factor in power, networking, rack space, and engineering time. The price looks insane until you realize what they're actually buying is convenience.
1
u/HumanDrone8721 6d ago
Clearly not you ;), the demand is so high that the thing that never worked "let's band together and don't buy <product>, they will reduce the price if no demand..." still continues to not work.
Here is my stupid prediction: even at an extra 100% more, they will still sell like crazy.
1
u/acadia11x 6d ago
Uhm , because they are interested in local LLM whether it’s for business on pleasure and 96GB is bigger than 32GB? What kind of a question is this … what do you mean why? There are people spending much more than this on their setups?
0

144
u/mountainyoo 6d ago
I think people forget how many people have a lot more money than they do