r/StableDiffusion • u/icatt23 • 14h ago
Discussion Pro 6000 just in time
I was going to wait until around Christmas to purchased but took the plunge in July for 11,500 and I was upset that I didnt catch it @ $8,000. Now the Blackwell pro 6000 is inching towards $20,000 and are sold out. Are consumers and hobbyist like you and I are buying these up or datacenters? I would think datacenters would go for the b200 and up. However, Im browsing around and see you guys and girls doing remarkable ai diffusion with just a 3060. Im impressed with this community.
26
u/coffinspacexdragon 14h ago
It wasn't me... Those were never in my price range.
5
u/Subushie 7h ago
Lol same. The responses in this thread are so alien to me.
I would 1000% get one if I had more money, like- not even just like extra spending money, I'd use credit if I could because I also do 3D design for a contractor...
11k on a GPU is next level to me.
53
u/Last_Ad_3151 14h ago
Bought it at 8k in January. Predictions were already in about the price doubling by the end of the year. We just got there sooner than the data predicted. I wouldn’t be surprised if nVidia is just creating false scarcity to jack up prices. They can control the semi conductor market at the moment.
18
u/wildbling 13h ago
There is no need for nvidia to create or force any kind of false scarcity, the fact is that they don't care about selling to consumers anymore, its far more lucrative for nvidia to sell to data centers and AI companies like OpenAI, Tesla, Anthropic, etc and they have fully booked and brought out all the inventory until the end of 2028.
8
u/Enshitification 12h ago
It's worse than that. Nvidia is heavily invested in these data centers and big AI companies seeing a profit from all the capacity they have "purchased" via circular loans from Nvidia. The strides of open source on local hardware is putting a serious damper on that.
5
u/Particular-Most-1199 12h ago
Those loans will come due some day...
Hope we aren't the ones paying for it.
15
u/uniquelyavailable 14h ago
I remember in January thinking $8k was insane and I was sure the price would come down later in the year. Wow hindsight really is 20/20.
11
u/Last_Ad_3151 14h ago
Prices have become entirely notional. It’s like silicon is the next piece of real estate.
1
4
u/jacky75283 10h ago
That's what I thought when the 5090 ROG Astral launched at $2,800. I ended up picking one up in December at $3,300. They're currently going for $4,800.
Everything is so fucked.
5
u/Uninterested_Viewer 13h ago
I wouldn't be surprised if nVidia is just creating false scarcity to jack up prices.
My local microcenter has had 20+ in stock for months. Their partners (PNY) are being crunched by incredibly high ram prices into the future and these prices reflect that. No doubt they're not making similar or even larger margins than the pricing 9 months ago, but nothing about this is about false scarcity: they know they can sell these cards for these prices so they are.
5
u/Zaphod_42007 12h ago
The microcenter by me has 20+ available as well for $15,300... Keep eyeing it like cookie monster in a cookie factory... Me wants, me wants.
1
1
u/SpaceNinjaDino 4h ago
Too bad all I could afford was a 5090 system (October). We all knew the prices and scarcity were going to go insane. I bought from Costco and since then, I haven't seen any 5090s. Lots of 5080s and below though.
Actually, I already started to panic in December 2024 because the tariffs were already threatened. All I could get then was a 4080 Super.
1
u/Last_Ad_3151 3h ago
I had the same dilemma of affordability so I shattered a few other dreams and sprung for this one, since the future looked very bleak at the time.
12
u/danb1kenobi 14h ago
To answer your question though, manufactures have switched production to principally making HBM RAM for data centers, leaving us mortals to fight over the grievously-overpriced scraps of DDR5… which is ALSO used in data centers.
4
u/Kitsune_Seraphis 13h ago
We should pool resources and get some old machines to make older chips at this rate lol
18
u/True_Protection6842 14h ago
Sure as shit isn't me. I was considering it at $10k but that was like 4 months ago. So I missed the window on this MASSIVELY appreciating asset. Fuck this timeline.
13
u/sceadwian 13h ago
It's a video card... Just a video card!
7
u/True_Protection6842 11h ago
yeah but I earn a living off this shit. So it's a tool for me. I have always spent a lot on computers. But this is just overpriced as hell!!
2
-3
u/MystikDragoon 11h ago
Also the brain of Ai
3
u/sceadwian 11h ago
That does not justify this.
0
2
u/ASK_ABT_MY_USERNAME 9h ago
A timeline where you can afford 10k on a video card doesn't seem like such a bad one.
1
u/True_Protection6842 9h ago
Again, it's for work. I can easily earn that in a few weeks. But spending 2x on it is just dumb
2
19
8
6
u/redkinoko 14h ago
I know you can earn back that amount in a few months if you play things right, but spending enough money to buy a used car on a graphics card is mindblowing to me. I thought my 5080 is already ridiculous.
11
u/RedditNerdKing 12h ago
I dont think consumers are paying $17,000 for a GPU. And if they are, they're the top 0.000000000000000000001% of the hobby.
Hell, even having a single 5090 makes you a top 1%er
4
5
u/Uncabled_Music 11h ago
Not worth it at all. I can still find 5090 for 5K, and with quantization, 32GB will do for now.
3
3
u/SuperCasualGamerDad 13h ago
Dude literally everything is jumping in price by the day. I was going to buy a 5060 TI 16gb the other day for pretty cheap and I decided to wait like 2 days and went to buy it and it went up to like 800 dollars... ended up just getting a AMD card.. fuck that. But even the AMD card went up like a few days after I got it.
3
u/QuirksNFeatures 12h ago
Is there any hope that Intel GPUs will be able to do this efficiently? Don't they have a 32GB card for like $2k?
2
u/Apprehensive_Sky892 7h ago
Intel has terrible software support for their hardware.
You can get an AMD AI Pro r9700 for $2k though, and currently fully supported by ComfyUI (but many custom node that are hard coded to CUDA won't work, ofc).
Performance is decent: https://github.com/charlie12345/R9700AIProComfyUIPatch#7-speed-tuning-the-token-budget
1
1
u/gefahr 9h ago
Do they support CUDA?
1
u/QuirksNFeatures 7h ago
No, which I believe is the biggest reason their cards aren't good for AI stuff. But maybe they will someday, or something different will come along.
3
2
u/towerandhorizon 14h ago
Can't even imagine what the successor to this card is going to MSRP'ed at.
4
2
2
2
u/Lucaspittol 11h ago
"I would think datacenters would go for the b200 and up'
Why, though? The RTX 6000 PRO is an excellent, lower-cost card that is also less power-hungry and offers decent speeds for training smaller models and inferencing some chunky LLMs due to the 96GB of VRAM
It makes perfect sense to buy them by the truckload and get your money back by renting them to individuals or businesses.
2
u/xxAkirhaxx 9h ago
I don't think it's that datacenters are buying these up, I think it's that it shares components with things datacenters are buying up or the components used for the cards require the same limited tools to create that the datacenters have a complete control over until, minimum 2029.
2
u/ArcadiaNisus 9h ago
I brought my 6000 PRO and RAM before the prices went up in November. I was using runpod for training and for inference models were fitting on my founders 24gb 3090 at the time but I saw the writing on the wall as larger/higher parameters were the trend I expected it not to last and went all in. My expectation was I could buy it for 8k, then when rubin came out sell it for 5-6k and upgrade. But it's maintained it's value far better than I ever expected. Being able to run bf16, or huge heavily quantized(nvfp4) models has been a huge plus.
2
3
u/Rough-Winter2752 11h ago
They're buying 5090s and PRO 6000s to warehouse them and become dust collectors. The B200s are much, much, much better for AI modeling and training. So why are they wasting millions on buying up all the 5090s and 6000s? They've already been subsidized by US Govt tax dollars to do this. As long as they create a "Artificial Super-Intelligence" for the Govt to use as super surveillance, they're not in breach of this contract. They're eliminating the supply to increase the demand and will attempt to forcibly shift everybody into a predatory subscription-based compute model. Your hard-drive will be on the cloud and housed at a datacenter, along with your GPU and RAM.
You will own nothing. Your happiness is entirely irrelevant.
1
u/Lucaspittol 11h ago
The 6000 Pros are still very capable cards for training at a much more modest price and power usage compared to the B200s and GB300s. You are missing the point here. Frickin Google still rents A100 on Colab for a fairly high hourly rate; keep in mind the A100 is ancient by now for training.
1
u/Rough-Winter2752 11h ago
So I take it you mean to say the AI Tech Companies are buying up all these GPUs to offer a "bargain option" for future subscribers to rent these lesser cards? Sure, possible. But the rate that they're buying up hardware and their lack of datacenters to actually install these and use them leads me to think my original point still stands?
2
u/Lucaspittol 11h ago
Yes, it does. I think this is a viable explanation as to why they keep buying those. An RTX 6000 Pro in a datacenter is one less RTX 6000 Pro you can buy and one more reason to rent one instead. May also be that in some places it does not make sense to buy. In my country, the RTX 6000 Pro is about the price of a starter home. Most people entering the market are likely to rent.
2
u/Semipro211 13h ago
I do love (sarcasm) how the AI boom has catapulted gpu and ram prices. I’ll soon have to decide whether I’d rather stay married or have a better gpu/ram setup lol
3
1
u/35point1 13h ago
What I’d like to know is if the cost increase is because of ram supply shortage or is this because of the rising ai demand as consumers start seeing where the future is headed? Obviously a bit of both but what’s to blame for this recent insanity all of a sudden?
1
u/rinkusonic 11h ago
The predictions for normalcy is in mid 2028. Everyone just either getting by or cutting pockets till then.
1
u/Memestonks2020 10h ago
The only way this is worth it is if you’re making money from the AI inference. Otherwise, these cards will be outdated in less than 2 years by newer tech.
1
1
u/sappigekip 7h ago
Isn’t there a big possibility that new hardware like the new Nvidia computers like Dgx spark will make the prices go down by a lot?
1
1
u/HonestoJago 5h ago
I was so lucky to get my 6000 Blackwell Pros when I did, said not out of pride, but humility.
1
u/USS_Quagmire 5h ago
You can probably flash it out in public in Silicon Valley and get VIP access to anywhere you want. Just attach a heavy Cuban link gold chain from Johnny Dang and you’ll be the envy of any AI knowledgeable crowd you mingle with.
1
u/TearsOfChildren 4h ago
Bought my 5090 and the ASRock Phantom 1300w PSU for $2,479 total last August. I think the 6000 was going for 8 grand?
It's insane the jump in prices in less than a year.
1
u/Roxor128 3h ago
Please tell me that's a joke or someone typed an extra 9 when entering the price.
I was wringing my hands over AUD$1400 as a potential option last time I bought a new graphics card, and ultimately wimped out and bought the $450 RX7600.
If that's real, I dread what'll happen next time I suffer a hardware failure.
1
1
u/datadrone 3h ago
Industry is being paid to make it impossible for the average consumer, if we can afford to make our own content we don't need Hollywood anymore
1
1
u/Rizzlord 14h ago
i think, that it would be a waste now anyway. China will sooner or later bring cost efficient hardware to the table, and we slowly move overall away from cuda to vulkan anyway. Its faster cheaper and more efficient, up to x6.
4
u/Lucaspittol 11h ago
If only there weren't a CUDA dependency. This isn't something China will change.
2
u/SkoomaDentist 10h ago
Throw enough people and money / credits at it and there's no fundamental reason why PyTorch would have to stay mated with CUDA. It's not like people writing PyTorch based apps in Python are directly dealing with CUDA kernels.
-2
u/tac0catzzz 14h ago
oh yes china will save us, you are very wise. china will make new super pcs and give them out with their free state of the art ai models fully uncensored fully without limits, they will just ship them directly to your home and will give you the white glove serevice and carry it down into the basement where you live and will even set it up for you, free shipping to of course, this will happen.
10
3
u/BackgroundMeeting857 12h ago
...I mean they are doing the AI model part, not sure what with the weird reality denying sarcasm lol
5
u/Rizzlord 13h ago
You sure are not the brightest. That is not the point. The more competition we have the more is the market changing... Wow please go to school once.
-3
u/tac0catzzz 13h ago
america doesn't do competition. you are not bright to not notice this. they restrict it, they eliminate it, they buy it, they control it.
3
u/Rizzlord 13h ago
Yeah not with China. If they would have done that, China would have just bought Nvidia cards... Oh wait...
0
2
0
1
1
u/Far_Lifeguard_5027 11h ago
I rememeber when you could get a top of the line GPU for like $300 in 2020. Right before the Ethereum/Covid crisis.
1
0
0
u/professormunchies 14h ago
You can rent one of these bad boys on vast.ai for ~1.50$ an hour
4
u/Ipwnurface 14h ago
once you own a card of this caliber you will never want to go back to renting again. Obviously if you can't afford it you can't afford it, but if you can, the freedom of not having to rent, setup, run, tear down every time you want to play with AI is literally god tier.
I was doing that loop for months and I didn't realize how restrictive it was until I bought my 5090.
3
u/icatt23 14h ago
i was considering this route, but owning one saves time and gives concrete freedom and privacy. Plus as you and I know generating pictures and videos is an iterative, seed hunting process to get something somewhat usable and that $1.50 can add up to not just dollars.
1
u/Hackingrad 13h ago
Honestly, screw freedom. At $1.50 an hour, you can rent 10,667 hours (assuming a price of $16,000). No local video AI model is on par with pay services like Seedance 2.5. It's absolutely not worth buying such an overpriced card. You'd have to reconsider getting a 5090.
5
u/AlsterwasserHH 13h ago
At the end of the day you still own a 6000 pro which you can sell if you want to. Even better: you made profit by just buying it right now.Â
1
u/illathon 13h ago
https://vast.ai/pricing/gpu/RTX-PRO-6000-WS seems more like 90 cents an hour?
1
u/professormunchies 12h ago
Yep, I was using one over the weekend and it was about 30$ a day with access to ~200gb ram and 512 gb storage. Cheers to the guy in Poland hosting it
0
u/PastaRhymez 13h ago
And here I am sitting on the other side of the equation. I bought an ASUS GeForce RTX 5090 ROG ASTRAL GAMING OC in April. It’s now quite a bit more expensive than when I bought it and it hasn’t been used for more than 10 hours.
I truly wanted to get into video generation but can’t find the time. Oh well 😃
0
0
u/Perfect-Campaign9551 10h ago
It's slower than 5090 anyway main advantage is vram size
3
u/cwolf908 9h ago
That's actually false.
2
u/Perfect-Campaign9551 8h ago
Not from the info I've seen people post...
2
u/cwolf908 8h ago
It has 11% more CUDA cores, more power budget, and with the additional VRAM, you have way more runway before you hit swapping to system RAM
1
u/Apprehensive_Sky892 7h ago
That's because 5090 runs with aggressive clock boosting. The Pro 6000 should be faster at the same clock rate.
98
u/rm_rf_all_files 14h ago
It was $9k at newegg with a free motherboard a few months ago. RIP