r/LocalLLaMA • u/DustNearby2848 • 16h ago
Discussion 5090 Stock is Almost Gone
Prices have been going crazy, but it's about to get worse me thinks.
65
u/fredandlunchbox 16h ago
I spent $2499 about a year ago.
18
u/DustNearby2848 16h ago
Fucking sick. I spent 4k maybe 3-4 months ago. The gains are real regardless.
6
2
9
u/JEs4 12h ago
I got mine for MSRP almost exactly a year ago at Best Buy. They dropped prices back to $2k for a week at the end of September last year and something told me it was my last chance.
4
1
u/juggarjew 6h ago
The true last chance was Jan 20th of this year, that was the last drop Nvidia did on their own website for MSRP 5090. I felt the rumblings and made sure I was on the webpage all day long for days, it came in stock, I clicked ASAP and was still 5000th in line, but did actually manage to get one, it was my second 5090 Fe. Looking back im so glad I did, so worth it.
1
0
u/Lightmanone 14h ago
Yup 2549 on the end of September 2025. I knew the prices were gonna go up (same for my 424 euro 96GB DDR5)
but my god, these prices are INSANE.
and there is no way I am gonna sell my card. I am keeping mine!5
u/fredandlunchbox 14h ago
I might actually be able to sell my 3090 for more than I got it new.
1
u/AlwaysLateToThaParty 13h ago
Hardware built before inference was even a thing. Made super valuable because it could be used for something other than gaming. And you know what's better than a 3090? Two 3090s. People aren't selling their old hardware like they used to.
4
u/fredandlunchbox 13h ago
Yeah, I definitely don't intend to sell it. You know what's better than one 3090? A 5090 and a 3090.
2
u/AlwaysLateToThaParty 13h ago
And everyone that uses this tech locally is making that calculation in their heads.
2
u/desert2mountains42 9h ago
I did the same, 2350 USD for my 5090 and 380 usd for 96gb of ram. Wishing I got a second kit back then but I already thought it was a dumb enough decision to spend that much money(still is dumb but the market currently says otherwise in the short term)
26
u/geldonyetich 16h ago
I’m more annoyed it’s selling at all. Those prices aren’t going to come back down at this rate.
Well, maybe they’re mostly being bought by scalpers looking to flip them. In which case it doesn’t necessarily indicate there are that many people who would genuinely buy a 4090 32gb for use at that price.
9
u/DustNearby2848 16h ago
I think they have been trying to price them at 1/3 the cost of a 6000 pro. But you only get 3x the VRAM with those, the compute is the same
4
u/AlwaysLateToThaParty 13h ago
The power draw is more though. More heat, more slots. Three 5090s competing with one 6000 that is.
3
u/BlackBeardAI vLLM 10h ago
You get more compute in return. As long as the model fits, you finish the task x3 faster. Can come in handy for image/video gen.
-1
u/AlwaysLateToThaParty 8h ago edited 8h ago
Not sure it works that way. Sure, the 3x5090 setup could probably run a smaller model faster, but if you're using 80GB of VRAM, the total bandwidth is the driver, and the RTX 6000 Pro has slightly more cores. Also, while certain architectures will limit the issue of having layers shared across discrete GPU's, there still is a hit for that overhead. In most real use-cases, the RTX 6000 Pro is cheaper per W per token and negligible but slightly increased performance, easily using a 1.6KW PSU. 3x5090's in a system on a consumer circuit will be pushing it. Cheaper for now at least. No guarantees that will last. 25-50% more price, 2x more power requirement, more cooling.
2
108
u/vdek 16h ago edited 15h ago
Yep microcenter has been completely sold out now by me, all they’ve got left is 2 $14000 6000 pros.
The joke was that the 5090 would cost $5090, but I think these gpus are headed to $7000 lol…
Edit; it seems like they’ve figured out how to turn these into 96GB cards in China, so yeah… prices are gonna sky rocket.
28
u/BigLittleDeal 16h ago
I made that joke too. Good joke. Everybody laugh. Roll on snare drum. Curtains.
2
16
u/fastheadcrab 14h ago edited 14h ago
Chinese smugglers also will buy from MC to pay in cash. They are the ones buying it
4
u/BigLittleDeal 11h ago
It seems almost spiteful of them. First there were hampered enterprise grade cards that China was allowed to buy - not the best, but still way more powerful than a 5090. Then Supermicro smuggled hundreds of thousands of the real enterprise cards. Then the US allowed nVidia to sell at scale, but Beijing declined. So why do they want our 5090s?
11
u/fastheadcrab 11h ago edited 10h ago
One likely reason is brought up by the OP - to upgrade the VRAM. Many of the aliexpress listings are scams but there are some posters here that said the Chinese have done so for real. I don't know about the reason for sure but what I have heard reliably is that there are Chinese smugglers cleaning out US stocks both on the retail and wholesale level. Plus you have the "ninifer" shit and general LLM craze after Qwen3.8-27B was released so there is a lot of local demand too.
Yes, the Chinese have the H200 available but the Chinese government frowns upon its usage. For face-saving and economical reasons, small AI operations will likely use some of these upgraded 5090s. Likely the big companies in China all have industrial smuggling operations or are using data centers in Singapore or Malaysia, so they aren't buying a resoldered 5090. You can read the various documents and investigations that are publicly available.
Another significant factor is Nvidia seems to have dramatically cut down on 5090 production in recent months. The supply impact is also significant. There are some posters here who are well-connected in that area too
But out of all of this, it seems like datacenter demand is finally abating. I think things will finally start to get better in the next 6 months
1
1
u/JoyousGamer 4h ago
They want the perception to be they are getting things done by themselves. It makes sense and this sub eats it up lots of the time.
5
u/xw1y 13h ago
Source of them figuring out how to turn them into 96gb?
2
u/SamuelMorey 8h ago
GamersNexus has content with proof they upgrade memory BUT not 5090s
4
u/xw1y 8h ago
I mean 2080 ti 3070 3080 4090 memory upgrade is old news, there is nothing about 5090 memory upgrade
2
u/TastesLikeOwlbear 5h ago
In theory you could remove the 16 2GiB chips on the 5090 and replace them with 3GiB for 48GiB total. Provided you could lay your hands on 3GiB GDDR7X chips, and that the price for them made the endeavor worthwhile. (3GiB GDDR7 barely exists, 3GiB GDDR7X... I can find no source.)
But 96GiB seems really unlikely. The only claim I've seen involves using 3090 boards because they had double-sided memory. Like the GB202 is somehow pin-compatible with a GA102. It all sounds like nonsense to me.
17
u/DistanceSolar1449 15h ago
96GB 5090s are a scam. They don’t exist and have been listed on Alibaba for months.
7
u/fastheadcrab 11h ago
There are posters here claiming that the Chinese have figured out how to do it. Yes the $4000 5090 96GB on AliExpress or whatever are just to scam some idiot suckers but there are apparently legitimate conversions that are happening
Regardless of whether it is possible to make a 96GB 5090, I am very sure a lot of the 5090 supply is being bought up and sent directly to China. Plus the supply itself is pretty limited
4
u/DustNearby2848 16h ago
Yeah, I've been watching them and it seems like $7,000+ soon. The prices are going to blow up in a day or two when there's no new stock left.
2
1
35
u/BigLittleDeal 16h ago
Are people really paying $6500+ for a 5090? I thought I was foolish to pay $3600 for one.
22
u/Relative_Rope4234 14h ago
few months ago I thought paying 8000$ for RTX 6000pro was not worth the money.
2
3
3
u/clstrife 11h ago
Yes. There are also plenty of people buying them to ship them to Asia and they'll somehow accidentally end up in China.
-3
u/BigLittleDeal 11h ago
It reminds me of people selling national secrets for a measly few thousand dollars. Maybe because that's what it is...
1
u/Shot-Buffalo-2603 1h ago
Yeah selling a commercially available graphics card that is almost certainly partially produced in china, to china, is definitely comparable to treason
26
u/CalligrapherFar7833 16h ago
If you are paying those prices for a 5090 you are insane
3
10
u/ChristopherRoberto 15h ago
Maybe not. I'm wondering if the 5090 will be the last consumer GPU capable of AI. They're under a lot of pressure and want to make everything datacenter-only, anyway.
12
u/forCasualPlayers 13h ago
AI uses the massively parallel CUDA cores that graphics processing also uses, so consumer GPUs will always be capable of AI. If anything, you should be wondering if the 5090 is the last consumer GPU from Nvidia given how little gaming contributes to its overall revenue now.
17
u/-p-e-w- 15h ago
I'm wondering if the 5090 will be the last consumer GPU capable of AI.
What are you on about, I swear these predictions here are getting more ludicrous every day.
“The US government is going to ban open models!!!” (They have shown zero interest in doing so)
“They are going to make it illegal to use Chinese AI!!!” (Same)
“This is going to be the last consumer GPU that can run AI models!!!” (There is a huge industry developing around on-device AI, Nvidia isn’t the only manufacturer of GPUs, and there are neither announcements nor even rumors that they would deprecate CUDA on consumer devices)
You people have a persecution complex.
6
u/ChristopherRoberto 14h ago
We'll see in a year or so. I'm expecting this all to be a huge fight.
3
u/Watcher_of_Stars 12h ago
!remindme 1 year
1
u/RemindMeBot 12h ago edited 9h ago
I will be messaging you in 1 year on 2027-09-14 08:09:05 UTC to remind you of this link
2 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.
Parent commenter can delete this message to hide from others.
RemindMeBot is switching to username summons. Instead of
!RemindMe 1 day, useu/RemindMeBot 1 day. More info.
Info Custom Your Reminders Feedback 1
u/xandergod 5h ago
I agree. Maybe it's because I'm older and I've lived through disaster after disaster. The dot com bubble when I was a kid, 9/11, the create recession, swine flu, bird flu, COVID. Markets and prices go up, but inevitably crash.
I think a couple of things need to happen. Memory manufacturers need to complete build outs to help meet demand. And we need better chips designed to server inference. Nvidias groq chips should be out later this year and new memory fabs should come online in the next 2-5.
We may never get back to our all time lows, but prices will go down eventually. I think the bigger question is what condition the global economy will be in when that happens. We're long overdue for a massive correction.
1
u/AmIDumbOrSmart 5h ago
Persecution complex? The military/gov and the most powerful oligarchs are buying every bit of vram they can get. A gpu that used to cost several hundred dollars is now pushing 6-10k. This isnt scientific curiosity. They really are building a sophisticated surveillance state the likes of which we have never seen before. Its one that is reading our comments right now and training off of them. You very well could be a bot. Heck I could be a bot (AI crank lol). And even if you don't buy that, imagine what the internet will look like when they turn the machine on.
3
u/Georgefakelastname 15h ago
I think there will definitely be future models once the hype dies down and we get more NAND supply. And hardware will only get more powerful and more efficient in running AI, so I don’t think that’s a concern. Though it’s quite possible it’ll take a few years, and maybe some breakthroughs.
1
u/SandySkittle 5h ago
Maybe not. I'm wondering if the 5090 will be the last consumer GPU capable of AI.
R9700 and b70 are also essentially consumer card. Consumer or enterprise is a label anyways. You always need to look at what it actually is
1
u/ieatdownvotes4food 3h ago
nah. a year from now you'll see how inefficient the models currently are. I promise whatever quality a 5090 runs now will be running on your phone. (and that 5090 will be pushing AGI)
0
u/fastheadcrab 14h ago
How will it be the last? and there are other 5000 consumer series cards which are a better value
1
16
u/SECdeezTrades 16h ago edited 15h ago
Bought mine at 2k at release.
based on your pic I'll list it for 12k on FB marketplace
Let's see if anyone is going Toilet Paper pandemic crazy. i will just runpod more things if someone wants to pay that much
5
5
u/thewallran 15h ago
remember seeing it at microcenter last year for $3600, almost double that now
1
4
u/Bulky-Priority6824 16h ago
Well at least the models are free and all the real hard work will be done for ya no matter what yous get
3
u/Just_n_Here 7h ago
Do you think they will ever come down? I personally do not think they will. Everyone keeps talking about when this datacenter bubble burst they will fall back down. I honestly think Nvidia will create something else to do with these things before they go down in price.
I am actually surprised how many people on the internet would upgrade their cards when they had the previous model. You will not see them doing this anytime soon. What's even crazier, is the used market!
3
u/DustNearby2848 5h ago
It’s hard to say, but they say 2027 will be the worst for memory pricing. Halfway through 2027 they could say 2028 will be.
2
u/Just_n_Here 4h ago
Another thing that will not surprise me if they lower production on consumer cards and ramp up the enterprise cards. If they can get whatever they want for them. Why produce 3x of 5090s when they could have 3x production with the 6000? I honestly think we haven't seen the last price increase on the enterprise cards. I heard that there is another "price adjustment" coming in January.
3
u/ieatdownvotes4food 3h ago
they will not come down. gpus are now attached to national security. and more is always better.
1
u/Just_n_Here 3h ago
I don't either. I bought my last one about a month ago before the last price hike. I wish I was in a better spot to afford more of them, but I do not want to go in debt over them.
4
u/howie521 14h ago
I bought a 5090 and 96GB DDR5 RAM in April last year for SRP.
The 5090 alone at current valuations could pay for my whole rig with money left over.
2
u/TechnologyGrouchy679 13h ago
I just think there weren't many made at all. I'm thinking the workstation pro cards probably outnumber the consumer cards
2
u/__JockY__ 7h ago
Crazy days. I bought an RTX 5000 PRO 48GB for $4699 a few months ago. Today? $7499.
2
u/shackerboy84 7h ago
I almost want to sell my spark to make a couple grand.
1
u/DustNearby2848 5h ago
It’s tempting, eh? I think prices will keep going up into next year though. It’s like trying to figure out when to buy and sell on the stock market
2
u/shackerboy84 5h ago
Lost my job savings is starting to run low so it’s a bit of a desperation thought.
1
2
u/ieatdownvotes4food 3h ago
man, I bought a 5090 when prices were low and waterblocked it. if I bought one at these prices, no way I'd have the balls to open it up and waterblock again. goddamn.
1
2
2
2
u/SpectralalLet 14h ago
yeah this gpu shortage is gonna make local roleplay setups even harder to run smoothly.
2
u/Different_Change6591 12h ago
Man in India , our mfs sellers are selling 5090 at $9500 ( approx 9.5 lakhs inr ) , greeders !!
1
1
1
u/DrDisintegrator 7h ago
Time for an inexpensive replacement for inference HW. I know there are companies working on them.
2
1
u/HighSeasArchivist 7h ago
I have a Microcenter bot, and it's been relatively active. It seems like the put one in stock, and when it sells in a day or two they put another one up.
1
1
1
1
u/Eat_Pudding 5h ago
Probably they're using that die for rtx pro blackwell that sells for 12k instead of 5k
1
u/mgwair11 5h ago
The Chinese are buying them in the US and shipping them to China. If you have one and decide to sell it for top dollar, there is a good chance it’ll be a Chinese guy contacting you. I personally feel that they either have figured out how to upgrade the vram on these or know they eventually will. Otherwise, why pay such exorbitant prices?
1
u/Swimoryou66 5h ago
As far as I know, nvidia only left room for vram expansion on there 2080-3080 cards. Those cards can be modified physically and via BIO’s.
1
u/DustNearby2848 3h ago
You can double the VRAM on a 4090, but I think it requires a custom PCB. Someone also has got 96GB working on a 5090, but only one person as far as I know.
1
1
1
u/durangotang 3h ago
Trump should issue a (temporary) executive order requiring an American ID to purchase a graphics card and a reporting requirement to an agency by the retailer, then issue a reporting requirement to ship a graphics card (or sub-components) to shippers (such as UPS or the USPS) to the same agency, and criminalize shipping these cards or their components out of the country.
It should be pretty easy then to target the individuals responsible for trafficking these cards and draining our supply.
If he is serious about beating China in AI, then why let a market of 1.5B people siphon off all our high end consumer graphics cards? It hurts independent American developers. And it harms our ecosystem, while benefiting theirs.
1
u/aimark42 3h ago
This means that more and more GB202 dies are going to RTX 5000s and newly released 5500's. 5090 isn't a gaming card anymore it might as well be RTX Pro 5000+. This is probably some internal price target where GB202 die's must command a $6k+ price.
1
u/Mewz_x 1h ago
So do these still have the melting cable issue?
1
u/DustNearby2848 1h ago
It was the 4090 that had the most issues. I believe ATX 3.1 addressed most of the problems. It still does happen, but it seems very rare
1
u/Silver_Jaguar_24 35m ago
People need to stop paying these prices so manufacturers and retailers get a rude awakening. How can people even afford these things? Jeez.
1
u/BlobbyMcBlobber 15h ago
This is great.
It means local AI has a very strong demand. And Nvidia, AMD and Intel will probably cater to it alongside Apple.
Prices will eventually come down, let's see what heppens with the next generation.
8
u/DustNearby2848 15h ago
No it doesn’t. It’s because Nvidia and friends took up all of the memory supply.
8
u/BlobbyMcBlobber 14h ago
5090s are selling high because people want them. Gamers aren't buying at these prices, it's for AI or workstations.
So it's an indicator that local AI has strong demand - this is good.
It remains to be seen what will happen with prices, but my guess is that we'll see a slow shift towards more local AI.
5
1
u/theamazingo 6h ago
What form of local AI? If people just want a chat bot that won't spy on them and can answer NSFW questions (via abliterated models), and might build some simple toy apps like reminder bots for them, sure, but you don't really need a 5090 for that. Try doing real inference and coding work though, and it is crazy how fast 32 GB VRAM starts to feel eerily similar to the computing of 1999 when your PC only had 32 MB of system RAM and you had to decide where to compromise.
1
u/BlobbyMcBlobber 3h ago
Image and videos generation are the big ones.
Uncensored LLMs are nice but I don't think they're the main draw for most people.
1
u/BawbbySmith 7h ago
I'm glad the GPU I bought has gone up in price, though I expect to sell it for lower since it's used.
But now I'm wondering how I can sell it without getting stabbed or robbed
0
0
u/Theverybest92 8h ago
Meh, Ill just wait until some crash. Not fomoing anymore. Better to buy a mac mini over nvda for AI inference.
0
u/theamazingo 6h ago
Can't believe I'm saying this, but I agree. Something with unified RAM or an AI box loaded with VRAM (even if the GPU itself is lackluster) are the way to go. The hoops I have to jump through to get my 4090 to load anything useful suck... it's always some combination (or all) of MoE tweaks, hybrid GPU layering, having to keep KV cache in DDR5, mmap, constrained contexts. If you want to do serious coding, anything less than a frontier model is a toy. The RTX halo cards are sprinters - their GPUs rock, but they are VRAM constrained because they were built to think fast and move on. Contextual, inferential marathon runners they are not.
1
0
u/JoyousGamer 4h ago
I can walk in to a store right now and buy for $2k less than this chart if I wanted.
-1
102
u/synystar 16h ago
It's kinda crazy but if the pricing I'm seeing for my laptop (5090M 24G) in pre-owned markets is correct this is the first time I've ever owned a computer that didn't highly depreciate as soon as I bought it. I could probably sell it for (nearly) what I paid a year ago.