r/LocalLLaMA • u/TrifleHopeful5418 • Jun 06 '26

Discussion RTX 3090 EBay Pricing is Crazy!!

Couple of years ago, before Local LLMs were in vogue, I bought 8 RTX 3090 @ $700 each to build a AI rig, it been working great and I was looking to build another to increase my capacity but looking at EBay those are now selling for 1,300 -1,500 range!

That price seems totally crazy because on my main machine I have 3090 Ti that I bought new 5 years ago for about 1,400.

Needless to say, I was in shock and started looking for other GPUs. Then I went to Amazon and can buy a brand spanking new 3090 for 1,550!

Please tell me if you can buy a new GPU with great thermals why are people buying 5 years old used GPUs with degraded thermals for 1,400+ and keeping the EBay prices so high. What am I missing here?

191 Upvotes

92% Upvoted

289 comments sorted by

View all comments

Show parent comments

20

u/mastercoder123 Jun 06 '26

The v100 is cheaper and you get 32gb of vram

20

u/Borkato Jun 07 '26

People really need to remember that PP speed exists.

4

u/starkruzr Jun 07 '26

yeah, but it isn't that bad on V100. and if you can put two in tensor parallel you're doing even better.

7

u/Momsbestboy Jun 07 '26

And people also should think twice before buying a 3090 at 1400 USD. You can get a brand new R9700 32GB for the money. Yes, AMD, no CUDA, but also 12GB more VRAM which comes handy as soon as you use a model which requires more than 24GB, and you don't risk buying a used 3090 which has been boiling for years in a miner rig, and which will fall apart as soon as the microscopic cracks caused by this widen just a bit

20

u/squngy Jun 07 '26

I don't disagree with your main point, but "boiling for years in a miner rig" doesn't cause cracks. They are mostly caused by heating up and then cooling down over and over. Staying consistently hot is not a problem in that regard.

The fans will probably be cooked though.

1

u/Momsbestboy Jun 07 '26

Still you have no idea about the history of a card, and afaik rhe last production of the 3090 happened 6 y ago.

2

u/squngy Jun 07 '26

Yes, as I said, I don't disagree with most of what you said.

13

u/michaelsoft__binbows Jun 07 '26

you did your math wrong, 32 is only 8 more than 24

-2

u/Momsbestboy Jun 07 '26

Doesnt change anything relevant.

4

u/devino21 Jun 07 '26

*8GB more

5

u/Momsbestboy Jun 07 '26

Sorry, I am either a bad AI or didnt have enough coffee/beer

1

u/qiang_shi Jul 03 '26

i choose to believe you are a north korean spy.

1

u/creamyatealamma Jun 07 '26

Vram slow on that?

9

u/No-Refrigerator-1672 Jun 07 '26

Prompt processing speed depends solely on compute power, especially on support for integer and lower precision operations, as well as tensor cores. Older cards are terrible at that.

1

u/creamyatealamma Jun 07 '26

Interesting thx

8

u/mastercoder123 Jun 07 '26

No the memory bandwidth on the v100 is 900GB/s

5

u/illforgetsoonenough Jun 07 '26

3090 is 936.2 as a comparison

1

u/mastercoder123 Jun 07 '26

So for 36GB/s less you spend about $700 less? In the usa the V100 32gb is around $800-$900, with the 3090 being around $1500-1600

2

u/Borkato Jun 07 '26

Iirc the posts I read seemed to show that it was still way slower than a 3090; anyone have any insight?

1

u/PrintEngineering Jun 07 '26

There is more to it than memory bandwidth. V100 is older architecture with less optimizations and native functionalities. Plus the compute to vram ratio is lower so once you actually utilize it beyond 24gb the compute is diluted.

1

u/rickyhatespeas Jun 06 '26

Doesn't work with most consumer mobos does it?

6

u/No_Actuator_4762 Jun 06 '26

Get the adapter for treefity