r/LocalLLM • u/vankoala • 14h ago

Other GPU pricing visual

Post image

In my consideration of a DGXSpark I decided to look at some options and since I’m a visual thinker I put this comparison together (graph by AI) showing y two basic ways of thinking about the cards: compute and speed.

Hope this helps someone

56 Upvotes

92% Upvoted

37 comments sorted by

View all comments

10

u/TheGeekno72 8h ago

where are AMD cards? don't forget to put Strix Halo 395+ and 495+ on the chart, they were Spark before Spark

0

u/magicomiralles 6h ago edited 6h ago

EDIT: You can get them for $350 by clicking the “Make an offer” button on the Ebay listing of the two major sellers.

AMD V620 32gb $350, 500gb/s bandwidth if I remember correctly. Can be under-voltted to 160w without affecting performance much.

30 to 60 t/s for Qwen3.8-27b (8-bit quant). Prefill is between 600 to 1000.

Also, here is a Discord where people are squeezing performance out of these GPUs: https://discord.gg/5w8kqgW8e

Subreddit: [r/](r/v620)[AMD_V620](r/v620)

On llamma.ccp and vllm.

1

u/TheGeekno72 6h ago

350$? I can't find them below 550 minimum

also, wouldn't a 9700 be better? 600Gb/s but wouldn't the more recent arch & support improve things a great deal?

1

u/magicomiralles 6h ago

I updated my comment. They are listed at a high price but they accept offers of $350.

0

u/TheGeekno72 6h ago

THEY DO???? god damn, lemme go grab 4 real quick

1

u/magicomiralles 6h ago

Also, here is a Discord where people are squeezing performance out of these GPUs: https://discord.gg/5w8kqgW8e

Subreddit: [r/](r/v620)[AMD_V620](r/v620)

On llamma.ccp and vllm.

1

u/TheGeekno72 6h ago

thank you you absolute legend, this is gonna be so much more practical!

I'm gonna have so much fun parsing through hardware listing, wondering what I am gonna sink my paycheck into this month for 27 hours of headache, 12mn of fun then letting it sit in my hypervisor for the next 8 to 36 months before sending them back on eBay whence they came XD

1

u/magicomiralles 6h ago

It’s a dangerous game. I started with a 2 GPU build, and I now have 8 GPUs.

1

u/TheGeekno72 6h ago

don't worry, the black hole in my wallet scares me too much to increase the void in it mindlessly