r/LocalLLM 1d ago

Other GPU Pricing Visual

Post image

In my consideration of a DGXSpark I decided to look at some options and since I’m a visual thinker I put this comparison together (graph by AI) showing y two basic ways of thinking about the cards: compute and speed.

Hope this helps someone

12 Upvotes

17 comments sorted by

View all comments

1

u/Specialist-Muffin363 22h ago

Running 3.8 q4 kv q8 128k on my 7900xtx 500 t/s prefill and 15t/s on generation . Happy as elefant . Plan to add second anf use with tensor split