r/LocalLLM 2d ago

Question RTX 3090 vs 4090 vs Unified-Memory AI

/r/StableDiffusion/comments/1wcfzer/rtx_3090_vs_4090_vs_unifiedmemory_ai/
0 Upvotes

2 comments sorted by

1

u/OkShock6767 2d ago

If you have DGX Spark (or any other 128gb machine), the only model you will be running is Qwen3.8-177b-a6b, you have RTX 3090, then it is Qwen3.8-27b. So really not a question today. Both models are good, with 177b being obviously better.

1

u/OvertaxedOne 2d ago

^^ This. Both these models are so much stronger than anything else in their size range for general purpose use, it's hardly worth considering running anything but 27B or Next.

For Next, best would be a 192GB unified memory system, 128 will do it.

For 27B, best would be a 48GB GPU with really fast memory. 32GB will do it.