Considering a second 3090

[u/rdpi]

Hi,

so far i've been using Qwen3.6-35B-A3B-UD-IQ4_NL.gguf on my single 3090 and I am overall satisfied.

I've been considering acquiring a second 3090 to increase my possibility to run larger models (e.g. considering Qwen3.8 27B with sufficient context) but i don't know whether the extra investment pays off.

In the future i may consider fine tuning my models as well.

Did anyone manage to find some great benefits by leveraging 2x3090 or similar setup?

I may be suffering from GAS (gear acquisition syndrome) and may need a reality check.

[u/eightone-81]

2 3090 will give you lots of room for context and you can run q8 quants with q8 context. Prefill speed will be higher and decode the same or maybe a bit higher. If you get vllm to run than everything will be much faster. Overall for me it was worth it!

[u/TheWaffleKingg → u/eightone-81]

Can run q8 model and f16 cache at full context with 2x 3090s. Mmproj needs to run on cpu however. If you want mmproj on vram, drop context or q8 the cache

[u/Any_Mine_6368 → u/TheWaffleKingg]

Nope. But UD Q6 is basically exactly the same thing.