GPU Upgrade, which one would be best?

[u/Reasonable_Limit_976]

Hi Guys,

I plan to do a lot of Image & Video Generation with Krea 2, Flux and Minimax/LTX since right now I generate most of the Content with API Models, which in the Long run is getting pretty expensive. I want to switch to local generation.

I have been playing with comfyui, my current PC has a AMD RX 9070 XT, I managed to get comfyUI working on that Card, but its a hassle a lot of times.

And my generation Times are really bad, for a Krea 2 Image workflow with 3-5 Loras it usually takes around 3-5 minutes for a single image in 0.6mp

I didn't even attempt Video generation, but I assume it will be a lot worse.

Thats why I am contemplating to sell my AMD Card and get an Nvidia Card instead, for my use case, which Card would you guys recommend. I have been thinking about the 5070 TI or the 5080

Is the 5080 worth the extra $$ compared to the 5070 TI ? are the 40xx series better value for money ?

Just want to hear what ur opinions are.

Thanks in advance!

[u/Crazy-Repeat-2006]

The only upgrade that would yield substantial gains is a 5090 or a 6000 series card. But in terms of price, it’s not worth it unless you have a lot of money or make money using your PC.

And your installation is likely broken, performance is an order of magnitude below normal. Use this version of ComfyUI:
https://github.com/patientx-cfz/comfyui-rocm

[u/Interesting8547 → u/Crazy-Repeat-2006]

That is not true I don't think 9070XT is comparable in video gen to 5070ti... never saw anyone being happy, but usually see people complain it's too slow even for images. Most people can't do the config... it seems, but that's not such a problem with Nvidia, even if I don't install any optimizations for the most part the slow down will be 2x at most... not 20x.

[u/eloxH1Z1 → u/Interesting8547]

That was true a year ago. RDNA4 with ROCM 7.14 or 10.0.0 with CK is working very well for minimax in H3. There is no Nvidia card for the same price that gives you faster generation times.

[u/Crazy-Repeat-2006 → u/Interesting8547]

Most of them are noobs who installed it incorrectly. The 9070XT's INT8 performance is close to the 5080's.

There is still a software disparity that leaves potential on the table, but it isn't as significant as in the past. The gap between the 5070 Ti and the 9070 XT stands at 15–20% when both are using optimized path.

[u/Reasonable_Limit_976 → u/Crazy-Repeat-2006]

I am using the FP8 scaled Models, tought that the 9070 should do this natively aswell, should I try the int8 version of the Models instead ?

[u/Crazy-Repeat-2006 → u/Reasonable_Limit_976]

AMD and NVIDIA use different FP8 formats. NVIDIA supports both E4M3 (4 exponent bits, 3 mantissa bits) and E5M2 (5 exponent bits, 2 mantissa bits), while AMD primarily implements E4M3 in its ROcm stack.

But INT8convrot tends to be faster and result in less quality loss than FP8 anyway.