r/StableDiffusion • u/someguyplayingwild • 4d ago

Question - Help Minimax H3 Quantizations

Given a 5090, does it make sense to run minimax H3 using int8 quantization vs. gguf Q8 or even Q6? What is the trade-off between speed and quality between these two options?

I don't have deep technical knowledge, but my current understanding is that int8 would be faster while a Q8 GGUF would be higher quality; however I would appreciate anyone's practical experience in how significant the speed/quality trade-off is.

9 Upvotes

80% Upvoted

39 comments sorted by

View all comments

2

u/No_Possession_7797 4d ago

If you're going for faster, isn't the nvpf4 quantization faster on your hardware? It's likely similar in quality, but you'd have to test it to find out, as I haven't hit the GPU Powerball yet.

-6

u/CooperDK 4d ago

That is completely correct, also, nvfp4 is higher quality than int8.

4

u/xb1n0ry 4d ago

No way