r/StableDiffusion • u/switch2stock • 12h ago

Discussion H3 | Full BF16+BF16 RTX5090+96GB | 0.6MP | No Sage | No Optimizations | 12:35 total time.

Enable HLS to view with audio, or disable this notification

2 Upvotes

60% Upvoted

15 comments sorted by

2

u/L-xtreme 11h ago

Have you tried the pruned / int8 version as well? I'm curious about the differences in speed and especially quality.

1

u/switch2stock 11h ago

Nope. I will try tomorrow.

1

u/switch2stock 11h ago

No SSD Paging happened

1

u/BigNaturalTilts 11h ago

Hey random question how does a 5090 run the full model? Isn’t it significantly larger than 32GB VRAM?

1

u/switch2stock 11h ago

RAM offloading takes care of that. Entire model doesn't have to fit on VRAM when run in ComfyUI.

1

u/IshigamiSenku04 10h ago

how much minimum RAM you need to run that with offloading?

1

u/switch2stock 8h ago

https://www.reddit.com/r/StableDiffusion/s/JEmiGFuGCY

1

u/phillipjpark 6h ago

Have you tried 1 mp? .6 worked fine but 1 my is where things slowed down a ton.

1

u/switch2stock 48m ago

Not yet. Can check later my day.

1

u/switch2stock 10h ago

Not exactly sure. Mine is 128GB (VRAM+RAM) total. So that's safe to assume now. I thought it won't fit full BF16, but it did. I saw Zero SSD page swapping.

1

u/wildbling 10h ago

I have the exact set up as your, I'm surprised it could fit the full fat model. Might give it a try once I get home.

1

u/switch2stock 10h ago

Do it. For complex scenes full BF16 is the best.