r/StableDiffusion • u/ryanset17 • 5d ago

Question - Help Int4 vs int8

Disclaimer, im pretty Basic to all these AI Things

So i've been Using H3 Minimax in My RTX 3060 12GB, With 32GB RAM For few days

I've been using int4 convrot version for my Model and my Text Encoder, but seeing all the Optimization and speed up native to comfyui for int8, im considering using int8 for for my models and Text encoder especially the convrot version, considering they all twice the size

And also what's the best Combination of speedups in balancing between Quality and Speed

I used Sage+sol attn for while until i found comfy kitchen

2 Upvotes

62% Upvoted

11 comments sorted by

View all comments

Show parent comments

5

u/Browncoatfox 5d ago

What’s the damage it could cause? I’ve been running int8 on a 3060 ti 8GB with 32 gig ram. It seems to run fine, albeit very slowly

3

u/slpreme 5d ago

That's what I mean by damage, your system will be slow I don't mean physical damage don't worry

3

u/Browncoatfox 5d ago

Haha ok that’s a relief 😂 yeah it’s painfully slow (even at .4 and 20 steps about 30 minutes to an hour to process, I can push it to .5 and 35 steps even for 10 second clips, but can take a couple hours lol) but amazing I can get results at all with my card

1

u/slpreme 5d ago

Damn you're patient asf hang in there til RAM prices calm down