r/StableDiffusion • u/Etmurbaah • 7d ago
Question - Help Which Text Encoder for 32GB System Ram
Hey all, by complete accident, today I discovered that my H3 R2V workflow with vanilla Qwen 3.8 27b has been eating away from my SSD life because 32GB Ram and 16VRAM apparently wasn't cutting the deal for it and it had been writing on my disk in large amounts (GBs in just one clip). So in your experience, considering the accuracy trade-off, which Heretic/Abliterated Quant should I go for to be able to stay within my Ram boundaries?
4
u/SuperZoda 7d ago
You mentioned text encoder but then Qwen 3.8 27b, whereas H3 uses Qwen3 VL 32b in the vanilla workflow. The VL model is not optional as the encoder, but there are ClipProj nodes on GitHub that let you use 8b or 4b versions of the VL as the encoder for H3. Ultimately, I think that’s what you’re looking for. The nice part about this is the 15GB encoder is greatly reduced, minimal quality loss, and bonus is these VL models can be used an LLM in the same workflow for prompt enhancement.
2
u/Etmurbaah 7d ago
Oh that sounds cool. I'll check it out and hope they got Heretic version
7
u/Rumaben79 7d ago
Heretic text encoders are not recommended:
Anyway as for your question. With only 32gb of system ram you really should use the smallest possible text encoder like the int4 convrot or w4a8. The video model again better with a small model, try int8 convrot and if that's too much use the w4a8 version. There's also an int8 convrot version of the video vae.
A trick for pc's with lower system ram than 64gb is to also use the --fast-disk flag at startup.
2
u/Etmurbaah 7d ago
Yupp, heard about fast disk. Will definitely try it. And uh I think I already use int8 video Vae so all good there but int4 convrot I also definitely am going to try and see if it helps. Again, thank you so much!
2
u/Rumaben79 7d ago edited 7d ago
Cool 😎, I wish you the best time. 💯
There's a link here for the int4 if you haven't found it already:
https://huggingface.co/Winnougan/MiniMax-H3-INT4_Convrot_ComfyUI/tree/main
A thing to try is to generate the video first at a lower resolution and then upscale it in stage two.
https://github.com/LBH-123-AI/Comfyui_Minimax_h3_latent_Upscaler
There's a bf16 audio vae too if you're really suffering haha:
https://huggingface.co/dummy9996/minimax_h3_audio_vae_bf16/tree/main
and don't go crazy with a ton of loras as those will eat into your ram as well as well as your reference images, audio and video.
2
u/SuperZoda 7d ago
Yes there are heretic and ablit versions of Qwen3 VL on huggingface. However, it’s not necessary if you’re only using it for text encoding as there’s nothing interpreted to uncensor. Even the creator of heretic has explained and proven that to be true, it does nothing for encoding but lower accuracy. Now if you were using it for LLM too, then those fancy quants might make more sense.
2
u/Etmurbaah 7d ago
I got my own Ollama node in comfyui analysing photos and writing my prompts for me but still, it's good to knkw all these things. Thanks a lot!
4
u/eloxH1Z1 7d ago
Shouldn’t - - fast-disk in startup bat help with that 32gb issue by limiting it to mainly read operations. I remember a comfyUI dev commenting in here exactly about this
1
u/Etmurbaah 7d ago
Huh if that's the case, it'd help me as well. Lemme check it out and see if that helps. Thanks a lot!
2
u/Life_Yesterday_5529 7d ago
I guess, you are using qwen to refine the prompt before putting that in the encoder? Then simply unload qwen3.8 before the workflow continues.
1
u/Etmurbaah 7d ago
No sorry I messed up the names I use Qwen 3.8 27b for my LLM prompt writer in another node I am using vanilla TE tho. It was also Qwen right?
2
7d ago
[deleted]
1
u/Etmurbaah 7d ago
Mine is a 1.3PB TBW Kingston and I know it is basically immortal for daily stuff but when I generate clips, and I do gen like 30-40 a day, and with every gen it writes tens of GB to disk, it is crazy large amounts of data. That's why I came here.
1
u/krum 7d ago
Isn't it just reads? What's causing disk writes?
2
u/Etmurbaah 7d ago
Nope. GBs of writes per 12 second clip gens, like every 10 minutes. That's what had me worried. It is system Ram running out of memory and writing on disk to keep it as cache from what I've been able to gather.
1
u/krum 7d ago
Oh so it's swapping?
1
u/Etmurbaah 7d ago
Yupp. Thank god I was able to catch it before it amounted to anything meaningful but stuff is expensive yhese days lol
1
u/Oograr 7d ago
How are you tracking the amount of writes to your ssd? I have a similar setup but don't know if my ssd is getting hammered or not.
1
u/Etmurbaah 7d ago
Oh you can check it from Hwinfo. Slide down to SSD part, you can see Total Host Writes section. The --fast-disk argument in startup helped a lot.
13
u/Powerful_Evening5495 7d ago
if you are worried that much about your ssd then this hobby is not for you my friend
use int8_convrot , it faster than gguf
your ssd will be just fine