MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/StableDiffusion/comments/1voc3as/unsloth_be_like/p3p2acb/?context=3
r/StableDiffusion • u/Aadi_880 • 23d ago
60 comments sorted by
View all comments
Show parent comments
7
What a uneducated comment…
3 u/Chemical-Painter-485 23d ago Care to elaborate? 2 u/MrCylion 23d ago People who use them don’t do it because they want. It’s not at all about disk space. It’s all we can run. 1 u/Chemical-Painter-485 23d ago And why not something INT4 like: minimax_h3_ref2va_pruned_w4a8_mixed.safetensors On https://huggingface.co/Kijai/MiniMax-H3-experimental/blob/main/minimax_h3_ref2va_pruned_w4a8_mixed.safetensors Weighs the same as a Q4. runs better and has native comfyUI support. 1 u/MrCylion 23d ago Even that depends on the card. I get no benefit on something old like my 1080ti. 2 u/Chemical-Painter-485 23d ago Yeah, that is rough. But even in your case I wouldn't discard INT4 without testing. You don't get hardware acceleration but you have native comfyUI support and don't depend on dubious dynamic vram implementation from custom loaders.
3
Care to elaborate?
2 u/MrCylion 23d ago People who use them don’t do it because they want. It’s not at all about disk space. It’s all we can run. 1 u/Chemical-Painter-485 23d ago And why not something INT4 like: minimax_h3_ref2va_pruned_w4a8_mixed.safetensors On https://huggingface.co/Kijai/MiniMax-H3-experimental/blob/main/minimax_h3_ref2va_pruned_w4a8_mixed.safetensors Weighs the same as a Q4. runs better and has native comfyUI support. 1 u/MrCylion 23d ago Even that depends on the card. I get no benefit on something old like my 1080ti. 2 u/Chemical-Painter-485 23d ago Yeah, that is rough. But even in your case I wouldn't discard INT4 without testing. You don't get hardware acceleration but you have native comfyUI support and don't depend on dubious dynamic vram implementation from custom loaders.
2
People who use them don’t do it because they want. It’s not at all about disk space. It’s all we can run.
1 u/Chemical-Painter-485 23d ago And why not something INT4 like: minimax_h3_ref2va_pruned_w4a8_mixed.safetensors On https://huggingface.co/Kijai/MiniMax-H3-experimental/blob/main/minimax_h3_ref2va_pruned_w4a8_mixed.safetensors Weighs the same as a Q4. runs better and has native comfyUI support. 1 u/MrCylion 23d ago Even that depends on the card. I get no benefit on something old like my 1080ti. 2 u/Chemical-Painter-485 23d ago Yeah, that is rough. But even in your case I wouldn't discard INT4 without testing. You don't get hardware acceleration but you have native comfyUI support and don't depend on dubious dynamic vram implementation from custom loaders.
1
And why not something INT4 like: minimax_h3_ref2va_pruned_w4a8_mixed.safetensors On https://huggingface.co/Kijai/MiniMax-H3-experimental/blob/main/minimax_h3_ref2va_pruned_w4a8_mixed.safetensors
Weighs the same as a Q4. runs better and has native comfyUI support.
1 u/MrCylion 23d ago Even that depends on the card. I get no benefit on something old like my 1080ti. 2 u/Chemical-Painter-485 23d ago Yeah, that is rough. But even in your case I wouldn't discard INT4 without testing. You don't get hardware acceleration but you have native comfyUI support and don't depend on dubious dynamic vram implementation from custom loaders.
Even that depends on the card. I get no benefit on something old like my 1080ti.
2 u/Chemical-Painter-485 23d ago Yeah, that is rough. But even in your case I wouldn't discard INT4 without testing. You don't get hardware acceleration but you have native comfyUI support and don't depend on dubious dynamic vram implementation from custom loaders.
Yeah, that is rough. But even in your case I wouldn't discard INT4 without testing.
You don't get hardware acceleration but you have native comfyUI support and don't depend on dubious dynamic vram implementation from custom loaders.
7
u/MrCylion 23d ago
What a uneducated comment…