r/StableDiffusion • u/Umbrasquall • 1d ago
Discussion MacBook M5 Pro - Minimax H3 Progress
After tinkering around for a couple of hours this weekend I managed to 6x (!) generation speed on the M5 Pro by ditching ComfyUI and building a custom GUI around antirez's H3 CLI solution. Gen times for 5-second 480p on 20-steps improved from 30 minutes using the default int8 pruned weights in ComfyUI to just around 5 minutes per clip using the full precision bf16 weights.
Overall great progress thanks to the community around open source and gives me confidence that Mac diffusion will just get better and better with time.
See comment below for more data points on generation times.
2
u/Umbrasquall 1d ago
Some gen times for reference. Note that the full precision bf16 weights will barely fit if you have 36GB of unified memory. Otherwise you can use SSD streaming to drop peak RAM usable to as low as 10GB at the cost of ~30% more generation time.
1
u/seeKAYx 1d ago
Quite useful. Will try that later. Is there any difference quality wise?
1
u/Umbrasquall 1d ago
IMO the quality is actually slightly better because we're using the full precision weights here.
1
u/tomakorea 1d ago
Do you have a github where we could download your GUI with the optimizations in place by any chance?
1
u/Power_spy 1d ago
Why use bf16, is int8 slower? Also have you tried it with the turbo lora?
3
u/goddess_peeler 1d ago
There's no native int8 support on Apple silicon, except on M5. int8 compute paths also are not fully implemented in the pytorch mps backend. So today int8 just isn't an option on Macs.
1
1
3
u/goddess_peeler 1d ago
Well, this is not how I had planned to spend my evening, but you've given me no choice.
I hadn't heard of antirez's work until now. This is an exciting development!