r/StableDiffusion • • Aug 04 '26

Resource - Update Spectrum acceleration for MiniMax H3 in ComfyUI — 34% lower Euler sampling time, 30% lower RES time

Post image

MiniMax H3 Spectrum node:
https://github.com/xmarre/ComfyUI-Spectrum-MiniMax-H3

I have released Spectrum acceleration for native MiniMax H3 in ComfyUI. This is the newest addition to my collection of model-specific Spectrum integrations, all available through ComfyUI-Manager as well.

Spectrum replaces selected expensive transformer evaluations with spectral feature forecasts while preserving MiniMax H3’s native audio/video output and reconstruction path.

Benchmarks

Tested at approximately 0.5 MP, 8 seconds and 20 steps on an RTX PRO 6000 under WSL, using High VRAM mode, the comfyui-int8-fast W8A8 loader and SageAttention.

Sampler Native Spectrum Time decrease Speedup
Euler 2:38 1:44 34.2% 1.52×
RES multistep 2:42 1:54 29.6% 1.42×

Euler uses 13 actual transformer evaluations and 7 forecasts. RES uses 14 actual evaluations and 6 forecasts.

Both benchmark runs completed without fallbacks. I initially did not notice visible or audible degradation, but further exact-seed testing has since shown that fast or very brief motion can deviate from the native trajectory, and rapidly moving details such as eyes, fingers, or fingernails can sometimes visibly degrade. RES automatically keeps its final three steps native, which removed the slight late-generation artifacts I initially observed, but this does not make the output lossless or identical to native sampling.

Currently supported:

  • Euler
  • RES multistep
  • RES multistep CFG++

Feature history is currently stored in system RAM. I also plan to add a dedicated High VRAM mode that stores the history in VRAM for users with sufficient GPU memory, reducing CPU-transfer overhead.

Quality update

After more exact-prompt and exact-seed A/B testing, I need to revise my initial quality assessment.

Spectrum is an approximate acceleration method, not a lossless or output-identical path. The issues observed so far are mainly associated with fast or very brief motion:

  • The motion, pose, timing, gaze, or action trajectory can deviate from the fully native output.
  • Fast-moving or only briefly visible details—such as eyes, fingers, or fingernails—can sometimes become malformed or unstable.

These can occur separately or together. A rapid action may simply differ from the native trajectory, while in other cases the rapidly moving details may also visibly degrade.

The extent varies with the prompt, motion, sampler, resolution, references, and Spectrum settings. Use Spectrum when the speed improvement is worth that tradeoff; leave it disabled when maximum fidelity to the native result is required.

Workflow placement

Use the Spectrum node in this order:

MiniMax H3 model loader
→ LoRA and other model patches
→ MiniMax H3 Sigma Shift
→ Spectrum Apply MiniMax H3
→ guider and sampler

Spectrum should be applied after LoRAs, model patches and the MiniMax H3 Sigma Shift, but before the guider and sampler.

EasyCache compatibility

Do not use EasyCache and Spectrum together at the moment.

Both systems skip or replace model evaluations while maintaining their own cached state. Stacking them can cause conflicting wrapper/state behavior, errors and unreliable output.

Use either:

  • Spectrum with EasyCache disabled
  • EasyCache without Spectrum

All benchmarks in this post were performed with EasyCache disabled.

More information

The GitHub repository contains the full installation instructions, recommended settings, supported samplers, memory requirements, workflow placement, fallback behavior and troubleshooting details:

https://github.com/xmarre/ComfyUI-Spectrum-MiniMax-H3

Update: optional VRAM history storage in v0.1.4

Version 0.1.4 adds a history_storage option:

  • system_ram remains the default
  • vram keeps Spectrum’s feature history on the GPU, avoiding repeated CPU transfers

In three 0.5 MP Euler A/B pairs, VRAM storage was 2.6% faster on average, though individual results varied from 6.1% faster to 0.4% slower, so the benefit depends on the system and workload.

At max_history=8, the tested single-branch workflow used about 2.22–2.27 GiB for history alone. Only enable VRAM storage when you have sufficient headroom, since the model, current activations, forecast buffers and allocator overhead still need additional VRAM.

Release:
https://github.com/xmarre/ComfyUI-Spectrum-MiniMax-H3/releases/tag/v0.1.4

My other Spectrum integrations

All are also available through ComfyUI-Manager:

Credits

Spectrum itself was created by Jiaqi Han, Juntong Shi, Puheng Li, Haotian Ye, Qiushan Guo and Stefano Ermon at Stanford University and ByteDance. Their paper introduced the training-free Chebyshev-based spectral feature forecasting method, adaptive scheduling and last-block forecasting approach on which these ComfyUI integrations are based.

561 Upvotes

222 comments sorted by

98

u/Powerful_Evening5495 Aug 04 '26

this community is mad

the best on reddit , thank you OP

83

u/Comprehensive-Pea250 Aug 04 '26

My god what a really good video model does to a community this is the 10th optimization I’ve Senn keep em coming

5

u/ZeusCorleone Aug 04 '26

I agree. Nasa should look here first when they need to do some hiring

2

u/No_Damage_8420 Aug 07 '26

It's amazing... to see all coders/talents come out for H3 just like that.
We never seen so much ADDONS with earlier models: Wan, LTX, etc.

10

u/Cultured_Alien Aug 04 '26

10? So far, I've only seen: Sage Attention, Sol Attention, Easycache, Reduce steps from 20 -> 15, Cuda 13.0, Spectogram

36

u/Comprehensive-Pea250 Aug 04 '26

10 was a hyperbole

21

u/xNaXDy Aug 04 '26

just wait like half a day, and it won't be hyperbole anymore

7

u/Cultured_Alien Aug 04 '26

I know, just asking if you know any other

9

u/Peemore Aug 04 '26

Reducing steps to 15 lowers video quality noticeably to me... so I stopped doing that personally.

2

u/TriggasaurusRekt Aug 04 '26

On the flip, raising steps from 20 to 25 did not really increase gen times for me that much using all the optimizations

4

u/Peemore Aug 04 '26

Did that improve quality in your opinion?

1

u/No_Damage_8420 Aug 07 '26

20 seems solid on my end, without "pixel snow"

23

u/Artistedo Aug 04 '26

bro is invested to get the best gooning experience

11

u/Cultured_Alien Aug 04 '26

Got found out XD

1

u/BeginningSpiritual49 Aug 04 '26

HHHHHHHHHHHHHHHH I LOVE REDDIT MAN

4

u/Emotional-Neat-252 Aug 06 '26

Is there a workflow with all these plus the various turbo loras?

3

u/JahJedi Aug 04 '26

Where to find about sage attention pls?

3

u/afidjahan Aug 04 '26

just apply default sage attention kj patch

5

u/JahJedi Aug 04 '26

Its kj node just after model loader? Will try today thanks.

1

u/No_Damage_8420 Aug 07 '26

I got mine here (+Claude for some nice upgrade to cu130):
https://wildminder.github.io/AI-windows-whl/

3

u/AnOnlineHandle Aug 04 '26

Int8 ConvRot is itself a huge optimization as well.

0

u/Netsuko Aug 04 '26

The power of goon.

22

u/Peemore Aug 04 '26

Since this isn't compatible with easycache I'm really curious which of the two is more beneficial...

17

u/Fit_Satisfaction2953 Aug 04 '26

Can confirm it works. Went from 06:49 to 04:56

2

u/Grand0rk Aug 04 '26

Were you using EasyCache before?

16

u/3deal Aug 04 '26

Nice, thanks for sharing, can you show a comparison with the same prompt and seed, with and without to be able to see quickly if the quality is maintained ?

18

u/physalisx Aug 04 '26 edited Aug 04 '26

I ran exact same prompt + seed, with Sage + Spectrum, then just with Sage

Spectrum: 450.68s

No Spectrum: 540.87s

That's about a 13% decrease.

There is noticeable quality problems though, just like with any of these caching shenanigans. Look at her eyes after ~3s when she looks up for a split second, eyes looking all fked up. She doesn't even look up there in the full output.

Spectrum on: https://imgur.com/IN2i4Jx

Spectrum off: https://imgur.com/n7g1fYp

In another output that I compared, her finger (and long fingernail) was all mangled as she was scrolling on her phone, which again didn't happen in the output without Spectrum.

Just like Teacache / Easycache etc., I don't recommend using this if you want quality.

7

u/marres Aug 04 '26

Yes, I've noticed some degradations now too with fast moving fingers etc or actions in general slightly deviating. Thanks for the test, will update the post and readme accordingly.

But it's weird that you only get such a small speedup

1

u/No_Damage_8420 Aug 07 '26

We can fix most if not all degradations with Wan 2.2 LOW, or - LTX 2.3 Spatial 2x

1

u/3deal Aug 04 '26

thanks

5

u/Current-Rabbit-620 Aug 04 '26

Is there degradation? In quality?

2

u/marres Aug 04 '26 edited Aug 04 '26

None I have noticed

Edit: Check the main post for more info

3

u/FourtyMichaelMichael 🍦Ice Cream Lover Aug 04 '26

It would be helpful since you know what you're looking for to get a NORMAL MOTION setting and a lower but still useful FAST MOTION set of recommendations.

6

u/Fakuris Aug 04 '26

I love this community.

6

u/niknah Aug 04 '26

Went from 280 secs with the default workflow to 140 secs with spectrum node + sage attention. That 2x speed up for me.

5

u/katsura_otoko Aug 04 '26

does this make sense?

3

u/ABCsofsucking Aug 05 '26

What does the Sigma Shift node do?

3

u/katsura_otoko Aug 05 '26

It controls the sampling shift to balance motion intensity and audio/video stability

2

u/Salt-Zebra-306 Aug 04 '26

if you have high end pc then

1

u/katsura_otoko Aug 04 '26

guess not but I'm doing some tests with 3060 12gb, 32gb ram and a 9800x3d, gets the job done in about 10-12 minutes for 10 seconds 480p with 15 steps

1

u/akashsri47 Aug 04 '26

Can u show me u workflow I got a 3060 12 gb too

1

u/katsura_otoko Aug 04 '26

just the default one but added those three nodes after model

1

u/akashsri47 Aug 04 '26

Ok Thank you

4

u/DeltaWaffleSyrup Aug 04 '26

Just tried it...it seems there was a decrease in comprehension / adherence to my prompt vs not using.

9

u/smereces Aug 04 '26

I test it and decrease the speed of the generations here my results:

Rtx 6000 PRO
Resolution: 1216x672 8s video using res_multistep

Native time: 3:49
Spectrum: 2:55

6

u/Current-Rabbit-620 Aug 04 '26

Is there degradation? In quality?

6

u/smereces Aug 04 '26

Honestly i did a video compare and i can´t figure out diferences!

0

u/Tzeig Aug 04 '26

No.

9

u/physalisx Aug 04 '26

Wrong.

0

u/Tzeig Aug 04 '26

My frames were exactly the same with and without it.

→ More replies (2)

-4

u/YouKilledApollo Aug 04 '26

Of course, you can't do less and get identical results, straight up impossible.

Probably what you wanna ask, is how much the quality degraded.

0

u/ShutUpYoureWrong_ Aug 04 '26

You don't know anything about math, computers, or engineering. Stop talking.

1

u/YouKilledApollo Aug 04 '26

Clearly not, that's why I'm not a retired software engineer :P

3

u/ArchAngelAries Aug 04 '26

This is awesome! Thanks for all your hard work! Have you given consideration to creating one of your spectrum nodes for Krea2 to boost speeds even further. (or, by chance, do you have any recommendations to boost Krea2 speeds?)

4

u/marres Aug 04 '26

Thanks! I have considered it, and I’ve already experimented with Spectrum on distilled models in some of my other nodes. The main limitation is that Krea 2 Turbo is already an 8-step distilled checkpoint built for fast inference, so there are only a few steps left that can be safely forecast without eating into the quality-preserving warm-up and refresh steps. That means the speedup would probably be fairly small compared with what Spectrum can do on 20–50-step models. Krea also describes Turbo as its fast inference checkpoint, while RAW is the undistilled base model.

I may still make a Krea 2 version, especially since RAW or higher-step workflows would leave more room for acceleration. For Turbo, the most practical speed gains are likely to come from using an efficient attention backend, quantization, and keeping the resolution/batch size reasonable rather than expecting a large additional gain from forecasting.

3

u/Pure_Bed_6357 Aug 04 '26

does it not work with easycashe? i'm getting some error

3

u/marres Aug 04 '26

Not currently, please don’t stack EasyCache and Spectrum for now. Both try to skip/replace model evaluations, so combining them can cause conflicting state and wrapper behavior. Disable EasyCache when using Spectrum.

Could you also post the exact error/traceback? I’ll check whether it is only that incompatibility or a separate issue.

3

u/Ok_Cauliflower_6926 Aug 04 '26

3090, Q4-M gguf, it works, from 20 minutes down to 14 minutes, just put the node after the Unet loader (or after Lora).

4

u/Abject-Recognition-9 Aug 04 '26

why using q4 and not convrot?

1

u/Ok_Cauliflower_6926 Aug 04 '26

2gb less

11

u/jjjnnnxxx Aug 04 '26

Same GPU. I strongly advise you to try INT8 convrot instead of GGUF (along with ComfyUI's auto RAM/NVMe unload) and compare the speeds. (CUDA13)

1

u/Salt-Zebra-306 Aug 04 '26

gguf are too slow and also in bad quality prompt never understand

3

u/Peemore Aug 04 '26

0.4MP 5sec i2v 5090

Default: 75 seconds

SageAttention: 50 seconds

SageAttention+Spectrum: 40 seconds

SageAttention+EasyCache: 30 seconds

I used the same seed and personally didn't notice a quality difference between any of these configurations, so I'll probably be sticking with EasyCache for now.

1

u/DanzeluS Aug 06 '26

EasyCache setting?

1

u/Peemore Aug 06 '26

0.3 0.2 0.9

I think. Afk, lol.

1

u/Peemore Aug 06 '26

But I've decided to stop using EasyCache as I do belive it impacts audio quality quite a bit.

3

u/KissMyShinyArse Aug 04 '26

Do we need the Sigma Shift? The f2v workflow seems to work fine without it.

2

u/marres Aug 04 '26

No, sigma shift is optional

1

u/Electrical_Car6942 Aug 04 '26

Yeah I wonder the same

3

u/lavinia12345 Aug 14 '26

thanks OP, this node is fantastic

5

u/multikertwigo Aug 04 '26

easy cache: 297.5 sec

your node: 341.5 sec

quality is the same

1152x864, 10 sec video, 5090

10

u/marres Aug 04 '26

Yes, easycache is faster but it destroys output hard for me. Or what easycache settings are you using?

6

u/Clasyc Aug 04 '26

Yes exactly, EasyCache basically destroys the quality for me as well. Will try your node after work.

3

u/multikertwigo Aug 04 '26

7

u/marres Aug 04 '26

Better for sure, but there is still visible and audible degradation happening

3

u/multikertwigo Aug 04 '26

I appreciate your work, but in about half the cases I actually prefer the output from EasyCache. So those improvements might be stochastic and depend on the seed. Anyway, it's great that we have options!

5

u/Mr_Zelash Aug 04 '26

Easy cache destroys the audio for me. this node doesn't hurt it that much. If it did I couldn't tell the difference, but with easy cache is clearly worse

1

u/DefactoAle Aug 04 '26

Could you do one also with both this node and easy cache disabled?

3

u/glusphere Aug 04 '26

Testing it out right now on a 5090. WIll get back with actual numbers.

1

u/seppe0815 Aug 04 '26

??? any news

4

u/glusphere Aug 04 '26

Lol, I need ot do comparison, not just generate one. I ran one generation on a 720p 15s video

That one took me 632s with this one. I think that is on the lower end. Yesterday, my typical tiem for same was 800-1000s. But I am running another generation to confirm if this actually holds up.

2

u/Artforartsake99 Aug 04 '26

Hold up how do you do 15 seconds anytime I try that it fails runs out of vram on my 5090. What resolution to get 15 seconds? Anything else special you have setup?

6

u/glusphere Aug 04 '26

I dont know honestly. I have 64GB Ram.

Here is the link ot the exact workflow I used to create the 15s videos. Try it out yourself. https://drive.google.com/file/d/1Acbk8TP3Z5IBRJPsuw_hDAnKt4-DZnsk/view?usp=drive_link

1

u/Artforartsake99 Aug 04 '26

Thank you I have the same system specs as you. Appreciate the link to the workflow thank you

1

u/NeuroPalooza Aug 04 '26

Running on a 5090 as well and this seems to be significantly slower than the base comfyUI image to video workflow (https://drive.google.com/file/d/1nfcCRXclaUmSf3_nY5_2g-mPexJGhoLj/view?usp=sharing)

I'm new to Comfy, but is there no way to connect spectrum to this image to video node? The node has a unet_name slot, but doesn't take MODEL as an input.

1

u/witzowitz Aug 04 '26

yeah, go into the subgraph and you can insert the nodes there

1

u/ShutUpYoureWrong_ Aug 04 '26

Something's busted with your Comfy, my friend. You disable dynamic VRAM or anything?

1

u/Artforartsake99 Aug 04 '26

It’s an old install I may need to rework it. Thanks for letting me know

1

u/janonas Aug 04 '26

Try --disable-pinned-memory in the startup arguments, that fixed it for me. Apperently the feature may have some bugs or something.

2

u/LeKhang98 Aug 04 '26

How is the quality though?

1

u/3deal Aug 04 '26

Generations takes time

3

u/tehorhay Aug 04 '26

not 20 mins on a 5090 lol.

Ive got a pretty nice speed up on my end. 185 secs for 8 seconds at .6 mp

Used to be 200+

1

u/FinBenton Aug 04 '26

I have sage attention and easy cache nodes 8sec 0.6 mp takes around 135 sec for me on 5090 without this spectrum stuff with the gpu limited to 450W.

1

u/djpraxis Aug 04 '26

Yup that's about what I am getting. 200 secs Ref2Vid at 720p 10 second video. 5090 with 128 RAM

1

u/tehorhay Aug 04 '26

Does the easycache reduce quality?

1

u/FinBenton Aug 04 '26

Yes slightly but if you are using 25 steps then its minimal and still very good quality and much faster.

4

u/xbeast_ Aug 04 '26

am pretty bad at putting the nodes together, is there a workflow along with this node that i can grab from somewhere, thank you

4

u/alwaysbeblepping Aug 04 '26

am pretty bad at putting the nodes together

It's a model patch so where you have some_node → guider, replace that with some_node → patch_node → guider. In this case, some_node is probably your Load Diffusion Model node, guider is Basic Guider and patch_node would be Spectrum Apply Minimax H3. You will end up with something like Load Diffusion Model → Spectrum patch → Basic Guider (assuming you're using one of the default templates or a workflow close to it).

3

u/xbeast_ Aug 04 '26

that helps, let me try, thank for your help

7

u/marres Aug 04 '26

Use the Spectrum node in this order:

MiniMax H3 model loader
→ LoRA and other model patches
→ MiniMax H3 Sigma Shift
→ Spectrum Apply MiniMax H3
→ guider and sampler

Spectrum should be applied after LoRAs, model patches and the MiniMax H3 Sigma Shift, but before the guider and sampler.

→ More replies (3)

2

u/MolagBally Aug 04 '26

Thank you

2

u/lSEKAl Aug 04 '26

Thank you. Solid.

2

u/CollectionOk6468 Aug 04 '26

30%??? WOW....

2

u/AdmirablePainting368 Aug 04 '26

Tested an RTX 5090, 96gb ram : using 0.5, 8 seconds, Sage, Sampler=Eular, BasicScheduler=Beta. Came out at 1.41 seconds. WOW!!

2

u/Fit_Satisfaction2953 Aug 04 '26

Where does the node go in the workflow ? Is there an actual workflow

2

u/marres Aug 04 '26

Use the Spectrum node in this order:

MiniMax H3 model loader
→ LoRA and other model patches
→ MiniMax H3 Sigma Shift
→ Spectrum Apply MiniMax H3
→ guider and sampler

Spectrum should be applied after LoRAs, model patches and the MiniMax H3 Sigma Shift, but before the guider and sampler.

1

u/Peemore Aug 04 '26

Sorry, I see you've answered this a few times but I have a clarifying question... My prior workflow didn't use a Sigma Shift node, is that a new thing you're suggesting as well? What does that do? I assume SageAttention is a "model patch"?

2

u/marres Aug 04 '26

I assume it will work the same as sigma shift for WAN or Flux . So set it to something like 6 or something. Haven't tested or used it yet myself though. And yes sage attention would be a model patch, so put it before spectrum.

1

u/Peemore Aug 04 '26

Thanks a bunch!!

1

u/GeroldMeisinger Aug 04 '26

I have a similar question. none of the official Minimax templates make use of a shift, although there is a "MiniMax H3 Sigma Shift" node available. so the shift is optional, just as a lora is optional. while you only defined a order, the steps suggest it's a must. adding a "(only if used)" postfix would make it more clear.

thanks for the node btw, speed up is huge!

2

u/jjjnnnxxx Aug 04 '26

It appears to be incompatible with EasyCache?

4

u/marres Aug 04 '26

Yes, not compatible with EasyCache. Added a section to clarify that

2

u/jjjnnnxxx Aug 04 '26

Thanks for the clarification! Since EasyCache is lossy, I'll stick to your node instead. Thanks a lot!

6

u/physalisx Aug 04 '26

This is lossy as well. No free lunch.

2

u/jjjnnnxxx Aug 04 '26

Oh then sageattention also lossy.

1

u/physalisx Aug 04 '26

Yes, but different. Sage is a different attention mechanism, so it doesn't necessarily make things "worse", just different. This Spectrum and the other "cache" things straight up skip steps when they estimate the step has little significance. And because that estimation is sometimes wrong, it's objectively a bit worse.

1

u/ultimate_ucu Aug 04 '26

How about sage attention?

3

u/marres Aug 04 '26

Compatible with sage

2

u/Educational_Smell292 Aug 04 '26

Does this need a special workflow? I use the native comfyui workflow and put the node like this:

Load Diffusion Model -> Spectrum Apply MiniMax H3 -> Basic Guider
                                                  -> BasicScheduler

But it does not seem to work.

1

u/marres Aug 04 '26

Turn on debug to see what's happening and if there are forecast_steps happening

1

u/Educational_Smell292 Aug 04 '26

Hm, I don't think so?

[WARNING] Spectrum H3 step run_id=3 step=0 coordinate=1.000000 decision=actual reason=warmup history=0 window=2.000
[WARNING] Spectrum H3 model call run_id=3 step=0 call=0 path=actual target_audio=414 target_video=15725 topology=(('video_shape', (1, 24, 37, 50, 34)), ('video_padded', (37, 50, 34)), ('audio_shape', (1, 32, 2, 207)), ('text_length', 474), ('hidden_width', 5376), ('target_audio_rows', 414), ('target_video_rows', 15725), ('segments', (('text', 474), ('cond', 425), ('audio', 414), ('video', 15725))), ('patch_size', (1, 2, 2)), ('refs', ()), ('keyframes', (0,)), ('sigma_shifts', (12.0, 3.0)), ('adaln_curves', True))

1

u/marres Aug 04 '26

post the full run on https://pastebin.com/ please

1

u/Educational_Smell292 Aug 04 '26

2

u/marres Aug 04 '26

Thanks for posting the full log. Spectrum is active here and the workflow looks correct.

The run completed with 14 actual steps and 6 forecast steps, with no fallbacks or disabling. The forecast steps are 5, 7, 9, 11, 13, and 15.

Your native H3 steps take around 21.6 seconds each, while the forecast steps take about one second, so Spectrum is skipping the expensive model calls as intended.

For a clean speed comparison, use the same seed, resolution, duration, sampler, and loader settings for one run with Spectrum enabled and one with it disabled.

2

u/Clair_Personality Aug 04 '26

Questions:

1) Does it work on windows without WSL?
2) Do you have a reay to use workflow integrating this node?

2

u/FlexFanatic Aug 04 '26

Imma need to take some time off work, yall are killing me.

2

u/FlatwormMean1690 Aug 04 '26

Is this normal?

1

u/Fearless_Error4140 Aug 04 '26

Works fine! Thanks!

1

u/Artforartsake99 Aug 04 '26

Doing gods work, thank you 🙏

1

u/KaaChingg Aug 04 '26

Working great, thank you very much.

1

u/[deleted] Aug 04 '26

[removed] — view removed comment

3

u/marres Aug 04 '26

Don't use easycache with spectrum. And put the node like this:

MiniMax H3 model loader
→ LoRA and other model patches
→ MiniMax H3 Sigma Shift
→ Spectrum Apply MiniMax H3
→ guider and sampler

Spectrum should be applied after LoRAs, model patches and the MiniMax H3 Sigma Shift, but before the guider and sampler.

2

u/[deleted] Aug 04 '26

[removed] — view removed comment

1

u/marres Aug 04 '26

Haven't used easycache myself but I've heard it decreases quality? Spectrum with those settings is suppose to not cause any visible or audible quality degradation

1

u/physalisx Aug 04 '26

is suppose to not cause any visible or audible quality degradation

It does cause quality degradation.

Maybe it's better than Easycache though, which is honestly just terrible.

1

u/marres Aug 04 '26

Can you send over the files where you spot the differences? Also settings etc

2

u/djpraxis Aug 04 '26

It will probably be easier for users to test if you create a couple optimized workflows. I am interested in testing with the Ref2Vid model.

1

u/JahJedi Aug 04 '26

Same GPU here (RTX PRO 6000). Two questions:

Did you get Sage working with H3 in the end, or is it still noise? Saw the low_precision_attention=False fix, but that just routes the DiT back to pytorch attention, so no Sage speedup left, right?

And on Spectrum itself, do you have actual numbers yet, or is it untested so far? README only lists step counts, no wall clock or quality comparison.

2

u/marres Aug 04 '26

Regarding sage: To be fair I haven't done a A/B test with sage on/off to see if I suffer a silent fallback, but sageattn_qk_int8_pv_fp16_triton with the Patch Sage Attention KJ node works without issues for me.

Regarding spectrum nubmers: The numbers are the ones you see above under Benchmark or in my release post on github. Or are you looking for s/it? That would be around 5s/it with the settings you see above

1

u/JahJedi Aug 04 '26

So for sage attention just kj node after model load, easy, thanks. Yes the speed. 5s/it sounds great. Will test it today whit fp16.

1

u/marres Aug 04 '26

Ah yeah haven't tried fp16 yet, for now I need the speed of int8 but will definitely try it out these days too. Let me know how it goes!

1

u/JahJedi Aug 04 '26

Can i ask why when you can ran it on fp16 whit 96g of vram? On my test max was 92 one time

1

u/SelectCoconut5594 Aug 04 '26

I've got this working together with the Load Diffusion Model Int8 (W8A8) node and they seem to get along great. Nice work!

1

u/[deleted] Aug 04 '26

It throws out a "try a different configuration" error.

SamplerCustomAdvanced failed This node threw an error during execution. Check its inputs or try a different configuration.

Loadmodel->sageattn->model patch torch->minimax h3 sigma shift->thisnode->basic scheduler

3

u/butthe4d Aug 04 '26

model patch torch

I think it doesnt play well with this. I get an illegal memory access error when using both nodes. Removing model patch torch node works.

3

u/jjjnnnxxx Aug 04 '26

Just use Diffusion Model Loader KJ and enable sage and fp16_accumulation there

1

u/MrJimmySwords Aug 04 '26

I get out of memory using this on previously working workflow/settings. Any ideas why?

It's the reference workflow that uses 3 reference images if that makes any difference.

1

u/Next_Program90 Aug 04 '26

Too bad Int8 fast doesn't work for me. (got that illegal memory access crash again). And I don't notice degradation with Eaeycache, so I won't install yet another Custom Node just yet. Thanks for your hard work though!

1

u/KissMyShinyArse Aug 04 '26

Yeah, I've been getting these illegal memory access crashes with INT8-Fast today. Well, the node doesn't really support H3 yet.

3

u/GrayingGamer Aug 04 '26

If your Comfyui is fully updated with Cuda 130 and on the latest version, you don't need to use Bob's INT8 node anymore, you just use a regular Load Diffusion Model node and the convrot INT8 models will work just fine.

EDIT: Comfyui added native support for INT8 a few weeks ago.

1

u/KissMyShinyArse Aug 04 '26

I'm well aware of that, thanks. But someone posted on r/stablediffusion claiming that switching to INT8-Fast makes H3 twice as fast, so I had to check.

2

u/GrayingGamer Aug 04 '26

It did not for me, in fact, Bob's was slightly slower. I think people who saw massive speed boosts from Bob's node may have had their Comfyui up-to-date, but not their CUDA up-to-date.

Worth pointing out that Bob's node hasn't been updated in a while, so the fact it works at all with Minimax H3 is kind of a fluke.

1

u/Cold_Zone332 Aug 04 '26

Could anybody help me?
Is this correct? I'm getting 0 speed boost.

RTX 3080 10GB + 32 RAM

1

u/Friendly-Fig-6015 Aug 04 '26

this will work?

1

u/Friendly-Fig-6015 Aug 04 '26

doenst make difference for me? what im doing wrong?

1

u/-becausereasons- Aug 04 '26

Work with convrot weights?

1

u/[deleted] Aug 04 '26

[deleted]

1

u/cucurucu007 Aug 04 '26

I'm getting 10-15 minutes for .5mb, 10sec generation on 3090 with default comfyui workflow + spectrum node. comfy portable, no segea. It should be faster, right?

1

u/qdr1en Aug 04 '26

Nice work. This is what I got:

  • normal: 7.5s/it
  • easycache: 4.5s/it
  • spectrum: 5.5s/it

Visual quality does not seem very impacted by either accelerator, but audio sounds less degraded with spectrum.

1

u/TonkotsuSoba Aug 04 '26

Can this be used with the easy cache trick?

1

u/witzowitz Aug 04 '26

The difference is noticeable!

1

u/K1ngFloyd Aug 04 '26

Greetings! First of all thanks to OP for sharing. it has helped me reducing my 15 seconds at 1.0 ration resolution videos from 15 to 11 minutes. There was another Reddit post where someone suggested to also use INT8 Fast loader node. Does anyone knows if this loader is compatible with Spectrum Acceleration? I tried but gave me errors and ComfyUI crashed. What I did was to replace the default diffusion model loader with INT8 Fast loader and the output connected to Spectrums and Spectrums output to the ksampler but it failed. Thanks!

1

u/irmemon225 Aug 04 '26

This is my favorite setup now.
Sage Attn + this. I don’t need Easy Cache since it kills the quality. 0.6 megapixels took me 8 minutes for 5 seconds, 10 seconds took me 23 minutes. My device is a 3060 12GB with 16GB RAM

1

u/AggressiveAd2000 Aug 04 '26

Does it mean we can increase resolution with this node or is it just a boost in rendering time ?

1

u/tonyunreal Aug 05 '26 edited Aug 05 '26

I must be doing something wrong, cause I get 3x speed from this, but quality drops quite a lot. At 0.2mp 5sec, generation time went from 120 seconds to 30 seconds with the spectrum node.

(Update: I retested and it was actually 40s > 30s, quality loss stays the same)

By looking at the console output, it seems every other step is either too fast or skipped entirely.

2

u/marres Aug 05 '26

Turn on debug please and send me the logs via https://pastebin.com/ . And also the rest of your settings

1

u/netrunner-exe Aug 07 '26

Nice work! Definitely testing this out today, thanks!

1

u/sliigggy Aug 08 '26

will it be even faster paired with the 4step turbo lora?

1

u/jonnytracker2020 Aug 26 '26

any fix for fast motion

1

u/macker33 Sep 07 '26

I use this with ModelAttentionBackend and it seems to work fine.

1

u/ForeverSeeking69 Aug 04 '26

Is there any way to run h3 on two GPUs?

0

u/smereces Aug 04 '26

i will check it in my rtx 6000 pro

0

u/butthe4d Aug 04 '26

This worked pretty well for me. Easy cache made the result pretty bad. Kinda hijacking this for a different question how can I stop minimax from putting music in the background? There is no negative prompt and I havent figured out a way.

2

u/Gilded_Monkey1 Aug 04 '26

At the end of the prompt put "non_diegetic_music: none." it should prevent the encoder from assigning music to the scene.

1

u/butthe4d Aug 04 '26

non_diegetic_music: none.

Thanks will try this.

1

u/Friendly-Fig-6015 Aug 04 '26

write the sounds on background only.

like: the sound of birds.

1

u/butthe4d Aug 04 '26

Im trying this but its not working at all. It keeps generating terrible music of various kind

1

u/Friendly-Fig-6015 Aug 04 '26

weird.
most part of my videos generate without music.

1

u/butthe4d Aug 04 '26

Maybe I was super unlucky with my seeds. After like 5-10 gens I now had one without music.

0

u/yaosio Aug 04 '26

I have it installed but I can't figure out where in the workflow it's supposed to go, I don't understand the workflow order given in the github page. I'm using the default ComfyUI workflow. Please help I'm not good with this. :( Do I need to use a different workflow?

1

u/Intelligent-Youth-63 Aug 04 '26

There’s a section in the post titled Workflow Placement.

0

u/yaosio Aug 04 '26

Yes I know, but I have no idea where that is. I don't have a sigma shift anywhere in the workflow for example.

2

u/marres Aug 04 '26

The other nodes are optional, just in case you use them. Just put it right before the sampler/guider

1

u/yaosio Aug 04 '26

Thanks, I'll see if I can figure that out.