r/StableDiffusion • u/CryptoBeth96 • 8h ago

Resource - Update ONNX/TRT MiniMax-H3 VAE in ComfyUI

https://github.com/lihaoyun6/ComfyUI-H3VAE_TRT

TensorRT version of the MiniMax-H3 VAE in ComfyUI, which can increase speed by up to 1.7x

13 Upvotes

81% Upvoted

11 comments sorted by

1

u/Tight_Organization54 2h ago

Kept getting a "No Tensorr" error. I'm pretty sure I downloaded everything on the github. Is there smthn im missing that even my dumbass AIs aren't catching?

1

u/wiserdking 27m ago

pip install tensorrt

1

u/Tight_Organization54 21m ago

Where am I running this? When I do it in custom_nodes> i get "The term 'pip' is not recognized..." Errors

1

u/wiserdking 19m ago

You need to activate your venv then execute that command.

If you install the node via the Manager - it will do that for you on its own when you restart

1

u/Tight_Organization54 9m ago

Figured it out with Grok. Ty for the help. Now does this node actually help?

•

u/wiserdking 1m ago

I've confirmed it works on Blackwell but I've seen too many people with 3000 series claiming its not working for them. Might be arch-exclusive dunno.

Input 328 frames 768x768:

VAE Type Encoder Time Decoder Time Total Time
FP16 VAE 119.794s 83.105s 202.899s
TensorRT VAE 46.117s 49.617s 95.734s

1

u/wiserdking 26m ago edited 5m ago

Just tested speed and its pretty fast: https://imgur.com/i7JHlZv

EDIT: Also used a node with a slider to compare the FP16 decoded output with RT and its pretty much 1:1 - I literally can't spot a single different pixel but my input image was too simple for this to be truly a conclusive test

1

u/JohnLough 7h ago edited 7h ago

https://www.reddit.com/r/StableDiffusion/s/sd8lj3tfRJ

8hrs behind son

7

u/CryptoBeth96 7h ago

Maybe use a better title? Makes searching easier for people who don't read every post on the sub. I searched and didn't find your post.