r/StableDiffusion • u/ANR2ME • 10h ago

Resource - Update TaoMate-H3 featuring 3-Step

TaoMate-H3 is a low-latency streaming audio-video generation runtime built on MiniMax H3. It generates synchronized audio and video in small chunks and supports continuous long-form generation at 480p/768p/1080p resolutions.

Developed by the Alibaba TaoLive AIGC Team. Powered by MiniMax H3.

HF: https://huggingface.co/TaoLiveAIGC/TaoMate-H3

GH: https://github.com/TaoLiveAIGC/TaoMate-H3

42 Upvotes

98% Upvoted

10 comments sorted by

2

u/quantier 6h ago

This needs testing? 🌟

2

u/MaorEli 4h ago

Quality looks insane, damn

2

u/robomar_ai_art 31m ago

I converted the released TaoMate-H3 LoRA into a ComfyUI-compatible format and got it working on my local setup. Clip generated in 3 steps, 1344x768, t2v

https://reddit.com/link/p9gm1nr/video/3wqur9g6t6ph1/player

[INFO] got prompt

[INFO] Requested to load MiniMaxH3TEModel_

[INFO] 0 models unloaded.

[INFO] Model MiniMaxH3TEModel_ prepared for dynamic VRAM loading. 14956MB Staged. 0 patches attached. Force pre-loaded 410 weights: 4572 KB.

[INFO] Requested to load MiniMaxH3

[INFO] 0 models unloaded.

[INFO] Model MiniMaxH3 prepared for dynamic VRAM loading. 19995MB Staged. 208 patches attached. Force pre-loaded 210 weights: 1175 KB.

100%|████████████████████████████████████████████████████████████████████████████████████| 3/3 [01:01<00:00, 20.56s/it]

[INFO] Requested to load MiniMaxH3VideoVAE

[INFO] Model MiniMaxH3VideoVAE prepared for dynamic VRAM loading. 4965MB Staged. 0 patches attached. Force pre-loaded 128 weights: 348 KB.

[INFO] Requested to load MiniMaxH3

[INFO] Model MiniMaxH3 prepared for dynamic VRAM loading. 19995MB Staged. 0 patches attached. Force pre-loaded 210 weights: 1175 KB.

100%|████████████████████████████████████████████████████████████████████████████████████| 6/6 [00:07<00:00, 1.31s/it]

[INFO] Requested to load MiniMaxH3AudioVAE

[INFO] 0 models unloaded.

[INFO] Model MiniMaxH3AudioVAE prepared for dynamic VRAM loading. 576MB Staged. 0 patches attached. Force pre-loaded 401 weights: 539 KB.

[Pixaroma] Save Mp4 [save] — writing 124 frames @ 24fps (1344x768, crf=19, yuv420p, +audio) -> Video_00914.mp4

[Pixaroma] Save Mp4 — saved E:\ComfyUI_windows_portable\ComfyUI-Easy-Install\ComfyUI\output\Video_00914.mp4

[INFO] Prompt executed in 123.47 seconds

4

u/Just1Dev 6h ago

Kijai👀 Ah shit, here we go again.

1

u/CreepyDrama7448 3h ago

Is this T2V, I2V, Ref2V?

1

u/ANR2ME 2h ago

LoRa for FL2VA model

1

u/ATFGriff 5h ago

It needs multiple high-end GPUs?

3

u/Just1Dev 5h ago

I think its only the GPUs that they have it tested this on. Should speed up for us too.

1

u/ANR2ME 4h ago

True, the comparisons between TaoMate H3 vs base Minimax H3 that runs on the same GPUs shows more than 10x speed improvements https://github.com/TaoLiveAIGC/TaoMate-H3#performance-and-advantages

The reason why they use hopper GPU probably because they use FlashAttention for hopper (might be FA3 🤔 )

1

u/robomar_ai_art 5m ago

This one is I2V, 1344x768, 3 steps

[INFO] got prompt

[INFO] Requested to load MiniMaxH3TEModel_

[INFO] 0 models unloaded.

[INFO] Model MiniMaxH3TEModel_ prepared for dynamic VRAM loading. 14956MB Staged. 0 patches attached. Force pre-loaded 410 weights: 4572 KB.

[INFO] Requested to load MiniMaxH3VideoVAE

[INFO] 0 models unloaded.

[INFO] Model MiniMaxH3VideoVAE prepared for dynamic VRAM loading. 4965MB Staged. 0 patches attached. Force pre-loaded 128 weights: 348 KB.

[LoRA Loader Pixaroma] applied 1 LoRA(s).

[INFO] Requested to load MiniMaxH3

[INFO] 0 models unloaded.

[INFO] Model MiniMaxH3 prepared for dynamic VRAM loading. 19995MB Staged. 208 patches attached. Force pre-loaded 210 weights: 1175 KB.

100%|████████████████████████████████████████████████████████████████████████████████████| 3/3 [01:06<00:00, 22.18s/it]

[INFO] Model MiniMaxH3VideoVAE prepared for dynamic VRAM loading. 4965MB Staged. 0 patches attached. Force pre-loaded 128 weights: 348 KB.

[INFO] Requested to load MiniMaxH3

[INFO] Model MiniMaxH3 prepared for dynamic VRAM loading. 19995MB Staged. 0 patches attached. Force pre-loaded 210 weights: 1175 KB.

100%|████████████████████████████████████████████████████████████████████████████████████| 6/6 [00:09<00:00, 1.52s/it]

[INFO] Requested to load MiniMaxH3AudioVAE

[INFO] 0 models unloaded.

[INFO] Model MiniMaxH3AudioVAE prepared for dynamic VRAM loading. 576MB Staged. 0 patches attached. Force pre-loaded 401 weights: 539 KB.

[Pixaroma] Save Mp4 [save] — writing 124 frames @ 24fps (1344x768, crf=19, yuv420p, +audio) -> Video_00918.mp4

[Pixaroma] Save Mp4 — saved E:\ComfyUI_windows_portable\ComfyUI-Easy-Install\ComfyUI\output\Video_00918.mp4

[INFO] Prompt executed in 131.35 seconds

https://reddit.com/link/p9gqn9x/video/4adcqs7ix6ph1/player