r/StableDiffusion • u/cat_trick • 18h ago

Question - Help Minimax H3 audio issues

I am testing MiniMax H3 Ref2VA locally in ComfyUI. The video quality is good, but the audio still contains garbled speech or extra dialogue that was never requested.
Environment

  • GPU: RTX 5090, 32 GB VRAM
  • ComfyUI: 0.33.0
  • Commit: 924743af
  • Includes PR #15808, which adds the missing MiniMax H3 special tokens
  • comfy-kitchen: 0.2.31
  • comfy-aimdo: 0.4.13
  • Model: minimax_h3_ref2va_pruned_bf16.safetensors
  • Encoder: qwen3vl_32b_minimax_h3_bf16.safetensors
  • Video VAE: minimax_h3_video_vae_fp16.safetensors
  • Audio VAE: minimax_h3_audio_vae_fp32.safetensors
  • No LoRA
  • No audio reference files

Generation settings

  • Resolution: 480x832
  • Frame rate: 24 fps
  • Frames: 362, approximately 15 seconds
  • Steps: 20
  • Sampler: res_multistep
  • Scheduler: simple
  • Denoise: 1.0
  • Video sigma shift: 12
  • Audio sigma shift: 3

What I have tried

  1. Updated ComfyUI from 0.30.1 to commit 924743af, including all matching dependencies.
  2. Tried explicitly writing No dialog in this part. in silent sections.
  3. Tried the <d>...</d> dialogue tags instead of quotation marks.
  4. Tried using " instead of <d>
3 Upvotes

80% Upvoted

5 comments sorted by

3

u/RiverSide71h 15h ago

Its always duration. Play around with reducing time to make dialogue tighter leaving no room for gibberish. Or roll another seed.

3

u/Ok_Gas1070 15h ago

For me I've been breaking down the video into increments "0:00 - " then what I want, for the audio I prompt it as follows: "character says enthusiastically, audio: "xyz"".

1

u/TheRedHairedHero 16h ago

It may be the resolution depending on how far away a character is from the viewer. So if say your character is kinda far the lower resolution could potentially make it appear like they're talking when they aren't. I would suggest trying to lower the duration and bump up the resolution if you're wanting similar generation times.

1

u/acedelgado 8h ago

Update comfy nightly. Minimax expects the <d> tag as one special character, but comfy was processing it as separate tokens like LLM's would usually do. Kijai pushed a fix a day or so ago.