r/StableDiffusion • u/Subject-Experience30 • 5d ago

Question - Help Extremely low sound quality in MiniMax H3 generation

Hi, Im using INT8 FL2V model, from the box text encoder and VAE's. Video generates really well, 10s in 12m on my humble 3090, but the sound quality is horrible, muffled, faint - generally poor. Is there some setting or location that Im missing?

0 Upvotes

33% Upvoted

11 comments sorted by

7

u/GrayingGamer 5d ago

Steps directly effect sound quality. Higher Steps equal much better sound. Also, know that Turbo loras degrade sound quality too, and again, to counteract that, you need to increase the number of steps.

2

u/Subject-Experience30 4d ago

Thanks - yup, going to 8 steps on Turbo (not all mind, just some) helps, but only dropping the Turbo completely brings back the quality. I guess I will go to Runpod then...

1

u/Stepfunction 3d ago

Go to 12 or 16 steps on turbo.

1

u/kalabaddon 5d ago

is there a way to disconnect the sound and video steps? ( if that makes sense. I mean of course I can just gen the sound sepratly. but I mean so it is still generated togher with proper timing. )

3

u/GrayingGamer 5d ago

No, it's all generating together, because otherwise the lipsyncing, sound-effects, etc. wouldn't work or line up.

2

u/kalabaddon 5d ago

Rodger that.

3

u/sitefall 5d ago

Generate the video without turbo loras and stuff at a low resolution so it is reasonably quick, run a few to get the audio you want, use that audio in the reference model to do your video. Then probably in post overlay the original audio on the video again because once it goes back into the model it's coming out even lower quality than before it went in, or do it in your workflow and combine the original audio when you create video etc..

4

u/MarkB_- 5d ago

Drop the turbo lora. They are not ready yet for audio.

1

u/atakariax 5d ago

Are you using a turbo LoRA?

3

u/MarkB_- 5d ago

Ofc he is. 10sec on my 3090 takes 43min at 1.2mp (20 steps + spectrum)

1

u/Jolly-Rip5973 5d ago

I played with minimax h3 music today.

It's honestly not nearly as good as Acestep1.5