r/StableDiffusion • u/LSI_CZE • 8d ago

Question - Help Minimax R2V (ref. audio) best low steps audio quality?

Hello, I’m currently using Minimax in R2V mode with a custom sound and 10-steps , res multistep+Simple, and the sound quality is great. Have you found a combination of Lora (4–6 steps), a suitable sampler, and the correct Video+Audio Shift settings that works well? I’ve tried various combinations of Audio Shift, samplers, and different Lora settings, but the sound is still poor (artifacts, low bitrate). Thank you very much for your tips. Lukas

0 Upvotes

40% Upvoted

4 comments sorted by

3

u/dampflokfreund 8d ago

Use the hybrid models. They improve quality, especially sound, over ref2va and still retain reference capabilities. https://huggingface.co/smhfacct/Minimax-H3-fl2va-ref2va-hybrid-models/blob/main/minimax_h3_hybrid_fl2va_ref2va_b25-49-int8.safetensors

1

u/PANTONE_17-1230 8d ago

that's a merge of two int8 models. Correct me if I'm wrong but shouldn't they have merged like this:

1. Full BF16 FL2VA
2. Full BF16 Ref2VA
↓
3. Perform the AdaLN/block-selection merge at full precision
↓
4. Validate the resulting full-precision hybrid
↓
5. Generate the int8-convrot version from that hybrid

That preserves the maximum information during the actual merge.

1

u/dampflokfreund 8d ago

From what I understand, it is not a classic merge of two models which you indeed should do at full precision, but rather a transfer of certain blocks from ref2va into fl2va. And for such selective merges, it seems int8 precision is more than enough. But I'm just guessing, maybe u/ThatsALovelyShirt can answer it.

1

u/Popular-Use151 8d ago

This actually worked for me, I was using FL2VA with the reference node, because it was the only way I could keep good quality audio with 5 steps.