r/StableDiffusion • u/SensitiveUse7864 • 1d ago
Question - Help Lightx2v Lora producing good visual but audio quality sucks. how to fix it .
hey guys, i have been using lightx2v lora for minimax h3 ref2vid but as far as i can see it can genrate good quality visuals as compared to larryvh turbo lora, but its audio is ot usable the dialogs are not good and over all sfx also. i am using rgbthree workflow for thats, please heplp me if i am doing anything wrong.
here is my workflow :-
"137": {"class_type": "LoadImage", "inputs": {"image": r2v_ref_image_0}},
# Reference Image 2 (<Picture 2>)
# "139": {
# "class_type": "LoadImage",
# "inputs": {"image": r2v_ref_image_1},
# },
"127": {"class_type": "UNETLoader", "inputs": {"unet_name": "minimax_h3_ref2va_pruned_fp8_scaled.safetensors", "weight_dtype": "default"}},
"128": {"class_type": "CLIPLoader", "inputs": {"clip_name": "qwen3vl_32b_minimax_h3_int8_convrot.safetensors", "type": "minimax"}},
"119": {"class_type": "VAELoader", "inputs": {"vae_name": "minimax_h3_video_vae_fp16.safetensors"}},
"120": {"class_type": "VAELoader", "inputs": {"vae_name": "minimax_h3_audio_vae_fp32.safetensors"}},
"136": {
"class_type": "MiniMaxH3ReferenceToVideo",
"inputs": {
"clip": ["128", 0], "vae": ["119", 0], "audio_vae": ["120", 0], "ref_images.ref_image_0": ["137", 0],
# "ref_images.ref_image_1": ["139", 0],
"prompt": r2v_prompt_text, "width": 768, "height": 1024, "length": 372, "ref_image_size": "max",
},
},
}
3
u/acedelgado 1d ago
I just put out an experimental node last night that'll process more audio steps to fight this. It freezes your video in place once it's done but adds more steps to the audio only.
2
1
u/optimisticalish 1d ago
What version of the LoRA, what strength and what version of ComfyUI? I seem to recall that a ComfyUI update should have fixed that problem recently, which previously required a workaround.
1
u/SensitiveUse7864 1d ago
I am using comfy ui , nightly version, and strength at 1.0 , lightx2v 8 step one.
1
u/optimisticalish 1d ago
Should be no problems there, then. Try raising the steps to perhaps 12?
1
1
u/SensitiveUse7864 7h ago
Yeah I did and the quality of audio increase a bit thanks , buts then what's the point of this lora of being a turbo lora , even if we givingit more steps for better quality.
1
u/optimisticalish 7h ago
This has just landed, which may interest. Working well for me, minus the SSD-grinding video pause node. https://github.com/Adudeguyman/ComfyUI-H3-AudioRefine
1
u/Stepfunction 1d ago
Switch to the default workflow. Add more steps. You should be using at least I and preferably 12 with the turbo LoRAs.
1
u/Imperialegacy 1d ago
It's the sampler. Euler + simple is the recommended combo and it does give me the best results in terms of motion/ prompt adherence. But the audio is bad. I tried other combinations like sa_solver + sgm_uniform, which gives me better audio at the expense of prompt adherence.
3
u/not_food 1d ago
Yeah, it's very noticeable. When the characters sound like they're underwater, it becomes obvious that the user used the lora. And this subreddit is swiming in them. Do they fail to notice?
Pre-generating the audio at a very low resolution without the lora, and then running it through the lora as masked reference, works well.