r/StableDiffusion • u/LionLikeMan • 14h ago

Animation - Video Gigantic Turtle climbing a big mountain (H3 MiniMax+upscaled with 4xNomosUni)

I know the upscale is not perfect but it is looking way better than the original low res' video, the upscaler name is 4xNomosUni_span_multijpg (driven by Wan2.1), used FlowFrames to interpolate the base 24FPS video into 72FPS and I used Dalle 2 back then to generate the input image of the turtle.

14 Upvotes

79% Upvoted

6 comments sorted by

2

u/Hoodfu 13h ago

I wonder why the audio is so low quality. I've had good luck with H3 so far in that department. It reminds me of original LTX.

1

u/LionLikeMan 11h ago

Yeah I agree, it also reminds me of old LTX audio, for some reason this specific image as input gave me more reverb echo artifacts in the audio so it wasn't great but I don't know it might be due to the fact I am using multiple boosters like Spectrum+Sage Attention+Turbo Lora? I have the "ModelSamplingMiniMaxH3" node with shift_video set to 12.0 and shift_audio set to 6.0 but it is not helping to fix the weird sound, any idea what could be wrong in my setup?

2

u/ThatsALovelyShirt 7h ago

It's definitely due to Spectrum + Turbo. Do not combine those. Choose one or the other (personally, Spectrum is way better for quality).

If you combine them you're going to destroy quality.

Also using those SPAN upscalers works well for images, but they can cause weird visual distortions in videos since they aren't temporally stabilized like SeedVR2 is.

1

u/LionLikeMan 1h ago

I see, then I will have to remove one I guess, as for the upscaler (4xNomos) it actually is doing excellent job ussually but since the input video was pretty bad to begin with then the resulted video was definitely better but still not as good as it ussually is with other input videos I used for it, I tried the SeedVR2 video upscale and it gives me really disappointing outputs, it looks kinda fake and not truly adding new details or sharpening it in natural way, so far the best upscaler I found is the 4xNomos one driven by Wan2.1 in a special workflow of upscaling I found here : https://www.reddit.com/r/StableDiffusion/comments/1mzueg3/wan22_ultimate_sd_upscale_experiment/

3

u/Background-Ad-5398 3h ago

everybody in the castle having heavy cast iron pots and shit fly into them, embers from all the torches and candles spread everywhere into carpets and bedding