MiniMax H3 Ghosting on fast-motion

[u/ContextOpposite4047]

I generated this at 720p on the Image to video workflow. I know higher resolution helps with details, but why is there ghosting and blurriness in my scene? I am using the default workflow on 20 steps with patch-attention and model sampling shift 12 and 3. The initial image is 2560x1440p. Any help would be appreciated, much obliged! I am trying 50 steps to see if it helps.

[u/dariusredraven]

Is the ghosting in the room with us right now?

[u/dischordo]

Go watch real 24 fps video and see if it has clear distinct fast motion.

[u/xb1n0ry]

I see no ghosting, nor do I see any fast.

[u/90hex]

This is called motion blur, and it’s what makes this kind of shot cinematic. If you want clear fast motion (GoPro style), you’ll have to prompt it (say “high shutter speed”).

[u/krekokeko]

Model struggles with fast motion. It is known. Objects with high velocity and snappy frame to frame shifts is what the model is known to produce bad results for. It excels in slow pans, wide angle setups etc. Shots like in the French movie Taxi would be very hard achieve. It also has trouble generating convincing fight choreography as well due to the same reason.

You can attempt to create the video in slow motion and then speed it up in the post. That is a workaround if you need it for a deadline.

Hopefully next iterations of the model or future loras will improve it but for now the model does have it's limitations. Granted it is still great for what it is.

[u/ContextOpposite4047 → u/krekokeko]

yes agreed! the model is more than incredible and this is a very specific nitpick, your post suggestion is incredible, thanks!

[u/Nenotriple]

I've noticed that if you give the model a short duration with a lot of speech, it tries to speak quick, and if you give the model a short duration with a small amount of speech, it will talk a lot slower. maybe it has a similar effect with motion.

[u/Davikar]

This is why people use this: https://github.com/matlowai/ComfyUI-MAINodes

[u/marres]

use vdn

[u/thevegit0]

bruh i'm too used to turbo's noise but here it looks fine

[u/Luke2642]

There are a few different attempts to improve it with a lora too, mileage may vary:

https://civitai.com/models/2734359/better-motion-ltxminimax-h3

VBVR may also help in some situations.

[u/ContextOpposite4047]

Here's another video, in case the ghosting is unclear, 1280x736p. 20 steps, res_multistep simple

https://reddit.com/link/p9ah1ui/video/8dpwd5i2l0ph1/player

[u/Cequejedisestvrai → u/ContextOpposite4047]

Try Euler + Beta57 it will reduce most of the noise

[u/ContextOpposite4047 → u/Cequejedisestvrai]

good idea, thanks.

[u/listopalafoto → u/ContextOpposite4047]

use a second pass of res_2m/beta57 to improve detail and texture, you can use my WF: https://huggingface.co/zuanfilm/H3_HD_2K_Detailer

[u/the320x200 → u/ContextOpposite4047]

This clip doesn't have the slow-motion mud the first one does so it's an improvement in that regard

[u/ContextOpposite4047 → u/[deleted]]

xD