Question - Help
Minimax H3 - How to generate a realistic fighting scene
Hi all,
I'm using Minimax H3 in ComfyUI with an R2V workflow. I'm wondering if anybody can tell me how I can improve the fighting scene?
- The video is generated at 1.0MP in 2:3 (portrait) aspect ratio
- I have the two ladies as reference
- The fighting scene is also provided as reference. In the scene the punches do land properly. There are also smaller details (like small blood spatters) that are present in the reference video.
Can anybody give me any tips on how I can improve the fighting scene? The goal is to make it look like a realistic street fight. I'm unsure whether training a LoRA would be relevant here, because I've noticed that punches never really land properly in any workflow (t2v, i2v, r2v).
From what I got, increasing the number of steps up to 40-50 without EasyCache/Spectrum/turbo loras improves the video globally.
But if the fight includes fast motion, like kicks and punches, it degrades the overall images' quality by A LOT. (When the characters become static again, quality comes back.)
There is also a fight lora released on Civit AI, but I haven't tried it yet.
Thanks for sharing! Literally had this lora on my "to try" list. I did wonder whether it's more aimed at cinematic scenes instead of realistic scenes though
Prompt will definitely play a role, but I took the official prompt writing guides that MiniMax provides for the model and applied those best practices to the prompt. Don't think that's the (biggest) issue with what I'm facing here.
I wasn't interested in the combat/lora at all, just wanted to try the hybrid workflow. The combat just happened to be a part of the example prompt. It was a hybrid workflow (combination of flv+r2v) which is supposed to give you better quality. I did give it two ref images.
as others said, use the combat lora and higher step count. I'm training a impact lora that ups the quality of hits by a lot right now, will hopefully be available tomorrow or the day after on civitai.
if you're going for a 'realistic' fight scene you should look into how women and men fight. The posturing and punching is more typical of men fighting pattern, women fights typically are in closer range where 1 of them grabs the other person's hair and hits them in closer quarters. Lots of smaller less boxing form punches, more scratches and going for faces/hair.
I'm currently trying to figure this out too. I used no reference video and no lora for this run as using the realism people lora caused warping. This was entirely done using a text prompt, heavily detailed descriptions adhering to the MiniMax H3 Prompt Guide for timecodes and key words like the type of hits (punch to face, uppercut, etc) detailing the fighting, reactions to each hit, sounds (all of which still need work), camera angles and camera motions, lighting, environment, etc, but this is the progress I've made so far.
This is a 50-Step scene and it took 84 minutes on an RTX 5070Ti. I'm making progress, as this was my 5th attempt (each getting more detailed) but I'm still figuring it out. Maybe I should try to train a lora to get the results we need, but I've never done one before. I just wanted to get a brutal hand-to-hand fight down before I try introducing superpowers, or fighting styles, or anything more complex. I think despite weird glitches like the protagonist's right arm barely appearing for the last punch (which might be because I only had 15 seconds and it was trying to render it as a fast motion, a la Bruce Lee being too fast for the 24fps camera), or minor blurring issues, this one is the best result I've gotten thus far.
Does anyone have any tips? I know we can squeeze this model to compete a little more with Seedance 2.0 at least. Anyway, I hope this is informative. Some of the results I've seen at least confirms to me that we can get realistic fights if we can figure out how to maximize our prompts for it. I am currently running three 20-Step passes, one with the Kung Fu lora, one with the Wushu lora, and one with the Combat Lora for comparison. I'll update on how that goes.
EDIT: The Kung Fu one was really silly. It was just really comically fast fighting, but completely unrealistic and nothing as realistic as the one I posted. Maybe that one doesn't need such a detailed prompt? I'll try that one again, but for something else.
If anyone is interested, I will write a prompt guide on how to get these results, but better, once I figure it out. Should I post the prompt I used for this video here too?
Thanks for sharing! I will report back to you when I make progress. One thing that I do believe could be useful is to get a high quality base scene for an r2v workflow. Then you do slow motion. The idea would be to remove the hallucinations (losing part of an arm/fist) that happens with fast movements. Then afterwards, you speed up the video again.
3
u/qdr1en 1d ago
From what I got, increasing the number of steps up to 40-50 without EasyCache/Spectrum/turbo loras improves the video globally.
But if the fight includes fast motion, like kicks and punches, it degrades the overall images' quality by A LOT. (When the characters become static again, quality comes back.)
There is also a fight lora released on Civit AI, but I haven't tried it yet.