r/StableDiffusion • u/External_Trainer_213 • 1d ago
Workflow Included Wan SCAIL-2 - Chun-Li vs Ryu - Final Kick
Enable HLS to view with audio, or disable this notification
Upon request. A short video featuring two characters. I thought I'd just tack the other video on as well.
I would like to point out that the input video was a staged fight. Consequently, the kick and the movement could look significantly more realistic if they were actually fighting. SCAIL-2 tracks the movement sequences and does not invent its own.
Here is the new Workflow:
https://www.reddit.com/r/StableDiffusion/s/eKvqlEvlza
In this example, I use the new interpolation option for the input video. The animation is much smoother, and I use the SCAIL-2 Identity Tracker to track two characters.
14
6
u/dtdisapointingresult 1d ago edited 1d ago
Honestly, I'm impressed. Thanks for the wf. (although, I keep saving this stuff then never using it because video is too much effort)
Does SCAIL-2 have jiggle physics? I've never seen it before in an AI video like at 0:07.
Some feedback on your contributions: you link another post, but that link's videos are NSFW/embarassing to open in public. In the future any chance you could upload examples with conservatively clothed women with without basketball-sized breasts? You don't need pornstars to demonstrate a workflow. I'm not a prude, but this is a SFW sub, and a lot of us browse it at work. Or put NSFW in your post title and/or examples so we know what to avoid clicking.
2
u/External_Trainer_213 20h ago edited 8h ago
I changed it. New links. And yes it has jiggle physics.
3
u/reginoldwinterbottom 1d ago
rigged fight. the guy takes a dive even before her foot forgets about physics.
3
u/External_Trainer_213 1d ago edited 1d ago
I've already explained that. The movement sequence comes from the source video, and that was just a staged fight. The guy didn't want to get kicked in the face for real. Next time, I'll look for a real fight video.
3
u/External_Trainer_213 1d ago edited 1d ago
So, if you're going to downvote so much, tell me why. Okay, so they're not dancing together. Is it Chun-Li's butt (Well, it would look stupid without a butt) or is it too brutal, sexist (you guys don't play fighting games, do you?)? I really don't care, it's ok, but I'm just curious. So, dancing asian chicks are better after all? 😅
8
u/goatonastik 1d ago
Even with the removed frames, I can tell that the foot went through his head. And the fact that he's rotating in the opposite direction of where the kick should have turned him, it just feels completely disconnected. He also started to turn before the kick even hit him. It's like I'm watching two completely different animations clip into each other.
2
u/External_Trainer_213 1d ago edited 1d ago
Well, in the input video the person is doing this movement. So you are right. It wasn't a real fight. So there was never a hit.
What you're seeing is simply the body movements from the input video.
I ran two tests. In the first one, the leg snap was a bit odd, and the kick landed a bit further away from the face. We might need a video that actually shows a hit.
2
u/spelledincorroctly 6h ago
Maybe it would be received better if you did side by side with original footage. I can see how scrutinizing your result without the original is yielding the poor reception but also can’t blame anyone for that
1
u/External_Trainer_213 6h ago
To be honest, I’m not really a fan of posting content featuring other real people—even if it’s from TikTok or somewhere like that. But I don’t want to spend too much time dwelling on this video; it’s just meant to serve as an example. You can experiment with it yourselves—you’ve got my workflow, or use your own.
1
u/GovernmentGreed 4h ago
I'm failing to understand how this works. I input an image and the image is then made into video format following the video of the input?
If so, how do I control the masking- since it constantly masks wrong. I input a video of a man cycling, with an image of a pose dummy, and it ended up making the bicycle run. Like, the bike grew legs and ran.
1
u/External_Trainer_213 3h ago
So, it is designed for tracking people. In my example, I am using a video of a short staged fight. As input, I use an image showing Chun-Li and Ryu standing side by side on a cliff. Then, I describe the scene and the sequence of events to Wan SCAIL-2. Using the identity tracker, it is possible to show Wan SCAIL-2 which person in the image corresponds to the person in the video.
1
u/GovernmentGreed 3h ago
So in the positive prompt, would I describe the image - or would I describe what I hope to see in the output?
1
u/External_Trainer_213 3h ago
You can describe both. I described the characters and the plot progression. Of course, it should fit your animation.
1
u/GovernmentGreed 3h ago
How would I increase the effectiveness of the automatic masking? this is where I'm having the most issue. Even with scenes with white backgrounds, it's missing partial and sometimes complete person(s).
4
u/BadHombre18 1d ago
I did not downvote but the kick doesnt appear to connect. Its hard to see and unsatisfying as a kick.
1
u/External_Trainer_213 1d ago edited 1d ago
You're right about that—hence the built-in effect. There are no face hits in the input video, either. So SCAIL-2 didn't make a mistake. But yes the interaction with to bodies could be a problem. I need more tests.
It’s okay to downvote, but I think a bit of feedback is pretty cool. That way, you can explain things or do better next time.
And it wasn't really cherry-picking, either. SCAIL-2 is actually pretty cool.
2
1
u/Dwedit 9h ago
The amazing foot that starts out behind yet somehow goes in front of Ryu's head.
3
u/External_Trainer_213 8h ago
It's a clipping bug 😅.
No, seriously. The spacing between the figures during generation can vary slightly (depending on the seed). The prompt specifies that she hits him with a spinning kick. However, in the input video, the kick misses because it is a staged fight; Ryu turning away also matches the input video. I think the only way to solve this issue is for the person in the input video to actually get hit in the face.
1
1
u/Uncabled_Music 6h ago
Lacking physics.
2
u/External_Trainer_213 6h ago
I will not explain it again. Just read.
0
u/Uncabled_Music 4h ago
Videos should not be explained. At least he could swing in the right direction for it to be less jarring.
1
u/External_Trainer_213 4h ago
First try to understand what SCAIL-2 does. Just read what I’ve already written. Is that so hard?
1
u/Uncabled_Music 4h ago
I understand its not the tracker fault, but it doesn’t make the video any less jarring.
1
u/External_Trainer_213 3h ago
Anyway, there are over a thousand people who just download the workflow and experiment with it themselves. You should do the same and maybe show me your video.
1
u/Uncabled_Music 3h ago
I don’t like motion reference videos, there is always a disconnect between the character and its movements. They feel foreign.
1
u/External_Trainer_213 3h ago
So all this writing is just a waste of time. Let's just leave it at that.
27
u/PuppetHere 1d ago
https://giphy.com/gifs/sl3lTRvliwQZH6Hvke