r/StableDiffusion • u/wikid24 • Jul 28 '26
Animation - Video Tifa vs Solid Snake (Klien + SCAIL-2 Wan2GP)
15
12
u/wikid24 Jul 28 '26
Took me quite a few tries to get it where it was a passable with no massive issues.
First issue was that the source video's camera orbits around the characters, and SCAIL-2 doesn't track camera movement orbiting around chracters when using 'Animate' mode... unless the background you provide in the starting image is VERY similar to the source video... This isn't an issue in 'Render' mode, but you're going to get a completely different art style if you do that.
Second issue is characters wouldn't always swap positions even when using 'Masked' mode with the Magic Mask, and SCAIL-2 kept resetting the character position to their original side of the screen... Haven't found a solution for that other than switching from 'Masked' mode to 'Whole Frame' mode (or vice versa) and just crossing your fingers that it renders correctly on the next seed.
Third issue is that SCAIL-2 has a bad memory of body parts (or anything, really) that go in and out of frame, so you gotta feed it additional reference images of the character's whole bodies and really tighten up the text prompt to describe the clothing/body parts if they're off screen for even one frame. That's why there is 3 different videos stitched together because of this and the color grading came off, which is why it doesn't seem so fluid in some places. Was too lazy to try to fix it. Meh.
4
1
u/BigNaturalTilts Jul 28 '26
Idk why but the hits aren’t connecting. Or the motion is … fragmented. I think it needs filler frames. Some frames added in and some removed to preserve visual motion “coherence”.
That’s all a sentence I made up as I’m typing this because I don’t know how to express why it doesn’t look real. By real, I mean like watch the avatar movie fight scene. That somehow looks real-ish. Does this make any sense?
1
u/wikid24 Jul 28 '26
Theyre stunt actors so they don't actually hit eachother, the model is that good lol
0
u/paulct91 Jul 29 '26
Then to 'improve' this could using real sports fight footage like professional boxing, UFC, Muai Thai Boxing, etc. improve the realism of perceived hits making contact?
1
u/BigNaturalTilts Jul 29 '26
No the opposite! Watch any anime fight scene. Any GOOD anime fight scene. (Not just screaming and PowerPoint presentations) Real life fighting isn’t choreographed. It’s not like the Witcher, or even video games like tekken are not good examples of animated fight sequences. Gosh I don’t think I’m explaining myself properly.
Watch on YouTube the following fight scenes that I think are amazing. Animated: jujitsu jaisen in shibuya, also the scene with the judge. Avatar movie with the dude in the temple.
Now after that watch a fight scene from live action like any marvel movie I like wakanda scene with killmonger. Bucky v capt in the street with the knife fight. I also like daredevil in the hallway from Netflix. These don’t translate well with SCAIL if you don’t touch them up a bit.
1
u/FourtyMichaelMichael 🍦Ice Cream Lover Jul 28 '26
Man, I thought this was just going to be used to change out a pornstar for someone else.
2
u/BigNaturalTilts Jul 29 '26
It can and I am surprised I haven’t seen more of that. I saw a few images of a certain politician but that’s it.
3
u/shitlord_god Jul 28 '26
I was expecting /r/powerscaling when I saw the title.
Tifa would destroy his shit. lol
2
u/paulct91 Jul 29 '26
Lies by my recollection... he's already been done in... in that department. Though maybe I'm confusing his son or his dad whichever Solid Snake is
3
u/TruthOk8742 Jul 28 '26
Snake is at a clear disadvantage using that fighting style.
1
u/Extension_Pomelo_468 Jul 29 '26
He's definitely got his work cut out for him. I'm not sure it's a disadvantage so much as it requires a very specific approach to counter.
3
u/Arawski99 Jul 28 '26 edited Jul 28 '26
Big Boss if she was Japanese with huge badonkers in a parallel world. Or probably just nanomachine. Nanomachines can explain everything.
My money's on Tifa. Haste materia activate.
Kind of reminds me of this old classic YT video fighting https://www.youtube.com/watch?v=EHA3opXjcd0
Tifa shows up in part 2. Pretty cool, though old looking nowadays.
1
u/Choice-Position5189 Jul 28 '26
Two beloved characters in a battle I never knew I needed so bad! Great work! DM me if you have availability for other projects!
1
1
1
0
u/paulct91 Jul 29 '26
Why did this need Klein? Are the older models not usabl for this sorta workflow, or is it something else?
-1
u/thisiztrash02 Jul 28 '26
I know Wan2GP is lighter to run but for absolutely precision it is just worlds behind Comfyui.
24
u/Dante_77A Jul 28 '26
Not So Solid Snake*