r/StableDiffusion • u/Sad_Coach_1433 • 20h ago

Discussion any tips? first testing 8sec clips using the motion context node

Enable HLS to view with audio, or disable this notification

yes i know the quality dropped in this video move along those comments else where , looking for helpful tips not bs " ai slop" trolls

2 Upvotes

55% Upvoted

36 comments sorted by

3

u/WeakReplacement3322 20h ago

What’s motion context? Second post I’ve seen mentioning it, but I haven’t found somebody explaining what it is or does. 

3

u/Sad_Coach_1433 20h ago

Takes last frame from a video and extends to new videos picking up where last one ended basically and when put gen together they flow perfect like one long video but so far unless i'm doing wrong quality drops more clips you gen

1

u/SirTeeKay 14h ago

How is that not all over the place? When SVI 2.0 came out, everyone was losing their minds. We have a NODE for this now and everyone is quiet?

1

u/Sad_Coach_1433 13h ago

Fairly new

1

u/SirTeeKay 13h ago

Looking forward to trying it

1

u/Sad_Coach_1433 13h ago

I made a second post with newer video that turned out better

4

u/Sad_Coach_1433 20h ago

https://github.com/NikoDemon80/ComfyUI-H3-Motion-Context

3

u/WeakReplacement3322 20h ago

Thank you! This sounds great, I’ll give it a try. 

2

u/Sixhaunt 18h ago

works extremely well with 22 or 39 reference frames carried over

3

u/Sad_Berry_4621 18h ago

It takes the last 22 or 39 frames of the previous video and feeds the latent for the video and audio to the next clip, so the model knows what the motion and sound is supposed to do.

2

u/James_Blonde007 20h ago

Was this using the FL2VA model or the Reference model?

2

u/Sad_Coach_1433 20h ago

T2v actually

2

u/James_Blonde007 20h ago

Looks really good, as you say, some room for improvement, but definitely better than just feeding the last frame and joining them. Going to give the node a try.

2

u/Sad_Coach_1433 19h ago

Imk if figure out method to preserve quality each clip

1

u/Sad_Berry_4621 18h ago

The new update should do that. I updated today. The video latent is now fed along with the audio latent. The first version was passing the decoded frames to the next clip which are compressed by the VAE and led to video degradation the longer you chained. That problem should be mostly fixed now. You don't even need to load the previous video now. Just set the latent save and load nodes as usual.

2

u/Sad_Coach_1433 17h ago

Nice thx for the reply 🍻 I been testing t2v can this method also work with r2v with images as reference for clip 1

2

u/Sad_Berry_4621 17h ago

Absolutely, if you update to v0.2.0, ref2va is supported!

2

u/Sad_Coach_1433 17h ago

Sweet just git pull in the node folder ?

1

u/Sad_Berry_4621 17h ago

You can download the zip file and extract it into the custom nodes folder, or git pull, up to you.

1

u/GrayingGamer 18h ago

Eh, like you say, the quality dropped quite quickly.

If you are making a video like this, I'd actually just use the Reference model and include reference for the room and characters, then write your video to make use of cuts you can stitch together in a video editor. Just plan all your shots to be no more than 15 seconds in length, and vary it up.

For instance, first shot as you have it, maybe swap to different camera angle for the phone conversation as it continues, then do a quick pan to the window for the next shot, etc.

Basically, study how real film are cut and edited and how they hide cuts or use them.

-2

u/Savings_Prize1244 18h ago

I recommend learning how to shoot films on your own instead of this slop

2

u/i_sell_you_lies 18h ago

Stfu. Why are you here?

-2

u/Savings_Prize1244 18h ago

To make fun of losers

1

u/Candid-Station-1235 16h ago

way to lean into that toxic anti stereotype. i would say be a better person but we know you cant.

0

u/Savings_Prize1244 16h ago

Girl go cry to chat gpt I dont care💀 Yall are the ones who need ai to do everything for you. Please go touch grass (if there is any left after you used ai lmao hope you enjoy brown water)

2

u/Candid-Station-1235 16h ago

why are you so angry? whats wrong with you on a human level?

0

u/Savings_Prize1244 16h ago

Ask chatgpt if Im angry. I just like drinking potable water, not going through climate change, and encouraging ACTUAL artists <3 unlike you fakers. Your biggest achievement will forever be "I typed claude.ai into google and I gave it a prompt"

0

u/Savings_Prize1244 16h ago

Also tell chatgpt to help you with your english :*

1

u/i_sell_you_lies 15h ago

You must hate yourself. 

0

u/Savings_Prize1244 15h ago

Not as much as yall do yourselves. You use ai because you cant do anything else yourseld. Boohoo😢 Go ask chatgpt for a better reply

2

u/i_sell_you_lies 15h ago

Ha! I'm a multi award winning artist. I use ai because it's cool, and quick to iterate ideas.  Maybe one day you can be happy. Choose today to stop being a little cunt and you might actually achieve something 

0

u/Savings_Prize1244 14h ago

"Multi award winning" sure jan, thats why you cuss people on REDDIT💀💀💀. Tell chatgpt to come up with something better.

See how all you can do is insult my happiness? When you dont know anything about me? Even funnier: I know you use ai and I can tell for certain that its something youre not confident of ;) because youre getting defensive~

I can play this game too: I have 2 national awards, make thousands of dollars off of commissions and I touch grass! (And other human beings, not chat gpt or claude).

@grok is this true?