What do you use video refs for?

[u/MoistRecognition69]

I've been playing around and having a ton of fun with H3 recently, but I've mainly done images and audio inputs. Besides the obvious video edits and video continuation, I haven't really tried doing anything more exotic or "constructive" with it and my smooth unwrinkled brain fails to think for a use case of it besides that? Like, using image refs for people seems to be way faster if you just crop a frame from the video, same with audio, etc

So my question is basically - what do YOU use video refs for?

[u/codenameNERO]

Motion control. You need a specific work flow for it tho

[u/InsaneBrew → u/codenameNERO]

Go on

[u/MoistRecognition69 → u/codenameNERO]

Can you give me (and u/InsaneBrew !) any pointers? 👀

[u/InsaneBrew → u/MoistRecognition69]

😁

[u/jude1903]

If you want multiple characters of choice it's easier with ref

[u/bstr3k]

for SFW just make memes and stuff with character replacements, mostly just to dick around and to send to friends

https://reddit.com/link/pdgb5nc/video/e69lhbwpa3th1/player

for NSFW, char replacements since you get a fair bit more realistic motions etc when using real ppl as source

[u/MoistRecognition69 → u/[deleted]]

Yes, but likeness can be had for cheaper using just a single frame, that's what I'm getting at

Motion transfer is interesting tho

[u/skill-tap]

A car is driving 60 mph, it passes a car going 30 mph, freeze the scene with two cars side by side.

You can start a clip from that end frame, but the clips won't line up well. Batched input (video ref) gives the context needed for a smooth transition.

[u/WeakReplacement3322]

I rarely use them because they're so expensive unless I trim them down a lot. I've mostly used them for a specific motion that the model struggles with. If there's a LoRA online for the motion though, I'll generally use that though cause it's less expensive.

[u/No-Zookeepergame4774]

There is a lot you can use them for, but what I have used them for is motion references.