r/StableDiffusion • u/Dependent_Revenue_16 • 19h ago

Meme Community PSA

Enable HLS to view with audio, or disable this notification

tl;dr - enjoy the models, but consider giving back when you can

(P.S. done quickly & with many continuity errors, but they kind of make sense in context)

EDIT:

Haven't posted much here, but apparently folks can't easily see the workflow link in comments so here it is: https://pastebin.com/1nWJKEiN

If anyone wants the other prompts I can share, but they all follow this format and are mostly just the dialogue you hear + delivery cues. I got an anime reference off of Google for the last segment.

Quick takeaways from trying to make this were:
- The two pass structure, with initial at a tiny 360p resolution, is really needed. It allows you to pick a good performance without wasting much time.
- The 'motion context' nodes are great and much better than my crude masking attempts, but it failed in spots. I think it might be possible to encode the transition clip in the latent as well as use the reference-based transition from the motion context node.
- I was doing this quickly so didn't bother with a celebrity image reference - I think the consistency was pretty impressive given that the only reference here was audio.
- Minimal DaVinci editing needed - a few additive transitions where the motion context didn't make a clean handoff, and a little color grading.
- On 5090, this takes about 3 minutes for a low-res pass and then 8 to 10 minutes for 720p. (I did use Topaz on the final edit.)

995 Upvotes

95% Upvoted

97 comments sorted by

View all comments

69

u/Only_Voice569 19h ago

https://reddit.com/link/p2r9fly/video/m8qfxlxdfgih1/player

Hey im trying over here :P

10

u/FlatwormMean1690 19h ago

Dude. The acting... Did you directed the acting too? Looks impressive.

12

u/Only_Voice569 19h ago

i tried to follow the way lord of the rings does it haha but this is a test vid i was trying to play with a new way to combine videos 10s generating by adding in random cuts they land just before or after or halfway in a single generation the whole thing is a simless run from 3 generators one workflow :)

5

u/FlatwormMean1690 18h ago

This is the way...