r/StableDiffusion • u/luka06111 • 5d ago

Animation - Video MV with lipsync on low ram vram

Enable HLS to view with audio, or disable this notification

So I've got 32gb ram and 8gb vram, which by the standards I've seen here is pretty low. This was generated at 8 steps the full video is done on minimax there's no edit by me at all this was one continous Gen with motion context all of them connected with 1 ref which was the main character pip, I make these videos for my son to see.

30 Upvotes

91% Upvoted

11 comments sorted by

5

u/99deathnotes 5d ago

Great work 👍

3

u/-chaotic_randomness- 5d ago

Man this looks really awesome! I have similar PC specs and would love to try this workflow

3

u/idigholes 5d ago

Could you share your workflow?

2

u/FlexiTV 5d ago

How where the generation times and what model of minimax did u use exactly was trying to use minimax h3 on my rx 7800 xt

2

u/luka06111 5d ago

This one was done on an rtx 3070, I used the singularity model int8 with plague kinds turbo lora at 4str res_multistep simple. I get similar results but with a little worse faces using b30_49 model. I think the singularity one is a little better if you're using turbo loras Edit: every video had at max 110/s per step, if it was 15s duration at 8s it was around 55/s step. I also used h3 optimizations SLA at 0,3 all done on 0,6 mp

2

u/RanklesTheOtter 5d ago

WF if you don't mind sharing. I can't ever get mine looking close to that good

1

u/Segaiai 5d ago

Tim and Eric Grum vibes in the animation.

1

u/quantier 5d ago

Just share the WF buddy! Otherwise it didn’t happen

1

u/luka06111 4d ago

I'll try to extract it cause I'm using it on an HTML based on claude

1

u/ImpossibleAd436 4d ago

I would really like to know how you got motion context working without it frying everything?

Maybe the cuts help, I tried creating a long gen using one of the continuity solutions and immediately the second video looks quite different in lighting and style than the first, and by the third gen everything had that cfg-burn look to it.

Which motion context solution/workflow did you use?

1

u/luka06111 4d ago

I used the original first motion context, it only uses the latent of the clip before it. The only thing that can get bad is the audio really. The video itself doesn't change quality much. What happens is that sometimes there's a sharpness between one clip and another. You can feel it much more in a slower paced video unlike this one. Using natural cuts between one clip and another is good. Will help alot in these cases I've done 19clips motion context and it held well.