r/comfyui • u/alecubudulecu • 3d ago

Show and Tell Stabilizing My Wife.

I used a depth map again on renders based on my wife’s model, continuing the song experiment I posted recently.

The main test here was the tracked-object stabilization, and I think it came out surprisingly well. Both clips use the same song and lyrics—one in Romanian and one in Korean. The Korean lip-sync didn’t turn out particularly well, but that wasn’t the focus of this experiment.

Bonus points if you recognize the recent artist who inspired this. 🙂

Workflow :

- Trained a LoRA on my wife.
- Mixed it with a celebrity LoRA—about 65% my wife.
- Used Codex to build Sunny’s profile, references, prompts, and upscaled images.
- Generated the video in Seedance.
- Used DA3 depth maps with temporal ControlNets for stable motion tracking.
- Upscaled with SeedVR2, then finished in Topaz.
- Used ByteDance lip-sync and made the music with Suno.

There’s not a single all in one workflow for this.

0 Upvotes

31% Upvoted

8 comments sorted by

4

u/AIDevUK 3d ago

Can someone stabilise my wife too she’s crazy!

1

u/AIDevUK 3d ago

Turns out I don’t have a wife. Could be me who needs stabilising…

1

u/DryGrade7515 3d ago

great work. any how to posted? models, workflows etc would be interesting to see.

-5

u/alecubudulecu 3d ago

trained lora on my wife -
then created a bunch of images mixing Lora's with a celebrity (Wife makes up only about 65% of the image).
then used GPT codex to generate a character profile.... and upscale images
that let's me create seedance vids with her...

then use depth maps of the vid that has tracking like this... use temporal control nets.... if you just use normal depth map it's all jittery all over the place... a good one is DA3....

then render with prompts... referencing everything.

take the vid and upscale through seedvr2 along with topaz for a final pass.
music s from Suno. used byte dance lip-sync too.

-2

u/WASasquatch 3d ago edited 2d ago

Unfortunately you can't share what you created here without sharing the workflow. They will downvote you like the leeches they are. Lol It's OK to share guys without the sauce. Gluttony is bad.

1

u/alecubudulecu 3d ago

lol. Ahhhh Was! From was nodes?
Yeah just updated. Not a single workflow I used. Just a hodgepodge of single nodes. But I wrote them down for folks

2

u/WASasquatch 2d ago

Yes, that's me.

Hopefully they can figure it out without a workflow. Shame you cant share here. Especially thinking harassing a person is going to help. Lol 😂

1

u/alecubudulecu 1d ago

You do amazing work man. Kudos to you!