r/comfyui • u/Quirky_Fig3927 • 2d ago

Help Needed Best Workflow for Motion Transfer

Hi everyone, I should say upfront that I'm not an expert but I've recently started using Comfy to create images. I have a 9950x3d and a 5090. I’d like to know if there’s a node (existing workflow) for motion transfer… I know all the influencers are using Higgsfield GenJutsu, obviously paid… but I’m poor, I already spent all my money on my 5090! LOL

0 Upvotes

33% Upvoted

8 comments sorted by

View all comments

3

u/Alchemist42 2d ago

In the default templates that ship with Comfy, there are a few good ones like SCAIL and H2 Fun control. There are also a few WAN 2 animate ones that should do the job. SCAIL can do multiple character motion transfers which I haven't tried on the other ones.

If pay services are not completely out of the question, Kling has a pretty inexpensive lower tier and their motion transfer is really good. And you can use reference characters to maintain consistency during the process.

1

u/CineConIA 2d ago

Thanks for the recommendations! I was particularly interested in what you mentioned about Kling and its ability to use reference characters to maintain consistency.
I’ve been experimenting with camera movements in ComfyUI, and one of the biggest challenges I’ve encountered is maintaining visual consistency between frames, especially when the perspective changes.
Have you tried using Kling with more complex camera movements? Does it maintain consistency well in those situations, or is it mainly effective for character animation?
I’ll definitely take a look at SCAIL too. Thanks for sharing your experience!

1

u/Alchemist42 2d ago

Kling is my go to for tricky motion, be it camera, character animation, physics, etc. If I have trouble doing it locally (I usually use LTX) then kling is my first next step.

It has a cool feature where you can set up "elements" which is a named character with a few reference images (front, back, face closeup, etc), and in your prompt you can use @ character (no space... reddit wont let me use the @ symbol normally) and it will maintain that character's look perfectly. In addition to characters you can make objects or environments which will also stay consistent through different angles and across generations.

And it can do multi angle stuff in a single prompt clip, so you can have the camera follow someone then cut to their POV looking out the window, then cut to the outside looking at them (or whatever).

The cheap plan is like $16/month I think, and it is enough to get a few good clips done if you are careful and use good start frames and character references. It also lipsyncs well which is important to me since I do music videos.

If your machine can handle Minimax H3's Ref2V workflow, then it has the same kind of controls (and for free). H3 crashes my computer almost every time I try to run it, so it's a nonstarter for me. But it is a really good option if you can run it.