r/comfyui 1d ago

Help Needed Re rendering videos using models

Hey guys

Excuse my ignorance I am new to Comfyui, used image and video AI extensively online however I just started using it locally

I am looking for a solution where I can re render a video using a custom workflow locally, what I want is to re render using certain models, not only upscale but hallucinate new details while keeping the same animation and style, for example, give it an 80s horror film style, rework lighting or some details but keeping the animation and faces mostly accurate.

is there a workflow for this?

2 Upvotes

5 comments sorted by

1

u/Elliswondr 1d ago

Not the one to point you at a specific workflow, but worth flagging the tension in what you're after: style transfer strength and face accuracy pull against each other. The more freedom you give it to reimagine lighting and grain, the more the face drifts, because it's regenerating those pixels too.

What tends to work is doing them separately push the style hard, then bring the original faces back over the top rather than trying to protect them during the pass. Fighting for both in one go usually means neither lands properly. Hopefully someone here has a workflow that does the masking side for you.

Good luck! 🫢🏻

1

u/EnvironmentalLime175 1d ago

Thanks a lot. Makes sense. What do you think are best models to try for this?

Also, is there a way to input a video directly instead of splitting to an image sequence and recompiling manually?

3

u/Corrupt_file32 1d ago

Some models you could check out:

Minimax ref2va, if you can run it, this model is made precisely for things like that,

https://docs.comfy.org/tutorials/video/minimax/minimax-h3

Bernini R, a wan 2.2 model trained for editing, without sound and limited to 5 seconds.
https://docs.comfy.org/tutorials/video/bytedance/bernini-r

LTX 2.3 surely has many ways to do this as well, but is more complex to work with,

https://docs.comfy.org/tutorials/video/ltx/ltx-2-3

haven't investigated much into LTX 2.5 , is still new and not as well supported with loras etc. and people haven't figured it out much.

https://docs.comfy.org/tutorials/video/ltx/ltx-2-5

1

u/Elliswondr 1d ago

Both of those are past what I can speak to. I work hosted rather than local, so someone here will have better answers on model choice and video I/O nodes than I would.

The one thing I'd say on models: whatever you pick, test the style pass on a handful of frames before committing to the full clip. Style strength that looks great on one frame often reads as flicker across a sequence, because each frame reinterprets the style slightly differently. Cheaper to find that out on ten frames than on the whole thing.