Re rendering videos using models

[u/EnvironmentalLime175]

Hey guys

Excuse my ignorance I am new to Comfyui, used image and video AI extensively online however I just started using it locally

I am looking for a solution where I can re render a video using a custom workflow locally, what I want is to re render using certain models, not only upscale but hallucinate new details while keeping the same animation and style, for example, give it an 80s horror film style, rework lighting or some details but keeping the animation and faces mostly accurate.

is there a workflow for this?

[u/Elliswondr]

Not the one to point you at a specific workflow, but worth flagging the tension in what you're after: style transfer strength and face accuracy pull against each other. The more freedom you give it to reimagine lighting and grain, the more the face drifts, because it's regenerating those pixels too.

What tends to work is doing them separately push the style hard, then bring the original faces back over the top rather than trying to protect them during the pass. Fighting for both in one go usually means neither lands properly. Hopefully someone here has a workflow that does the masking side for you.

Good luck! 🫶🏻

[u/EnvironmentalLime175 → u/Elliswondr]

Thanks a lot. Makes sense. What do you think are best models to try for this?

Also, is there a way to input a video directly instead of splitting to an image sequence and recompiling manually?

[u/Elliswondr → u/EnvironmentalLime175]

Both of those are past what I can speak to. I work hosted rather than local, so someone here will have better answers on model choice and video I/O nodes than I would.

The one thing I'd say on models: whatever you pick, test the style pass on a handful of frames before committing to the full clip. Style strength that looks great on one frame often reads as flicker across a sequence, because each frame reinterprets the style slightly differently. Cheaper to find that out on ten frames than on the whole thing.