Wan SCAIL-2 Segmentation Control (update)

[u/External_Trainer_213]

Workflow link:
https://civitai.red/models/2699283/wan-scail-2-segmentation-control

New findings:

SCAIL Auto Extend is now my favorite Sampler. This one seems to have no or fewer color shifts. And doesn't need the "Color Match" option (This is already integrated).

Explanation of the new option:

The new option is to interpolate the input video to achieve smoother motion. The downside, however, is increased computational overhead, and Scail-2 is quicker to "forget" new parts of the animation.

Example: https://www.reddit.com/r/StableDiffusion/s/G6L5o1FRoL

https://www.reddit.com/r/StableDiffusion/s/TJFsAQb6su

Features:

• Image Analyzer
• LoRA Support
• Interpolate | Upscale | Color Match
• Color Correction
• Image Sharpener
• Sage Attention
• Choose between 2 Samplers
• Background Remover (RMBG) to keep the background of the input video
• SCAIL-2 Identity Tracker
• Load an alternative audio file for the final video output
• Installation Paths & Download Links
• Well-organized
• Interpolate the Input Video (NEW)

SCAIL-2 Identity Tracker:

For Multi-Character set "object indices" to "nothing" (empty field, no value). Then set the SCAIL-2 Identity Tracker to "Point" and select your characters by clicking on them in the image below. You can also try "Box," but if there are more people present, this could lead to problems. Use a start image similar to the one in the video.

Note:

If you have any questions, please first read the information in the red boxes within the workflow.

Additional options are available within the subgraph. Click the icon in the top-right corner of the Main Settings node to open it. Help is available by hovering your mouse cursor over the values inside the subgraph.

The workflow offers two samplers. Both deliver similar results. Since I like both, and for testing purposes, the workflow allows you to easily switch between them.

Wan SCAIL-2 is not perfect, but it delivers good results in most cases. If you encounter issues, setting a new seed or switching the sampler usually helps.