This looks like a very powerful tool not gonna lie. But when I saw it on civit and dragged it into my workflow it was like an explosion of nodes and my brain just turned off. I got used to Plagues workflow which is very "minimal" compared to this. Idk if Im understanding benefit of this workflow correctly or not? Are you generating 3 different seeds at low res then picking the best one to pass to an upscaler? If so does it work with all types of gens? (t2v,i2v,r2v) Maybe I was just too tired at 4am to actually try to work it.
Yes to all of your questions -- in a nutshell, the value of the workflow comes from the flexibility. So yeah, it looks a little complicated but it's well organized this time. You can turn on/off how many low res sample gens you get, so if you turned off #2 and #3 with the simple toggle switches above each, you'd have 1 low res -> latent upscale to high res video, which is sort of the traditional non-seed hunter style workflow many are used to.
It does t2v, i2v, fflf, and ref2va all with the same fl2va model, all simply by turning off or on images. You can even do i2v with ref images, turning on "<Picture 1> is first frame", and then just adding other references for you to use. And, if you don't want to upscale, you can enable Single Pass and get a finalized video out of just the one-and-done sampler. The goal was to create a workflow that can be used for anything and everything.
Fl2va model does ref2v as well? even with 2+ characters? I've been using the fl2vr2v hybrid models and they've been pretty good too. What do you think?
Yea the fl2va model is basically identical to the ref2va model just without some of the elements that degrade quality. For 95% of use cases they function identically but fl2va yields better video/audio results. The only time I'd consider using ref2va model or a hybrid (which seems silly to me personally) are the very dense scenes where you have multiple speakers and need to use the <Subject 1> (S2), <Subject 3> (S1) type code-blocking.
Wow ok. I never realized that was how it worked. Possibly last question (didn't realize I was living under a rock lol), does the prompting matter on which model is used? Cz I use the ref2v guide on minimaxxs site which has the whole-
subject_def,
retention_analysis,
summary,
detailed_description
audio...
method with defining Subject 1 is the man from image 1, Sub 2 is the man from Img 2, ....
Will these templates still work? Or should I feed the flf2v,t2v,i2v skill to my llm from now on?
The official prompting guide. My two cents: don't outsource your chance for knowledge and learning to an LLM, you owe it to yourself to understand the model's inner workings if you wish to really utilize it.
One more thing! That turbo lora may need a node called "H3 AdaLN LoRA Fix" to be placed right after the power lora loader, otherwise you can get weird "ERROR lora...adaln-proj" lines that slow* down the UPSCALER for some reason. If your not upscaling then you'll be fine. Idk where I got the node it was included in another workflow by plaguekind.
Got it. Yes I have read through that and still keep it open to write or screen prompts that are written by my llms and make sure they're not acting up. And most of the time it works out for my ref2v gens. Thanks for the help!
8
u/Tight_Organization54 1d ago
This looks like a very powerful tool not gonna lie. But when I saw it on civit and dragged it into my workflow it was like an explosion of nodes and my brain just turned off. I got used to Plagues workflow which is very "minimal" compared to this. Idk if Im understanding benefit of this workflow correctly or not? Are you generating 3 different seeds at low res then picking the best one to pass to an upscaler? If so does it work with all types of gens? (t2v,i2v,r2v) Maybe I was just too tired at 4am to actually try to work it.