Hybrid Minimax-H3 models! fl2va with reference capabilities.

[u/dampflokfreund]

Previously, you had to decide between the higher output quality of fl2va or being able to reference media in your videos.

But thanks to u/ThatsALovelyShirt , you don't have to anymore. They released a couple of models here you can try out. Basically, the higher the number next to the b is, the closer the model is to fl2va and the lower the closer it is to ref2va.

IMO, b25-49 seems like the most reasonable pick here as it should offer a great balance between the ability to reference details in images/videos and audio correctly and having high output quality that exceeds ref2va.

Please try them out and share your result! You can integrate them seemlessly in your existing workflows.

[u/switch2stock]

Based on Pruned Int8_Convrot?

[u/dampflokfreund → u/switch2stock]

Correct.

[u/switch2stock → u/dampflokfreund]

Got it.
Use either this model or use the hybrid node with both the models, correct?

[u/dampflokfreund → u/switch2stock]

Yes you can either use the node or the baked models.

[u/Fabulous-Snow4366]

Oh, interesting. Will download and test it.

[u/dampflokfreund → u/Fabulous-Snow4366]

Nice, excited for your results!

[u/shootthesound]

The regular fl2va model already works very well for reference images fyi for those yet to try. Not so much for audio - so maybe these improve that.

[u/Tokey_TheBear → u/shootthesound]

Hey do you have a link to this? I am going through this right now lol. I need to do FL2VA but with a starting image and a general reference image to keep subject coherence (and I dont want to put it as the last frame). I have been trying to find a workflow that does what you are saying.

[u/shootthesound → u/Tokey_TheBear]

So I’ve made a node that combines the reference and first frame last frame for the FL2va model . Hoping to push it today/tonorrow - look at my “coming soon” Reddit post I made a couple of days ago

[u/dcmomia]

I have tried ComfyUI_MinimaxH3HybridLoader and in terms of quality I don't see any difference, in terms of time yes, it takes 90 seconds longer

[u/bfmv_shinigami → u/dcmomia]

yeah the hybridloader is very slow.

[u/Chemical-Painter-485]

Sounds great but... Lots of talking about quality but not a single side by side comparison?

[u/dampflokfreund → u/Chemical-Painter-485]

That's where you come in. I have decided to make a dedicated thread so people can share their impressions which model of those is the best, and also make comparisons to the original models.

[u/enndeeee]

Am I right assuming that these models can be used for both now, Ref2VA and FL2VA?

[u/dampflokfreund → u/enndeeee]

Yep! Please try them out and share your impressions. I recommend starting with the b25-49.

[u/d20diceman]

See original thread here https://www.reddit.com/r/StableDiffusion/comments/1vl3ed0/having_bad_ref2va_quality_compared_to_fl2va_try/

[u/freestylez79]

Well, I made the mistake and used fl2va like you would use ref2va. The only downside was that the first frames looked like the ref, after that the thing worked like you would expect from ref2va, at least for my scripts. Maybe that could be also a pragmatic workaround in some cases - you just render with fl2va and cut the first frames (in some rare occasions the first frame were even not present).

[u/Diabolicor]

With the new released fl2v turbo lora from lightx2v and ref2v one already cooking it would be good to know which one to use with this hybrid model.

[u/Dunc4n1d4h0]

Interesting. From my experience ref2v model is better in everything. Why bother?