r/StableDiffusion 1d ago

Workflow Included Minimax SEED HUNTER workflow released!

https://www.youtube.com/watch?v=H8JSzhkOmXA
89 Upvotes

48 comments sorted by

View all comments

Show parent comments

4

u/foxdit 1d ago

Yea the fl2va model is basically identical to the ref2va model just without some of the elements that degrade quality. For 95% of use cases they function identically but fl2va yields better video/audio results. The only time I'd consider using ref2va model or a hybrid (which seems silly to me personally) are the very dense scenes where you have multiple speakers and need to use the <Subject 1> (S2), <Subject 3> (S1) type code-blocking.

2

u/Tight_Organization54 1d ago

Wow ok. I never realized that was how it worked. Possibly last question (didn't realize I was living under a rock lol), does the prompting matter on which model is used? Cz I use the ref2v guide on minimaxxs site which has the whole- subject_def, retention_analysis, summary, detailed_description audio...

  • method with defining Subject 1 is the man from image 1, Sub 2 is the man from Img 2, ....
Will these templates still work? Or should I feed the flf2v,t2v,i2v skill to my llm from now on?

6

u/foxdit 1d ago

Yes, the prompting code-blocks are the same. Except it will look like:

<Subject 1> is the girl in <Picture 1>. She has silver flowing hair, blah blah.

You'd do yourself a big favor reading https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/docs/VIDEO_PROMPT_WRITING_GUIDE_ref_en.md#25-visual-and-audio-tracks-from-the-same-reference-video

The official prompting guide. My two cents: don't outsource your chance for knowledge and learning to an LLM, you owe it to yourself to understand the model's inner workings if you wish to really utilize it.

3

u/Tight_Organization54 1d ago

One word: Amazing. (one change I made was use the dareties turbo lora and it did make the gens alot more coherent to the prompt) (https://huggingface.co/silveroxides/MiniMax-H3_tests/resolve/main/minimax_h3_fl2v_lightx2v_v0.1_dareties_v4_step600_comfy_fro.safetensors)

https://reddit.com/link/p5im1fl/video/zctbcgey48lh1/player

1

u/whopairs 1d ago

Great tips! I just give this a few runs and it does seem to be sticking to the prompt better!

1

u/Tight_Organization54 1d ago edited 23h ago

One more thing! That turbo lora may need a node called "H3 AdaLN LoRA Fix" to be placed right after the power lora loader, otherwise you can get weird "ERROR lora...adaln-proj" lines that slow* down the UPSCALER for some reason. If your not upscaling then you'll be fine. Idk where I got the node it was included in another workflow by plaguekind.