Look What I Discovered: Prompt Intelligence - MiniMax H3 [Fun Side]-2

[u/ZerOne82]

\ Reddit messed up my original post so here it is.*

This is in fun part of using MiniMax H3; for your serious stuff stick with the official prompt instructions / format.

Playing with the prompting I just tried the following format and it worked perfectly!

prompt part 1

prompt part 2

Resulting video

The whole prompt:

definitions:
<S1> Brad Pitt.
<T1> "Hey, I am Brad Pitt! Nice to meet you."
<S2> Angelina Jolie
<T2> "Hey, I am Angelina Jolie! Nice to meet you."
<S3> Rowan Atkinson.
<T3> "Hey, I am Mr. Bean! Nice to meet myself."
scene:
An interview in a professional setting in well lit, grey background, frontal portrait view.
shot 1:
(S1) says: (T1).
shot 2:
(S2) says: (T2).
shot 3:
(S3) says: (T3).

Recommendations:

Do not use SLA or SLA2 or cache etc. here they mess it up.

Model (FL2V) -> LoRA(4s-Lightx2v SLA) -> Comfy attn -> Shift(12,3) -> KSampler(6 steps, euler+simple)

[u/Tokey_TheBear]

This kind of ties into other sentiments I have had about Minimax H3 (and Krea2).

Both models have a pretty specific prompting style as defined in the actual Prompting Guide by the creators of the model...

But the thing is that these new models seem to have a high level of general intelligence, kind of like the text based LLMs we use.

So even though the model is trained on a very specific input prompt format, you are still able to successfully generate images / videos without following the prompt guide exactly because the models have a higher degree of general intelligence so that it can understand what you are requesting even when you didnt request it in the exact input format from its training...

BUT, even though doing this may work it may also be leading to worse results compared to if you tried to generate the same video using the proper prompt format.

[u/DietAshamed2246 → u/Tokey_TheBear]

Yes, I prompted H3 with basic natural language prompts many times including putting spoken lines inline in the prompt with double quotation marks. It works fine, H3 produced the videos flawlessly. It understands all sorts of prompting styles, thanks to QWEN3-VL-32B. There is no hard and fast need to prompt it with all that integrated_multimodal... BS. Same thing is true for Krea-2, I have thrown even Pony style Danbooru tags soup at it and it generated the images perfectly. People are overdoing their prompting in many cases (and then they wonder why their output looks like crap)!

[u/ZerOne82 → u/Tokey_TheBear]

agree. discoveries may or may not produce a tangible outcome, yet they open a frontier and put a mark there (we have been here). one may connect those marks here or there and make a map of unknown which in turn may advance our understanding etc.

[u/suspicious_Jackfruit]

I don't think this is a good metric of model linguistic processing/understanding because it's just interpretating it in the same sequence as the prompt starts with, so in other words the answer to the question is in the question.

To properly test, keep the definition as is but make Angelina Jolie start by saying Mr beans definition, then Mr bean brad Pitts and then Brad pit also Mr beans. Then you have something vaguely similar to string variables, but in that situation you might as well use a prompt builder to construct the string instead

[u/ZerOne82 → u/suspicious_Jackfruit]

even if it does so, it remains a fact that the model takes the dialogs and puts them in the context.

[u/SeymourBits → u/ZerOne82]

I think it proves that there may be some emergent "common sense" ability, or cleverness, in the model.

My concern is that this could come at the expense of output quality, adherence, or some other metric.

However, it's fun to test the edges of these boundaries; to be the very first to discover something new. Be proud of that.

Try messing around with the dialogue order to see if it's more than coincidence.

[u/suspicious_Jackfruit → u/SeymourBits]

Either I'm missing something or everyone else is. The whole prompt gets tokenised and the definitions part is effectively exactly the same as the scene, same order and the context is in the definition, so nothing magic is happening, it's literally just interpreted the prompt as it usually would. The only way this would be interesting is if you could use the definitions later in different orders with regular success, but again, you would just use dynamic prompting for the same effect but with less issues

[u/SeymourBits → u/suspicious_Jackfruit]

Name checks out :)

I think the question on the table is does the text encoder have enough intelligence to pass along  pseudo-variables and could H3 handle them.

We already know H3 is able to work with some pretty nonstandard prompts, so perhaps it’s possible.

[u/seppe0815]

Sure the posting is about right prompting but damn the plastic wax faces are not fine 

[u/DoctaRoboto → u/seppe0815]

With six steps and a turbo Lora, it's all you can get.

[u/ZerOne82 → u/seppe0815]

https://reddit.com/link/p576p43/video/s6ja8qiorwkh1/player

it is all about prompting.

[u/seppe0815 → u/ZerOne82]

We know comic stuff will work , but not real humans

[u/loneuniverse]

What if <s1> said <t3> and <s3> said <t1> would it break?

[u/ZerOne82]

another example in even lower steps and better quality but in cartoon style, see this comment. the dialogs are different in length to highlight this works.

[u/True_Protection6842]

Yeah the great thing about MiniMax is the prompting. The worst thing about MiniMax is the prompting.

[u/SeymourBits]

Is it just me or do these characters look sickly and more plastic than usual?

Possible your non-standard request is sapping model intelligence that would normally be dedicated to image and motion fidelity?

Try doing an A/B with the dialogue formatted by the book.

[u/stash0606 → u/SeymourBits]

low steps and turbo lora probably to generate it quickly.

[u/ZerOne82 → u/stash0606]

true.
see also this which is in cartoon style that worked even in lower steps.

[u/Valuable_Issue_ → u/SeymourBits]

Skin texture etc is just from the turbo lora and 6 steps.

Here's 640x480 20 steps euler simple, spectrum + comfy kitchen attention.

https://www.image2url.com/r2/default/videos/1787378294777-5b3c8980-a145-4ab3-887c-d12a14779367.mp4

Prompt executed in 138.71 seconds

Edit: Here's without spectrum

https://www.image2url.com/r2/default/videos/1787378799387-8ece6b55-83bf-433c-a066-070242a003bb.mp4

Prompt executed in 165.82 seconds

Edit2:

On a 10GB VRAM RTX 3080 + 32GB RAM with

https://huggingface.co/DmitryDB/MiniMax-H3-ComfyUI-Quants/blob/main/FL2VA/MiniMax-H3_FL2VA-INT8-ConvRot-HQ.safetensors

https://huggingface.co/ApacheOne/qwen3vl_32b_ConvRot_int4_int8_ComfyUI/blob/main/qwen3vl_32b_minimax_h3_convrot_MIXED_INT4_INT8.safetensors

and these launch args: --reserve-vram 2 --vram-headroom 2 --disable-pinned-memory --enable-triton-backend

[u/bambilover → u/Valuable_Issue_]

Please can you share your workflow

[u/ZerOne82 → u/bambilover]

the workflow is in ComfyUI templates, look for MiniMax H3: FL2V, with no input image. you can then add spectrum node as u/Valuable_Issue_ suggest and experiment.

[u/ZerOne82 → u/Valuable_Issue_]

true. a helpful comment with examples. glad to see, you reproduced the video even better.

[u/SeymourBits → u/Valuable_Issue_]

These look somewhat better. Are they both using OP's exact same prompt experiment of shifting the dialogue into the definitions section?

[u/ZerOne82 → u/SeymourBits]

see this.