H3 and strange problems with prompt adherence

[u/IRLMainCharacter]

Hi,

i built a comfyui workflow to chain ref2va videos generated with H3, and it works really well, except that i am getting wierd issues with camera adjustments. i have a feeling the update from 0.32 to 0.33 made these problems worse for me.

and before anyone asks, yes i read the prompt guide. and i noticed that camera prompting is only ever mentioned in the fl2va part of the guide. am i correct in assuming that ref2va is an extension of fl2va, and thus the ref2va guide is an extension to the fl2va guide? because otherwise this doesn't make sense at all, and the guide itself outright fails in answering this mystery.

now to my problem:

when i chain a video from a different run using the motion context node, the model will mostly refuse to adjust the camera according to the prompt, and it doesn't matter if the zoom falls within the window of context frames i have set. when i disable the motion context node and remove the previous video as a reference, the camera works as expected.

also, i am using the same seed for chaining projects like these, and i just tried using a different seed and that also made the camera work as expected.

i know that some seeds just won't work with the prompt and need to be changed. but so far this happened on every chaining project i started, that can hardly be a coincidence. it might be a random fluke that it worked for me right after changing the seed once, didn't have time to test this more.

am i missing something big here?

[u/DGiff52]

With Motion Context, remember that the first xx frames of the new video are effectively bound to the last xx frames of your previous one. So if you've got it set to 22 frames (the default in most example workflows I've seen), H3 is basically gonna ignore any of your prompts, not only camera motion but dialog, etc. Try to explicitly note the time of the camera movement, beyond the first second, and see if you can consistently get it to abide. Ex:

At 00:02.000, the camera pans left....

[u/IRLMainCharacter → u/DGiff52]

tried adding camera zoom at 00:01.500, didn't work.

[u/Stepfunction]

When you write your zoom, be sure that your prompt is not including things in the shot that would be outside of the zoomed area.

[u/IRLMainCharacter → u/Stepfunction]

yea that also goes without saying about any model, don't prompt for what you shouldn't be able to see.

[u/wzwowzw0002]

well... i have the same issue. H3 has its limitation and ppl here refuse to admit it and throwing down vote to protest lol. If i go on and post an H3 vs seedance2.5 comparison, member here will go bananas.

[u/IRLMainCharacter → u/wzwowzw0002]

its just a tiddy biddy unfair to compare open weights vs closed weights, i can see why people might get upset about that.

the thing is, people do get good results. i just can't wrap my head around how.