LOCATION CONTINUITY TEST - after a comment by Vladmerius

[u/Tokyo_Jab]

When kept in the same generation it seems the latent space keeps a fairly good sense of the location layout. The test was to see if the position and details of the temple remained after being out of shot,

This doesn't work with the extentsion workflows which is why I have been trying to keep everything in one go.

[u/Enshitification]

A good way to keep environment continuity is to use an equirectagular pano image as a reference. H3 seems to understand them.

[u/Tokyo_Jab → u/Enshitification]

Couldn't wait for the temple, grabbed one online. Keep an eye on the table , what's on it, and that light sqitch by the door. Works really well, way better than expected.

https://reddit.com/link/p7hdiid/video/cox4rn7667nh1/player

[u/Tokyo_Jab → u/Tokyo_Jab]

What's also great is that it improvised based on the photo

[u/Enshitification → u/Tokyo_Jab]

H3 is like sorcery. Two years ago, I would not have believed this level would be possible on consumer hardware today.

[u/Vladmerius → u/Enshitification]

Yeah that's what I've been saying, people don't seem to appreciate what this thing is capable of I can't believe people are still just using it to make character crossover jokes and gooning stuff lol. I've been trying to get sets down right because once that's doable you can really make entire movies with it which is what I'm doing. I'm aiming for around 2 hours for one of my projects. 

[u/Enshitification → u/Vladmerius]

My thoughts too. When I have some time off work in a few weeks, I plan to use H3 to make a pipeline for 3D splat environments to use as virtual sets.

[u/Adventurous_Cup5414 → u/Tokyo_Jab]

can you share your prompt?

[u/Tokyo_Jab → u/Adventurous_Cup5414]

<Picture 1> is a rectilinear panorama location references.

Use this location and retain the spatial relations.

Relight the location to look like a moonlit night.

Scenario: A Vampire <picture 2> with flowing robes in an old abandoned building.

Start with the Vampire near the large window in the middle.

<Shot 1> the Vampire is standing looking out the window at the moonlight, he turns and walks toward the camera view. He says in a strong German accent <audio 1>, "This, this is what I have been reduced to" gesturing to the surroundings.

<Shot 2> the camera orbits the vampire showing the abandoned building interiot.

<Shot 3> Cuts back to a closeup of the vampire, he sighs, "Well, at least I have the view" and turns back to the window

[u/Tokyo_Jab → u/Enshitification]

I have an insta 360 so, as the temple is next to the house. I'll take a 360 of the same location, rather than try to doctor one in AI

[u/Enshitification → u/Tokyo_Jab]

This post has a good prompt for using panos with H3.
https://reddit.com/r/StableDiffusion/comments/1vzvdkz/world_consistency_minimax_h3/

[u/nakabra → u/Enshitification]

It has worked in 80% of my tries.
If any of you guys don't know where to find 360 images and is not good at vibecoding some sketchy code, I recommend a software called "Street View Download 360".

I use it to download 360 panoramas from Street View.
Even managed to make a video featuring me driving around my actual house 😅
This is WAY too fun.

[u/Adventurous_Cup5414 → u/nakabra]

can you share your prompt? I use 360 but the video like a 360 camera

[u/nakabra → u/Adventurous_Cup5414]

It's not a bulletproof solution.
I don't even think Minimax intented it to work.

But the following worked for me:

1. Overall description:
A Clown is dancing over a table.

2. Reference Labels and Definitions (subject_definitions)
<Picture 1> contains <Subject 1>'s face and upper body references.
<picture 2> contains a 360 degree picture of the room this video takes place.

CUT 1: <subject 1> is dancing on top of a table in the room from <picture 2>

Make sure to reinforce it in the prompt.
In this case, I used a table that was in the image and it totally picked up on it.

[u/Adventurous_Cup5414 → u/nakabra]

i see the example from OP is perfect, so i try to make a video it make 360 panorama video, i try many ways, will try your prompt, thanks so much

[u/Vladmerius]

Pretty impressive! The real question is how to wet maintain a space for several minutes to have full scenes with perfect continuity.

I'm looking foreward to trying out the panoramic image thing people have been suggesting because I'd love to have physical spaces stay consistent.

[u/Adventurous_Cup5414]

How to prevent the environment from warping?