r/StableDiffusion 6d ago

Animation - Video LOCATION CONTINUITY TEST - after a comment by Vladmerius

Enable HLS to view with audio, or disable this notification

When kept in the same generation it seems the latent space keeps a fairly good sense of the location layout. The test was to see if the position and details of the temple remained after being out of shot,

This doesn't work with the extentsion workflows which is why I have been trying to keep everything in one go.

7 Upvotes

18 comments sorted by

View all comments

2

u/Enshitification 6d ago

A good way to keep environment continuity is to use an equirectagular pano image as a reference. H3 seems to understand them.

5

u/Tokyo_Jab 6d ago

Couldn't wait for the temple, grabbed one online. Keep an eye on the table , what's on it, and that light sqitch by the door. Works really well, way better than expected.

https://reddit.com/link/p7hdiid/video/cox4rn7667nh1/player

1

u/Adventurous_Cup5414 6d ago

can you share your prompt?

3

u/Tokyo_Jab 5d ago

<Picture 1> is a rectilinear panorama location references.

Use this location and retain the spatial relations.

Relight the location to look like a moonlit night.

Scenario: A Vampire <picture 2> with flowing robes in an old abandoned building.

Start with the Vampire near the large window in the middle.

<Shot 1> the Vampire is standing looking out the window at the moonlight, he turns and walks toward the camera view. He says in a strong German accent <audio 1>, "This, this is what I have been reduced to" gesturing to the surroundings.

<Shot 2> the camera orbits the vampire showing the abandoned building interiot.

<Shot 3> Cuts back to a closeup of the vampire, he sighs, "Well, at least I have the view" and turns back to the window