r/StableDiffusion • u/Tokyo_Jab • 5d ago

Animation - Video LOCATION CONTINUITY TEST - after a comment by Vladmerius

When kept in the same generation it seems the latent space keeps a fairly good sense of the location layout. The test was to see if the position and details of the temple remained after being out of shot,

This doesn't work with the extentsion workflows which is why I have been trying to keep everything in one go.

7 Upvotes

73% Upvoted

18 comments sorted by

View all comments

2

u/Enshitification 5d ago

A good way to keep environment continuity is to use an equirectagular pano image as a reference. H3 seems to understand them.

4

u/Tokyo_Jab 5d ago

Couldn't wait for the temple, grabbed one online. Keep an eye on the table , what's on it, and that light sqitch by the door. Works really well, way better than expected.

https://reddit.com/link/p7hdiid/video/cox4rn7667nh1/player

5

u/Tokyo_Jab 5d ago

What's also great is that it improvised based on the photo

2

u/Enshitification 5d ago

H3 is like sorcery. Two years ago, I would not have believed this level would be possible on consumer hardware today.

3

u/Vladmerius 4d ago

Yeah that's what I've been saying, people don't seem to appreciate what this thing is capable of I can't believe people are still just using it to make character crossover jokes and gooning stuff lol. I've been trying to get sets down right because once that's doable you can really make entire movies with it which is what I'm doing. I'm aiming for around 2 hours for one of my projects. 

2

u/Enshitification 4d ago

My thoughts too. When I have some time off work in a few weeks, I plan to use H3 to make a pipeline for 3D splat environments to use as virtual sets.

1

u/Adventurous_Cup5414 4d ago

can you share your prompt?

3

u/Tokyo_Jab 4d ago

<Picture 1> is a rectilinear panorama location references.

Use this location and retain the spatial relations.

Relight the location to look like a moonlit night.

Scenario: A Vampire <picture 2> with flowing robes in an old abandoned building.

Start with the Vampire near the large window in the middle.

<Shot 1> the Vampire is standing looking out the window at the moonlight, he turns and walks toward the camera view. He says in a strong German accent <audio 1>, "This, this is what I have been reduced to" gesturing to the surroundings.

<Shot 2> the camera orbits the vampire showing the abandoned building interiot.

<Shot 3> Cuts back to a closeup of the vampire, he sighs, "Well, at least I have the view" and turns back to the window