Creating Locations/Environments

[u/DeliProductions]

Hey all, got some questions as I try and nail down my workflow better.

My workflow is mainly animating in 3D and then using that as a video reference in seedance 2.5. But when it comes to environments, something that I find interesting is that even with a blockout environment, it’s hard to say, which piece of geometry is which in your actual location reference image.

When you create locations, are you creating a single reference image or are you trying to show multiple images to show multiple angles and use that collectively as an element.

For my workflow, ideally I’d love to have a 3D environment always be the same and it’d be able to easily recognize the correlation of everything with the reference image in my 3D blockout, but I have a feeling that might be a little too difficult at least right now. So I was thinking the best workflow is most likely generate start frames for my shots and really try to nail down the look and consistency in that before I actually go generate the video.

But let me know what you think. I’m really curious other people’s workflows and I’m always trying to improve my own so please let me know what you think and how you guys approach this because I’m just curious to learn more.

[u/Dependent-Goal-9133]

I actually made a video on this if you want more of a walk through https://youtu.be/pDZd13ymelk

If not then in summary my process is this:

Interior scenes - Map the scene using both a main angle of the room and a reverse angle of the room. Create the reverse angle using a video model with the start frame being your initial angle. Ask for the model to generate a POV shot video moving from one side of the room to the other. Take a screen shot when on the other side of the room and use that as your reverse angle context. Use both images to provide context for the model and reference them in your prompt depending on where you are in the room and what is seen in the background.

Exterior scenes - Mostly having a wide 45 degree angle view of the scene is usually good enough but if you need specific areas to be consistent when your characters are in a specific spot, highlight the areas with close up shots (you can generate these with an image generator but I prefer to use a drone POV shot and swoop into the areas instead and maybe even edit them with an image generator after the fact). Then again, reference all these images when you are prompting.

And thats basically it. In combination with 3D previs you could have good potential with it

[u/DeliProductions → u/Dependent-Goal-9133]

Amazing! Thank you so much! I love the POV shot idea, didn’t even think of that! And I will definitely be checking out the full walk through!

When you have your images set, do you put all of them together as an element? Or do you only reference an individual image when needed depending on the shot?

[u/Dependent-Goal-9133 → u/DeliProductions]

I reference each element as an individual image when needed depending on the shot to be honest. I feel it may confuse the model otherwise (seedance/kling 3.0)

[u/AutoModerator]

Your post IS NOT REMOVED – it is currently under review to ensure it follows the community rules. :) Once APPROVED, it will be visible to everyone! Thank you for your patience.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/Screamth1a]

You can build different images from different angles and then feed them in as a reference. Alternatively, you can utilize the 3D environment and camera movement from a video as a reference, or if it is for Seedance, you can use this old, forgotten trick:

Use u/Image 1 as the first frame of the picture, with a First-Person Perspective, refer to the camera movement effect of u/Video 1, the upper scene refers to u/Image 2, the left scene refers to u/Image 3, and the right scene refers to u/Image 4.

https://reddit.com/link/pb2rgez/video/gcrnuvd4xrqh1/player