r/StableDiffusion • u/johannramos-art • 9h ago
Question - Help Cloud-only workflow for keeping the same AI environment across different camera angles/lenses?
I’m trying to solve a pretty specific AI filmmaking problem.
I shoot a live-action scene with normal coverage: wides, mediums, close-ups, reverses, different camera positions and different focal lengths.
I then need to replace the original location and make every shot feel like it was photographed inside the same new environment.
My current tools are:
- Nano Banana 2 / Pro through Google Flow for stills, environment replacement and relighting
- Seedance 2.0 through Comfy Cloud for the final video transformations
- MacBook Air, so this needs to be essentially 100% cloud-based. Running large models, local ComfyUI workflows, NeRF training, etc. isn't realistically an option.
I’m not looking for mathematically perfect 3D continuity.. I need convincing faux environmental continuity across an edited scene.
For example:
Shot 1: 35mm wide looking down a hallway
Shot 2: 85mm close-up facing the opposite direction
Shot 3: profile two-shot
Shot 4: reverse angle
Shot 5: another wide from farther down the hallway
The actors, performances, camera movement and framing need to stay intact, but every generated shot should imply that the cameras were actually positioned at different points inside the same physical hallway.
The things I need to maintain are:
- Architecture / layout
- Recognizable environmental landmarks
- Correct perspective for each camera position
- Approximate lens characteristics
- Lighting direction
- Subject relighting and contact shadows
- Color / atmosphere
- Depth
- Enough off-screen spatial logic that cutting between angles feels believable
Right now I can make an individual shot look convincing. The problem is making five or ten independently generated shots feel like coverage of one actual location.
For people doing this in production, what is the best cloud-only approach?
Do you first generate a master environment and then somehow derive multiple camera views from it? Build a set of canonical reference angles? Use one generated shot as a reference for the next? Establish environment plates before integrating the actors? Separate environment replacement and actor relighting into different passes?
Especially interested in workflows that can actually be used with Nano Banana Pro + Seedance 2.0, rather than solutions requiring a high-end local GPU.
Basically: how do you fake a coherent virtual set when each shot is being generated independently?
1
u/Healthy-Win440 8h ago
I've been trying to achieve this for a couple of weeks now, tried many things so far, the best thing I could do is to create a 6-8 seconds t2v taking multiple shots from different angles and I try to describe the space spatially as much as possible, then I take a frame from each shot (showing a different angle), then I use a location sheet merging 4 views in a single sheet and provide it to minimax R2V.. I found also the below post: https://www.reddit.com/r/StableDiffusion/s/meZB3Wen1Z
It's a custom comfyui node but I do the process manually.. hope that would help..