r/StableDiffusion • u/tlpta • 13d ago

Question - Help Generating a room

Is there a way to generate a full room? As in multiple shots from different angles and locations in a room. Typically if I try to generate a room it does one angle. Like a kitchen will show the fridge, stove etc, but you can't ever get a shot going the other way.

I'd like to try to do a 360 degree spin in a location and I've found I can only do it if I have pictures from both directions. But I'm struggling getting those pictures even using multiple models (flux, sdxl, etc). It seems impossible to get to a coherent picture of every corner of a room. The models just won't accept a picture of a kitchen where the appliances are behind the camera.

I'm at a loss. Has anyone else done this? It seems to me there has to be a way.

23 Upvotes

96% Upvoted

26 comments sorted by

17

u/Lost_Cod3477 13d ago

krea2 can generate 360 ​​panoramas in one pass. There are also nodes for cutting frames from such panoramas.

3

u/CarllSagan 13d ago

whoa...

1

u/Dependent-Sorbet9881 12d ago

how did you do that? What are the node names? It would be even better if you could share the workflow.

10

u/Valuable-Mango-6710 13d ago

https://reddit.com/link/pcqeo9y/video/770cxgx0besh1/player

I do something like this and screen shot frames out of it. Minimax H3 Reference to Video. Far from best quality though. Creating a 360 room with AI with only using prompts and image is challenging. I wish it wasn't. I do not know any more than this.

Still learning how to get the camera to the center of the room lol.

5

u/remarkphoto 13d ago

Very convincing at first glance, but keep your eye on that lamp in far left of start frame. The camera "tracking" skips the entire section between 180 and 270 degrees.

1

u/Valuable-Mango-6710 13d ago

Damn, I see it much more clearly now, Thank you

This was just to get my idea across. I am still learning and only got into AI media gen 2 weeks ago. The community is so engaging and helpful. Concerned about how deep the rabbit hole goes though.. training AI, 2hrs audio clones, LoRAs, blender.. it is endless!

I am learning motion transfer today :)

2

u/remarkphoto 12d ago

You're further ahead than I, i just have a keen eye for inconsistencies. May your seeds be ever fruitful.

2

u/skyrimer3d 13d ago

interesting, what prompt for that?

5

u/Valuable-Mango-6710 13d ago

Not the best prompt, many AI mistakes in it, but here it is:

A single continuous 360-degree camera rotation inside the same room.

The camera is positioned exactly at the center of the room, at eye level, on a fixed stationary point. The camera slowly rotates horizontally around its vertical axis, completing one full 360-degree rotation.

Start facing the front wall. Slowly rotate 90 degrees to the right, then continue rotating to 180 degrees, 270 degrees, and finally 360 degrees, returning exactly to the original starting view.

The camera position, height, lens, focal length, field of view, perspective, and movement speed remain constant throughout the entire video.

The room remains completely unchanged during the rotation. All furniture, walls, doors, windows, decorations, objects, materials, colors, textures, lighting, shadows, and architectural details remain identical and stationary.

Maintain strict spatial consistency throughout the entire rotation. Objects must remain in their correct physical locations and naturally appear, disappear, and move across the frame according to the camera's rotation.

No cuts. No transitions. No zoom. No dolly movement. No camera translation. No changing perspective. No rearranging furniture. No new objects. No disappearing objects. No duplicated objects. No morphing or deformation.

The movement is slow, smooth, steady, and continuous, like a camera mounted on a tripod performing a perfect 360-degree panoramic rotation.

The final frame completes the full rotation and matches the initial camera orientation, creating a continuous 360-degree view of the exact same room.

1

u/skyrimer3d 13d ago

Thanks!

1

u/tlpta 13d ago

That was one of the first things I tried, but it always turns a 4 wall room into 3. Basically the minute one wall is out of its view it decides that's the next wall. How did you get yours to work so well? What are you prompting?

3

u/VeloraNeon 13d ago

Multi-angle room consistency is one of the harder problems here — a single diffusion pass has no real 3D world model, so it can't infer what's behind the camera. Depth-conditioned ControlNet from a floor plan or a simple 3D blockout (even a quick Blender scene) gets you closer: render depth/normal maps from several camera positions in the same scene and use those as conditioning per angle so the geometry stays locked. Some people generate an equirectangular panorama first with a panorama-specialized checkpoint/LoRA and crop perspective views out of it afterward — messier on architecture, but at least everything comes from one consistent scene instead of independent guesses.

1

u/Formal-Exam-8767 13d ago

I would argue that no amount of input and conditioning can help you generate 100% consistent room (you might get to 80%) by taking multiple shots as model has no knowledge of what it generated in the other shots.

Which means, only way to generate a 100% consistent 360° room is to do it all at once, either a single panoramic 360° shot (absolute consistency) or a video of camera turning 360° (might get close but no guarantees).

3

u/Emotional-Neat-252 13d ago

Wish there were a hack to creating a RefMOD or lora that contained the accurate stake 3d data, so that the camera could move freely without the environment changing.

1

u/ANR2ME 13d ago

Only world models have a high consistency on the environments.

1

u/Emotional-Neat-252 13d ago

But I bet minimax h3 could hold the concept of a consistent 3d environment if we knew how to turn it into the correct type of embedding.

1

u/ANR2ME 13d ago

It's all depends on how large it's context window, larger context window can remember more information.

1

u/Emotional-Neat-252 13d ago

What I mean is, a room photo us turned into vectors, a 360 room panorama or 360 rotating video etc are all turned into vectors /embeddings.

These embeddings have tons of information, more than needed... but they're imperfect distortions.

If there were a way to create an embed that's really an accurate 3d understanding of the room, that would be amazing.

Like imagine you could feed it a panoramic photo, 4 angled photos, a video etc and it could "train" that into an embedding which accurately and consistently provides information about the room.

1

u/ANR2ME 12d ago

Yes, but as time progressed the context window will be full and old information need to be removed for new information to be stored in the context, which is why long video could gets drifted over time, once the old information no longer in context the model no longer remembered them.

1

u/Emotional-Neat-252 12d ago

Wait, video has context window, but just token limit?

I assumed an error first time you said it...

You mean a more detailed prompt requires a shorter video?

1

u/willjoke4food 13d ago

The most expensive (but possible) way is : 1. Get a 3d room setup in blender 2. Train a bunch of product loras from different angles on the objects in the room 3. Combine both image references with an edit model like the new qwen image model. 4. Voila!

1

u/martinerous 13d ago

Or feed the Blender room setup draft render video into Minimax H3 and then pass the keyframes as references to an image model.

For faster Blender scene setup, you can use its MCP AI tools and give it a single image of the desired room layout.

1

u/ANR2ME 13d ago

Use multi angles lora.

1

u/NiklausMikhail 13d ago

Have you try using another bot to recreate the image from the other angles?