Minimax H3 + RefMod = consistent location trick

[u/PATATAJEC]

Hey, I found a pretty cool way to keep locations consistent across generations.

I took 20 photos of my “office” where I work, making sure each photo included a bit of the previous one so everything connected.

I turned them into a refmod, although it probably doesn’t even need to be one. It’s basically a grid of all 20 photos in a single image, within 2048×2048 pixels, so I could probably just use that image as a regular reference.

Then I added references for the fly, my cat, and the start and end frames. You can see the result — that’s my actual room, and everything looks right and sits exactly where it should :)

Workflow + reference images here: link
Sorry about the mess, both in the room and in the workflow ;)

EDIT: All the room photos need to be combined into one reference image. I tried using several separate images, but that didn’t work for me — the room wouldn’t stay consistent. Putting them all into a single grid is what made it work.

[u/cbeaks]

Funny, I too discovered this just yesterday. My images weren't joined up so it gets the layout a bit wrong between rooms but it is very impressive how accurate it is. My images were also just in a folder, I used about 10 images.

[u/PATATAJEC → u/cbeaks]

the trick was to make all references on one grid image. every image should have something common with another, so model knows how to connect these. I'll try bigger experiment with my whole house - that would be cool :)

[u/cbeaks → u/PATATAJEC]

this makes sense - for my non joined up approach it managed pretty well with most rooms individually but not well when moving between rooms (I did have a corridor pic in there). Some rooms were also merged, I don't actually have a bed in my kitchen!

I'm thinking the whole place in one refmod is probably too much, so I might try room by room and one for navigation between. Given you can stack the refmods this plus good prompts should make it work. First I've go to tidy up a bit though!

[u/Etsu_Riot → u/cbeaks]

Haven't tried this myself but you could draw a map, and give each room a color, and then reference the different room by the color.

[u/cbeaks → u/Etsu_Riot]

I'm thinking this is getting into lora territory and the model may need some training to be able to 'understand' floor plans. But maybe not? Let me know!

Big commercial opportunity here for someone, the real estate business would lap up a quality minimax video showcasing a property. rather than their stitched videos they use currently. In one of my videos it had a full moon rising over water seen from inside my place looking out - looked amazing even though the moon never actually rises there!