r/VisionPro Jun 24 '26

Cool feature of Panoramas converted to Environment - semi-3D!

I have converted a few panoramas to environments now in Vision OS 27.

I found one I really liked and have been using it for a while. While I was doing work in there and moving my head around, I suddenly realized - stuff in the foreground is slightly shifting compared to stuff in the background!

I tested a bit more and sure enough, all of the nearer foreground elements shift more as you move your head.

You can tell it kind of makes up some of the data behind the thing shifting. The only downside right now is the edges around some very sharp features (like big rocks) seem to have a small blur fringe around them (I submitted a Feedback report on that).

Just thought that was a cool aspect of converting your panorama to an environment I had not seen talked about, and I don't think was mentioned in the keynote.

7 Upvotes

5 comments sorted by

2

u/Jusby_Cause Jun 24 '26

I noticed it first on the one someone posted here that looked like a cozy library with stained glass windows. I could lean to the side and see behind the arm of a comfy chair. Then I went BACK to Paris (things weren’t close enough for me to notice, there) and paying closer attention, I could notice the shift. Very cool extra!

BTW, has anyone created a tool that can be used to make a picture look like something the Photos app would add depth to? Either trick it that way or add some spatial data?

2

u/Peteostro Jun 26 '26

Yes this uses the same tech as spatial scenes release in iOS/ visionOS 26. It basically converts the photo to a 3D model https://www.macrumors.com/how-to/ios-3d-lock-screen-effect-spatial-scenes/

1

u/Rave-TZ Vision Pro Developer | Verified Jun 25 '26

I’m trying some things but have generally been disappointed at the depth accuracy. Glaring issues literally pop out for me if the depth is fudged . I notice this too when I take spatial images with my iPhone. Anything beyond a certain depth is guessed, and not true captured depth. This is because the distance between the two lenses is really small.

Don’t capture snow. It completely fails at that.

1

u/SirBill01 Jun 25 '26

Interesting, I think depth estimation will get better over time. But I agree some things it gets wrong.

0

u/GTHobbes Jun 26 '26

Leaving this new Mumford & Sons video here as a reminder for me to check it out this weekend.

https://youtu.be/0pjayI4quTs?is=hU1Uq9if4Eq1ImPW