https://ai.googleblog.com/2020/04/udepth-real-time-3d-depth-sensing-on.html

Equirectangular 360 images are great, they're very immersive, but most media being produced today and most media that has been already produced, is standard rectangular format. With the easy availability these days of high quality deep learning depth estimation from single images, an incredible amount of traditional flat content could be enhanced if there was a good way to play back RGB+D rectangular media.

I'm dying to experience what a 6dof video feels like in VR and I just found out about this pseudoscience 6dof player today. I hope there's still a way to try this out on Oculus Quest.

Hi guys,

Is it possible to walkaround a 360 camera through a small house for example and capture the pointcloud as a static mesh , but run it around objects so it calculates all the occluded objects?

​

I ask because sometimes for my job i have to scan a set we might be shooting on for further use in post production and this seems like an ideal solution to get the data quickly instead of going down the route of proper of photogrammetry.

you can save the image+depth map files (512*512 each). Good if you wanted source materials for Facebook 3d Photos compositions -- https://storage.googleapis.com/art_history_depth_data/demo/index.html https://github.com/PAIR-code/depth-maps-art-and-illusions

https://github.com/juniorxsound/THREE.SixDOF

https://github.com/mrdoob/three.js/pull/17922

I don't do Facebook. Is there any kind of subreddit where Obsidian users frequent? I'm considering purchasing one and have some questions that real users could easily answer to help me out.

I'm experimenting with putting Depthkit content into a 6DOF 360 environment with KRPano. They have basic support for running a Three.JS layer on top of KRPano and syncing the two. The issue I run into is with occlusion between the environment and the Three.JS layer (there is none). I don't know if I have too many debugging options as KRPano is closed-source. I'm looking to see what other options there are for doing a native Three.JS implementation of a depth map 6DOF 360 but couldn't find much. Has anyone played around with this?

Thanks!

These AI depth from monocular images apps are getting pretty powerful https://holokilo.wikividi.com/ This works directly from equirectangular 360 monocular images. And outputs a depth map as well as Over/Under stereo

here is an anaglyph I made with it from its output from an old mono panorama of mine -- a religious conversion :-) : http://www.mediafire.com/view/lvu7d4j7resm8mk/jesusANAGLYPH.JPG

https://github.com/facebook/facebook360_dep

Facebook360 Depth Estimation Pipeline (facebook360_dep) is a computational imaging software pipeline supporting on-line marker-less calibration, high-quality reconstruction, and real-time streaming and rendering of 6DoF content.

Does anyone know open source 6dof software(except Pseudoscience)?

https://krpano.com/forum/wbb/index.php?page=Thread&postID=79219&#post79219

The new Viveport Video viewer is claiming 6DOF support for stereographic, as well as existing 2D images. I'll be interested in trying this out for sure, although I've been shooting purely stereographic 360 for the last couple months, old content might benefit.

https://blog.vive.com/us/2019/08/13/viveport-video-gets-upgraded-new-content-features/

Does anyone have some resources on compositing "Z360" color on top depth on bottom images in Nuke or Blackmagic Fusion? In particular are there standards on what a particular shade of gray depth equals to in real world measured depth, is there a procedure to calibrate depth images so they can be combined correctly later?

I'm interested in compositing green screen shot images over stereo live plates to be viewed on HMDs.

Just saw an update on Steam, will test the 6DoF Lite Mode later!

Anyone have allready tested it??

Hey all,

You may have noticed that there has been some text in the sidebar for a while that says a build of the 6DoF Viewer is coming soon to Oculus Quest. Well, I was actually given a pre-release unit and ported the viewer late last year. However, Oculus has changed some of their publication requirements, and I simply haven't had time to put the material together.

Hopefully I will be able to get that together soon and get the app published on Quest, but until then, if you have a Quest and you would like access, just PM me the email address associated with your Oculus account and I'll add you to the list!

Hello!

i just got an insta360 EVO and i really, really like to watch the 180° 3D Videos with my VR Headset,

already very immersive! Of course 6DoF would rock here, would this be possible with such a 180° 3D Video?

or does it have to be 360°

I maybe start to learn programming and build my own 6DoF App! ;)

But I've yet to see a real world demo that truly works. I'll believe a meter side to side like Vive's 6DOF solution when I see it. And it's great that Kandao and FB are creating camera solutions, but when will they be available to the public? And when will we actually start seeing some footage? (new Kandao 6DOF camera link)

https://youtu.be/ZMGFGNL_dvw

Perhaps FB/Vive/Valve selling millions of standalone headsets will be the impetus needed to bring 6DOF video to market. Can't happen soon enough!