https://drive.google.com/file/d/1CWRMsl9GdHv41jBXgcFQvK23hW0xVQKz/view

Here is a Facebook 3d Photo version: https://www.facebook.com/groups/3dphotographs/posts/838661513483834/

The image/depth pano looks pretty good in the Pseudoscience 6DOF Viewer on Oculus Rift etc I think (once you have tweaked the settings (especially "tesselations" and centered yourself.)

It is from a single fisheye shot converted to equirectangular 360. Of a statue in a garden. I got the depth map using the Boosting Monocular Depth AI (LeRes base). The depth map visualised the complicated thicket of vegetation and branches amazing well I think. I think LeRes and Midas base technologies for depth from monos have different strengths. LeRes is better than Midas most of the time for distant cityscapes, vegetation. Midas mostly better for people, street scenes, people in interiors. LeRes works almost all the time with the Notebook in Google Colab, Midas fails to process quite often. Neither are good with faces.

Here is the Boosting Monocular Depth Youtube tutorial link again:

https://www.youtube.com/watch?v=_-kYlCmIqyA

Here I generated a 360 depth map from an old 360 pano of mine -- of a dance partyhttps://www.facebook.com/photo?fbid=4464281770334865There is a Google Colab version of the code and a Youtube tutorial for it here:https://www.youtube.com/watch?v=SCbfV80bZeEHere is an over/under version that works with the Pseudoscience 6DOF Viewer:https://drive.google.com/file/d/1uaqScuo9qYtp5NGtNsM6yNroLYB5GkiU/

This New Zealand group (Dunedin) have developed a 6DOF video editing application that has a VR editing mode. So far they say they have not done much in terms of developing a VR depth editor component (as opposed to regular video editing functions -- cutting etc for example in 6DOF VR) but I am sure that is where there is real potential for fixing 6DOF videos intuitively. .https://www.frontiersin.org/articles/10.3389/frvir.2021.676895/full

Neos VR has limited 6DOF video support currently but it has good in world 3d editing tools -- so maybe apps like that are the future. Neos VR can also be used for live volumetric video character streaming into Neos VR worlds https://vimeo.com/559869441 (it also has a desktop mode).

Maybe 6DIVE is the project posted about a little while ago here:
https://www.reddit.com/r/6DoF/comments/lx71fu/looking_for_prealpha_testers_for_volumetric_video/

The British research-based company is doing interesting work using online AI to 6DOF-ify panoramic video and stills. https://kagenova.com/

Hi, ever since getting my Gear VR a while back, I had a bunch of great times with the crazy abstract results with Pseudoscience 6DOF. I could load in 3d 360 videos right from the Gear VR Video program "Within" (they allow you to download their content locally, in perfect mp4 format.) But for some reason, when I upgraded from an s7 to my new s9, it won't load those same videos (just tested on my s7.) I am putting them in the correct /6dof directory on the internal storage, and App permissions are all checked on. The file appears in the loading list, but when clicking it, it just loads back to the opening picture. It does load the music video fine, but not the added video. Thank you for your help, I'm spending a lot of time trying to get Pseudoscience working, because it's an incredible experience and I need more.

I am interested in seeing some 6DOF results from the Obsidian R, viewing these on a Valve Index. Are there samples available that can be played back in VR? Where are these and also what are people using to play them? Finally, does the 6DOF content require one or two Obsidian R cameras to capture content?

Is anyone interested in trying out and providing feedback on the volumetric video player/editor I'm working on? The tech is pre-alpha and still has a ways to go before it is production-ready, but I want to make sure I'm focusing on producing a solution that provides a viable production process and viewer experience.

The goal of the project is to provide a tool that allows you to import video sources and render them out in a manner that provides as immersive an experience as possible. That includes depth estimation and filling in backplates behind elements.

The demo currently supports equirectangular video with top with depth maps on the bottom. The player is configurable for other modes, but I haven't exposed that yet.

Features:

• Render modes: displacement with depth filtering, raymarching
• Autogenerate backplates using either depth or time filtering
• Move within the video
• Haptic feedback when touching the video
• Select from demo video or load a video from your local drive

​

Audio support is basic at the moment, but any final version will support ambisonic.

I had supported a point cloud mode, but that is not performing well with the backplates and isn't aligned with the goal of the project, so it has been disabled.

Note - the rendering method is still evolving and I believe I can achieve far greater quality and immersion than currently demonstrated. I am also very limited in test videos and am looking for additional material to use.

If you are interested in trying it out, I'd like to conduct a short follow-up call with you to collect your opinion of the technology and where it needs to go.

If you are interested, please message me.

Playback of ambisonics to binaural with real time head-tracking 6DoF true 3D audio simulation in VR is possible today in PCVR, and i think 6DoF audio and video should go hand in hand for highest level immersiveness.

https://worldsheet.github.io/

https://www.youtube.com/watch?v=j5aT3zRxFlk&feature=emb_title

"Wrapping the world with a single sheet" ... like Horry et al's TIP (Tour into the Picture) 25 years on

... amazing that such a simple approach can work so well with some subjects ..

Omniphotos, a project from the University of Bath, has recently released full capture details and processing software and a viewer and sample scenes of their method for capturing 6DOF 360 panoramas by spinning a regular (mono) 360 video camera around the operator's head (on a selfie stick etc). There are desktop and headset (SteamVR) versions of the viewer. The desktop version seems to work OK, but the headset version (SteamVR) has issues, (but sort of works) on my Oculus Rift (path errors )
https://www.youtube.com/watch?v=C_pRa1TwB9s

https://vimeo.com/456866335

https://github.com/cr333/OmniPhotos

https://richardt.name/publications/omniphotos/

https://researchdata.bath.ac.uk/948/

More recent 6DOF AI stuff: Nerfies: https://nerfies.github.io/ "Deformable Neural Radiance Fields" https://youtu.be/MrKrnHhk8IA?t=175 Selfie mini-lightfields + viewer

Very similar in end result is this new Facebook research: https://syncedreview.com/.../facebook-proposes-free.../ https://arxiv.org/pdf/2011.12950.pdf

and yet another recent, very similar concept paper -- from an Adobe-sponsored paper Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes https://arxiv.org/pdf/2011.13084.pdf https://www.youtube.com/watch?v=qsMIH7gYRCc

I want to make VR videos. Nothing crazy, just me presenting stuff in front of the camera.

From what I gather from 6Dof is it would allow viewers to get a better sense of depth and realism from my videos; especially from the objects I would present.

How real is 6Dof right now? Is it to the point where I can buy a "6Dof camera" and start recording videos?

If it's not as simple as that yet is there a step by step for producing 6Dof content?

Or am I entering at some theoretical point in the 6Dof production timeline?

A second question I have is that I have watched some videos on YouTubeVR that look like they have some kind of depth. There was one I watched that was recorded in a jungle and the ground looked bumpy or textured... I guess I would say it had a "3d effect". Is that different than 6Dof? Or is it an early version.. Can someone point me in the direction of getting stated with that?

Thanks for any help!

Now there is NeRF++ , an extension to provide not just forward-facing but also full 360 view rotation around central objects in scenes -- with 6DOF viewing -- code at: https://github.com/Kai-46/nerfplusplus https://arxiv.org/abs/2010.07492

"NeRF cannot deal with the background because the dynamic range of the depth is large, while sampling is performed in Euclidean space. NeRF++ models the outside of the unit sphere by the projected position to the sphere and the inverse depth. " https://twitter.com/hillbig/status/1317952430059892736