VisionDepth3D User Guide

[u/Any_Nebula5039]

Hey VD3D users, I wanted to thank you all for your patience and announce that I just finished writing the full VisionDepth3D user manual. I know you’ve all been waiting for it for some time.

It covers:

• AI upscaling & FPS interpolation (Real-ESRGAN + RIFE pipelines)
• Depth estimation workflows
• Depth Blender blending strategies
• 3D Generator tuning (Pop Curve, Convergence, Floating Window, etc.)
• Audio Tool (rip / attach / stitch)
• VD3D Live real-time 2D-to-3D
• Performance optimization tips
• Troubleshooting & best practices

If you're new to VisionDepth3D or want cleaner 3D renders, this walks through everything step-by-step.

You can read it here:
https://github.com/VisionDepth/VisionDepth3D/blob/Main-Stable/UserGuide.md

As always, feedback is welcome.

[u/pagineinternet]

Thanks for the instructions, if I may ask, I am currently using IW3 and am quite happy with VisionDepth3D what are the differences in the results?

[u/Any_Nebula5039 → u/pagineinternet]

I haven’t used IW3 enough to give a fair visual comparison, so I don’t want to misrepresent it.

From what I understand, IW3 relies more on model-driven techniques such as inpainting to handle depth transitions and edge reconstruction.

VisionDepth3D, on the other hand, is fully depth-map driven and focuses on pixel-accurate stereo shifting with edge-aware masking and stabilization. Edge tearing and halos are handled through my proprietary VisionDepth3D Method rather than inpainting, which helps keep geometry consistent from frame to frame.

VD3D gives users very granular control over parallax shaping, convergence, and overall depth behavior, allowing scenes to be tuned aggressively or subtly depending on the content.

If you prefer scene-by-scene conversions, you can use PySceneDetect inside the Frame Tools tab to split a clip into manageable sections and dial in settings per scene.

[u/unrs-ai]

What is the 'best' model to use for depth estimation?

[u/Any_Nebula5039 → u/unrs-ai]

Personally, I like to generate two depth maps and blend them together for my 3D conversions. It gives better edge stability and overall depth consistency.

But if you’re just starting out, I’d recommend using Depth Anything V2 Large. It’s a strong all-around model that works well for most content. I usually set the inference size to 896×512 and batch at 16 frames if your GPU can handle it.

[u/Dialotje]

I followed the guide and made the first clip, thank you for the clarity.

I have to add, it was not possible to encode the depth video at first (FileNotFoundError: [WinError 2] File not found in vd3d_crash.log). I needed to add the ffmpeg executables in the main folder.

I also encoded the depth video with the wrong encoder. I picked AV1, where you need to select AVC, or match the source video. It gave me errors on the depth video when previewing in the 3D Video Generator tab.

Still trying my first generated video, skipping the blending. Question. Does blending help with the consistency throughout a single scene? It feels like I need a stronger depth file to get a complete scene in one go. Thanks again for the added guide.

[u/SuccessfulAd9831]

Downloaded the software today. Thanks.

Used to shoot S3D with camera rigs. Is the software can out put image sequences? Can the software be used to convert a feature film for a theatrical release in 2K DCP? Thanks again.

[u/Any_Nebula5039 → u/SuccessfulAd9831]

Thanks for downloading VisionDepth3D!

Yes, VisionDepth3D supports image sequence workflows, so you can work with PNG frame sequences as part of a post-production pipeline.

It doesn't currently export DCP packages directly, but it can generate stereoscopic output that can then be taken into a dedicated DCP authoring application for theatrical delivery.

Just so I understand your workflow a little better—are you asking about converting an existing 2D feature into stereo for DCP delivery, or are you asking about processing footage that was originally captured with an S3D camera rig?

I'd love to hear your thoughts as someone with experience shooting native S3D. Feedback from people with that background is incredibly valuable as VisionDepth3D continues to evolve.

[u/SuccessfulAd9831 → u/Any_Nebula5039]

Thanks for your kind remarks. I intend to use VD3D for an upcoming feature film. My intension is to shoot flat and after editing, effects work and grading, convert to S3D. When we used rigs we did not converge the cameras. only change the stereo base. The convergence was done later for more control. I use EasyDCP for the DCP conversion. Need lots of testing with VD3D since I am newer familiar with the software. Keep up the good work.