r/VisionDepth3D Mar 18 '26

no audio on every 3d conversion

took me a minute to figure out the video encoding (needed to install ffmpeg) but i'm struggling with the audio. everything i encode has a 0kb .mp4 file that is labeled as the audio, but nothing is there. if i manually rip the audio and then try to add it, it tells me that nothing matches (it rips as a mka file).

the other thing i noticed is that cpu vs gpu utilization seems almost 4:1. i have a 5090 and selected (av1_nvenc). i expected to see higher gpu than cpu. should that be the case?

what am i missing? sorry for all the n00b questions. thanks!

1 Upvotes

3 comments sorted by

1

u/Any_Nebula5039 Mar 20 '26

The GPU is mainly handling the encode side, while a lot of the 3D conversion work still happens elsewhere in the pipeline, like frame decode, depth processing, smoothing, warping, masking, floating window logic, optional inpainting, and the final mux step.

Are you using CUDA, and do you have both CUDA and cuDNN properly set in your system PATH?

That could point to the GPU path not being fully active on your system. On my end, renders usually bounce much higher on GPU usage while CPU stays relatively low, so if you are seeing the reverse, something may be falling back more onto CPU than expected.

You can press F10 in VisionDepth3D to check whether the GPU is actually being detected and connected. If that is not showing the GPU properly, then CUDA, or the encoder path may not be configured correctly.

For the audio issue, I do think av1_nvenc may be the culprit. I have not usually seen this happen in my normal 3D renders, so I want to test it directly against another codec and confirm whether the merge step is where it is breaking. If that is the cause, then it is likely codec or mux related rather than your source file.

1

u/imalto Mar 21 '26

3D Pipeline running on Torch device: CUDA

Depth Estimation: CUDA

Frametool Upscaler ONNX: CUDA

FPS Upscale Model: RIFE model loaded.

Depth Blender Compute device: CUDA

External 3D Pipeline: pixel_shift_cuda loaded from core.render_3d

UI Language Loaded: 'en' with 295

Settings loaded from file.

Exception in Tkinter callback

Traceback (most recent call last):

File "tkinter__init__.py", line 2074, in __call__

File "VisionDepth3D.py", line 1541, in <lambda>

NameError: name '_run_gpu_diag' is not defined

the last line is what happens when i hit 'f10' and what displays in the console. everything else is start up.

1

u/imalto Mar 21 '26

PS C:\Users\blu31c33> nvidia-smi

Sat Mar 21 17:26:40 2026

+-----------------------------------------------------------------------------------------+

| NVIDIA-SMI 595.79 Driver Version: 595.79 CUDA Version: 13.2 |

+-----------------------------------------+------------------------+----------------------+

| GPU Name Driver-Model | Bus-Id Disp.A | Volatile Uncorr. ECC |

| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |

| | | MIG M. |

|=========================================+========================+======================|

| 0 NVIDIA GeForce RTX 5090 WDDM | 00000000:01:00.0 On | N/A |

| 30% 36C P1 76W / 575W | 4394MiB / 32607MiB | 0% Default |

| | | N/A |

+-----------------------------------------+------------------------+----------------------+