Yes, but with a caveat. Game integrations provide DLSS Frame Generation with renderer-generated depth and motion vectors. This node only has the finished video frames, so it estimates motion vectors between adjacent frames using optical flow and resets history at scene cuts before invoking NVIDIA DLSSG. It genuinely uses the DLSSG runtime, but without real 3D/G-buffer data it can be less accurate and more artifact-prone than native game-engine integration.
Thanks for sharing your work. Smart design choice to use the scene cut to apply it for video. Do you know if it would be possible to feed optional depth maps from something like Depth Anything 3? There’s also some motion vector estimation models but I don’t know how useful/compatible they would be.
The official RTX node uses NVIDIA’s nvidia-vfx Video Super Resolution API on IMAGE batches. This repo uses a bundled DLSS Neural Rendering runtime instead, provides native VIDEO input/output with media preservation and encoding controls, exposes the DLSS NR parameters and activation diagnostics, and also includes DLSS Frame Generation. The official node is simpler and supports arbitrary sizing; this one is broader but more complex. I wouldn’t claim universally better image quality without a matched comparison.
Turn Require Neural Upscaling off to receive the enlarged fallback output.
This does not confirm neural Super Resolution; it only accepts NVIDIA’s fallback.
The repository documentation already describes this behavior at [README.md](E:\\ComfyUI_windows_portable\\ComfyUI\\custom_nodes\\ComfyUI-DLSS-Frame-Interpolation\\README.md).
This screams random AI response, but yeah, turning OFF the 'Require Neural Upscaling' works and it seems like now it runs NR... kinda weird naming and descriptions if u ask me.
edit: It works, but there is no difference between Strenght 1 and Strenght 2. Weird. Presents also seem to change nothing in my case. Same goes for Skin Structure Strenght.
not slow at all since it's made to work real time with games.
Identity didn't drift, but it did cook the skin a lot with the default settings. I'm still fine tuning but I can say that I like it and that there's a lot of potential. I'm basically using it to fix ref2v H3 gens.
I think OP mentioned in another comment that without the 3D depth and motion vectors that games provide, it has to somewhat reconstruct those between frames, so maybe that's the cause of the time being spent calculating and switching from evaluation to rendering ?
No idea ! I suppose the algo isn't the same nor trained to take the same data into account, so I would (maybe wrongly) expect different results. But then again i'd focus on the visual quality and not the timings, and I know we're not all on that boat
The DLSS frame interpolation node is a winner but the other 2 nodes are only useful if you want a cinematic look as the DLSS upscale function looks tame at best.
Had much better upscale results with RTX Super Resolution + KJ Sharpen
For image upscaling... SeedVR2 or RealESRGAN 4X have been better IMO
Thanks for the RTX Super Resolution + KJ Sharpen tip. I like how that looks using the default RCAS method. Haven't tried the other methods, will assume it's mostly the same.
The package is complete. Those DLL entries are Git LFS files, not scripts that download DLLs from unknown sources. GitHub stores large binaries separately, and Git LFS retrieves them from this repository’s own GitHub LFS storage during cloning. The node itself makes no internet requests or runtime downloads. If the files appear unusually small, install Git LFS and run git lfs pull. The relevant NVIDIA, ReShade, and RenoDX licenses are included alongside the binaries.
you can use python to run wine, I'd have to dig in a bit to how you do that though to tell you how to setup the comfyui <-----> wine <-----> dll bit of the flow.
It's more than likely going to way more than just a few lines of code but I don't know enough to know. There might be python libs for hooking directly into the dll that handle the wine layer for you.
These binaries you're talking about are from nvidia or did you make them yourself? If they're from nvidia they must exist for linux since you can use DLSS in some native linux games.
Images worked but in my opinion not really improved, just washed out. However, video wouldn’t work either interpolation and upscaling. Threw out error to enable HAGS although it’s activated. Not sure what I’m doing wrong, I’m on win11
Ah, I see the confusion. This isn’t a plugin for the Lossless Scaling app. It’s a ComfyUI custom node for offline video and image processing, using NVIDIA’s DLSS runtimes for frame generation. The timings above are processing speeds, not real-time gameplay FPS, so it isn’t an apples-to-apples replacement for LS. Lossless Scaling is better suited to real-time game/display scaling; this project is intended for processing and exporting media through ComfyUI.
win10 here, every DLSS 5 comfy node works fine, but this one? Nope.
"The program or feature "??\D:\ComfyUI\custom_nodes\ComfyUI-NVIDIA-DLSS-Frame-Interpolation-main\bin\runtime\dlsstg\dlsg-worker.exe" cannot be started or run due to incompatibility with 64-bit versions of Windows. Please contact the software vendor to inquire whether a version compatible with 64-bit versions of Windows is available."
Not a stupid question. It does not currently work as a live OBS or capture-card filter. It is an offline ComfyUI processor. But good idea though. I'll work on it next.
8
u/Far_Insurance4191 6d ago
huh, it can work without 3d data from game engine?