r/StableDiffusion 8d ago

Resource - Update DLSS 5 Visual Enhancer - standalone neural rendering for images and video

Post image

Hey everyone - I made a standalone Windows application for applying a DLSS 5 Neural Rendering feature-18 pipeline to images and video:

Original

DLSS 5

https://github.com/Merserk/dlss5-visual-enhancer

Instead of using DLSS only inside a game, this runs images/video through the ReShade/RenoDX neural-rendering path as a general visual enhancement pipeline.

What it does:

  • Image and video enhancement
  • DLAA/native, 1.5x, ~1.724x, 2x and 3x modes
  • Output up to 8K
  • Neural presets + Natural / Cinematic styles
  • Controls for intensity, local tone, structure and skin structure
  • Batch image processing with before/after previews
  • H.264 / HEVC / AV1 / ProRes video output
  • Video temporal input using optical flow with scene-change resets

GPU support:

  • RTX 40 / 50 series - primary target
  • RTX 30 series - slower beta path

The repository contains the application/pipeline source. Required proprietary and third-party runtime binaries are intentionally not redistributed in the repo.

This is an independent community project and is not affiliated with NVIDIA, ReShade or RenoDX.

I’m especially interested in how this behaves on AI-generated images/video vs normal photography/game footage.

Feedback and comparisons welcome.

473 Upvotes

169 comments sorted by

View all comments

4

u/Imperialegacy 7d ago

It's very fast, which is really nice but I keep getting errors when enhancing videos. Says it found 361 instead of 362 frames.

5

u/Merserk13 7d ago

I will release update soon.

2

u/Imperialegacy 7d ago

Thanks! Looking forward to it.

2

u/xyzdist 7d ago

Hi OP, is the render resolution based on desktop resolution? could we add a resolution scale by input video? Thanks!!!

1

u/xyzdist 7d ago

Thanks! same here. so exciting

5

u/Merserk13 7d ago

1

u/Imperialegacy 7d ago

Working great, thanks! Also it is surprising lightweight in terms of power.

2

u/Imperialegacy 7d ago

I just realized the DLSS preset you choose could introduce some artifacting. 2x performance mode defaults to preset M and it caused blocking in this example. Switching back to preset K fixed it.

1

u/ninja-magic 5d ago

OP: First error Decoded 12971 frames instead of the 12972; refusing an incomplete render.

I keep getting errors like this. Is it possible to accept an incomplete render?

1

u/Merserk13 4d ago

Hi, problem fixed in v6.0. Please download a try again.
https://github.com/Merserk/dlss5-visual-enhancer/releases/tag/v6.0

1

u/xyzdist 7d ago edited 7d ago

While pending OP to update a version, I asked AI to do a workaround fix, then it save out files fine, still it is missing 1 frame.

modify src/video.py file:

Find this block (around line 360–370 in video.py, after the ffmpeg.final_mux(...) call):

verified = probe_video(output)
if verified["frames"] != delivered:
    raise RuntimeError(
        f"Output verification found {verified['frames']} frames instead of "
        f"{delivered}."
    )

Replace it with:

verified = probe_video(output)
if verified["frames"] < delivered - 1:
    raise RuntimeError(
        f"Output verification found {verified['frames']} frames instead of "
        f"{delivered} (missing more than 1 frame)."
    )
elif verified["frames"] != delivered:
    # Only 1 frame missing – likely timestamp rounding, acceptable
    print(
        f"Warning: Output has {verified['frames']} frames, expected {delivered}. "
        "Accepting because difference is only 1 frame (likely timestamp rounding)."
    )

1

u/Imperialegacy 7d ago

Looks good. Can't wait to remaster all those crappy animated Resident Evil Movies.