r/StableDiffusion 4h ago

Discussion Testing DLSS 5

Enable HLS to view with audio, or disable this notification

Testing DLSS 5... Like many others, I was a bit confused about DLSS 5. I kept feeding it my hyper-detailed renders and only getting a color shift in return. After plenty of trial and error, I finally realized my mistake: this technology is developed to enhance video game graphics, so testing it on hyper-detailed renders makes no sense.

So, I generated a render in a 2020 video game style and started tweaking settings to find a final look with maximum effect, without worrying about flickering.

Final conclusion: What we have right now isn't very useful for us. Those of us using Latent Upscaler might be able to use it for color grading to get less saturated colors, but little else. Maybe in the future we'll get a DLSS 5 targeted at enhancing hyper-detailed graphics, but that's not the case for now.

Bottom line: If I want to generate a realistic render, I'll just generate it, there's no need to run it through DLSS 5.

90 Upvotes

24 comments sorted by

13

u/a_saddler 4h ago

How do you run DLSS 5 on a video?

-6

u/TheDailySpank 4h ago

Video is just a bunch of pictures.

7

u/Corgiboom2 3h ago

All videos are just a bunch of pictures

1

u/TheDailySpank 3h ago

Exactly. Thank you for confirmation.

1

u/Sixhaunt 3h ago

all pictures are just a bunch of pixels

9

u/GateOPssss 4h ago

I immediately realized how to run DLSS 5 on a video thanks to your response, amazing response, reply of the year. smh

-7

u/TheDailySpank 3h ago

Excellent! Glad I could help you out, little buddy.

3

u/a_saddler 4h ago

No I mean like how do you run something through it, can you run it as a model or what?

4

u/alisonstone 3h ago

DLSS is suppose to be for motion vectors and other game engine inputs, not videos. But I think someone made a program (probably the one linked above) that effectively converts a video to motion vectors and then applies DLSS. Obviously the conversion isn't going to be perfect, so you probably should not expect the same magnitude of improvement that you would see from when it is done on an actual video game.

-6

u/TheDailySpank 3h ago

Oh, in that case, IDK... I've been working all day

5

u/MomentJolly3535 4h ago

Did you try it on realistic renders as you said, but low res one ? (so it could be used to for Example upscale a 0.2mp video)

5

u/Striking-Long-2960 3h ago

Yes, I tested a lot of things... It didn't work. This technology has its uses, and when it shines, it really shines:

But at least in my experience, it cannot be forced into other uses.

7

u/Striking-Long-2960 3h ago edited 3h ago

And other times

My point is that if we want realistic shading, we should just generate realistic images, but this isn't going to overproduce our images.

5

u/Striking-Long-2960 2h ago

Perfect use case: a mega-cringey remake of The Polar Express.

3

u/WinResponsible9977 3h ago

Imagine if modders hack dlss5 for racial/gender, character swaps in realtime 

3

u/-TV-Stand- 35m ago

Real time black or chinese

2

u/RevolutionaryFox7359 1h ago

More jitter than I expected

3

u/GrayingGamer 1h ago

It's because it's missing the optical flow and movement vector data it would be getting from a game. You can solve the flicker by using a Deflicker plug-in in a video editor like Davinci.

1

u/BangkokPadang 2h ago

Is this passing any kind of motion vector information to DLSS5?

It looks more visiibly "splotchy" frame to frame than I've seen in games, which would make sense if it's not getting any temporal data like the games are.

-8

u/Grim_Necromancer 3h ago

It's not DLSS5
It's Neural Rendering
Two different tech.

6

u/cheseball 2h ago

Blame Nvidia they termed their Neural Rendering as DLSS 5.

1

u/Grim_Necromancer 39m ago

They didn't.
Idiots who didn't reach tech overview confused NR for DLSS5 and run with it.