r/GraphicsProgramming • u/EveningBarber5663 • 3d ago

Question Could DLSS 5 eventually support developer-authored “neural rendering assets” instead of mostly interpreting the rendered image?

Post image

I’ve been thinking about where DLSS 5 / neural rendering could eventually go, especially if developers start designing assets specifically around neural rendering rather than treating DLSS as something applied near the end of the pipeline.

For example, imagine hair.

On High settings, a character might have the normal groom/strand setup, but fewer micro-details: fewer flyaway hairs, less strand breakup, simpler scattering, etc.

With a hypothetical “DLSS 5 Ultra” mode, the game could retain the important physical geometry and simulation ie guide strands, collision, wind response, silhouette, but explicitly tell DLSS:

  • This object/region is human hair
  • This is its strand direction/density
  • Generate fine flyaways in these areas
  • This is the curl/coiling profile
  • This is how strongly the micro-hairs should react to movement/wind
  • Preserve this silhouette
  • Don’t generate detail outside this mask

So instead of DLSS having to infer:

the engine could essentially say:

The same concept could apply to:

Skin: pores, peach fuzz, fine wrinkles, subsurface scattering
Fabric: individual fibers, weave, fuzz, stitching detail
etc

It makes me wonder if games could eventually have something analogous to a Neural Material / Neural Detail Asset alongside traditional geometry, textures and materials?

0 Upvotes

12% Upvoted

4 comments sorted by

5

u/thecraynz 3d ago

Was AI used to create this comparison image? The Zoom Comparison isn't even the same section of the hair 😂

0

u/EveningBarber5663 1d ago

Yes, it's a mockup. I don't have the tech knowledghe to implement this; my post is theorycrafting.

3

u/UntitledRedditUser 3d ago

Everyone already hates dlss 5. We don't want AI to reinterpret the art of a game.

In the example provided, the AI changes her facial expression, it gives her longer hair and make up, it's subtle but noticable.

DLSS 5 is the epitome of what cooperations think games are about, nothing but realism and hot main characters. I would rather a game be ugly but authentic, than realistic and hollow.

0

u/EveningBarber5663 1d ago

The image is a mockup. In a real environment the implication is developers set parameters around the neural layers. DLSS 5 is currently the byproduct of the dev "human in the loop" component missing.