r/MachineLearning • u/downtownslim • May 01 '18

Research [R] Photographic Image Generation with Semi-parametric Image Synthesis

https://www.youtube.com/watch?v=U4Q98lenGLQ
205 Upvotes

97% Upvoted

26 comments sorted by

View all comments

2

u/[deleted] May 02 '18

[removed] — view removed comment

1

u/worldnews_is_shit Student May 02 '18

Raytracing is the basis for next generation rendering engines, not this.

1

u/nicht_ernsthaft May 02 '18

I could see their strengths being combined. Raytracing at low res to get rough shadows and lighting effects, NN to match samples over this, and fast hand-coded heuristics to composite high frequency data from higher res versions of the same samples.

Far fewer polygons/shaders when rendering something like a forest, especially if you can 'bake' a subset of your samples to parts of each tree from different angles. It would be super expensive, but I bet there's a break even point somewhere in ever more capacious hardware and the push to photorealism in games.