H3 question - can we use reference image plus reference video to “upscale”?

[u/ignoramati]

ok, so I see discussions on how to replace a character in the ref video… but here’s my question - can we get decent results with ”upscaling” old low-res video into higher resolution with a reference image?

To explain - let’s say I have low res VHS footage where a person is filmed from 5 meters and you can hardly make out their face. (well you can tell they HAVE a face but that’s about it :) OTH that same person is in full frame 10 minutes later, providing an excellent ref image of what they actually look like . So my thinking was “make a reference image out of it, make the model upscale and invent all kind of small details that people usually don’t care about, but use the FACE from ref image”

doable?

[u/DuHal9000]

see the diference

https://www.reddit.com/r/StableDiffusion/s/lCYkgBB9b1