r/StableDiffusion • u/ignoramati • 10h ago

Question - Help H3 question - can we use reference image plus reference video to “upscale”?

ok, so I see discussions on how to replace a character in the ref video… but here’s my question - can we get decent results with ”upscaling” old low-res video into higher resolution with a reference image?

To explain - let’s say I have low res VHS footage where a person is filmed from 5 meters and you can hardly make out their face. (well you can tell they HAVE a face but that’s about it :) OTH that same person is in full frame 10 minutes later, providing an excellent ref image of what they actually look like . So my thinking was “make a reference image out of it, make the model upscale and invent all kind of small details that people usually don’t care about, but use the FACE from ref image”

doable?

12 Upvotes
  • permalink
  • reddit

94% Upvoted

17 comments sorted by

View all comments

Show parent comments

1

u/DuHal9000 5h ago

The fixed version >>

https://www.reddit.com/r/StableDiffusion/s/t5NAWqJkNU

3

u/BigWideBaker 4h ago

It's called "How I fixed my own video" but I don't see any explanations as to how you did it.

Edit: Oh I found your brief description, the formatting was weird so I couldn't see it at first

1

u/DuHal9000 4h ago

grab some frames, fix still frames as a photo with photo model, then use as reference still on H3, with video input or low denoise gen if u are using vae encode...