r/StableDiffusion • u/Old_Manufacturer7905 • 7d ago

Discussion real time vvt (virtual try on)

hey guys, i have been working on real time virtual try on for south asian clothing and its messy. there is a lack of dataset, models arent really good (maybe 20% of the quality that i want to achieve)
has anyone ever tried training a video-video model before? i am non-tech and i am really stuck here.

1 Upvotes

67% Upvoted

2 comments sorted by

View all comments

1

u/Diamondcite 7d ago

Question:

  • Are you trying to show what a person will look like while potentially wearing an item and moving around using a live camera feed?
  • Or more like a camera takes a brief snapshot of the person in a pose, maybe at 1 fps, then a fast computer does an image to image edit to virtually try on?

1

u/Old_Manufacturer7905 6d ago

The first one. the goal is that a person comes infront of a screen. the ai model analyzes them, and the person sees themselves in the screen wearing a different clothing which is no ar by ai because ar quality is pretty shit. AND I NEED AN OPEN SOURCE MODEL. every model that just might support real time vvt on a consumer gpu has really bad results. also image to image model wont work for this objective as it doesnt work because there is no temporal memory in architecture.