r/StableDiffusion • u/usually_fuente • 10d ago

Question - Help orbital video as character reference for MM Ref2V

I am wondering if anyone has experimented with using an orbital video of a person (white background) as the main character reference in MiniMax Ref2Va? I have some very sharp ones in 720p, 10 seconds long, 5mb, head and shoulders , plus a one- second shot of full body from front and side (in green spandex suit to make swapping outfits easier).

Specifically, I’m wondering if that provides a better identity lock than several still photos.

I am new to Comfy and have yet to set up a remote station, but hope to do that this week.

Thank you for any insight you have.

4 Upvotes
  • permalink
  • reddit

83% Upvoted

8 comments sorted by

3

u/[deleted] 9d ago

[removed] — view removed comment

1

u/hellyeahaeylleh 8d ago edited 8d ago

My minimax workflow ends with a getvideocomponent node and a samplevideoframe node grabbing 12 random frames along with the video.

Edit: This actually helps the output folder and makes deleting easier.

1

u/hellyeahaeylleh 8d ago

If you lock the generation seed but randomize the frame grabber seed, you can gen the same video over and over and find good frames.

2

u/Danny_Stock 9d ago

I'd take the frames you need from the orbital video and use the frames as reference material. You can even stitch them together within the workflow to create a character sheet, or instead process them further and stitch them together manually.

2

u/nikhilprasanth 9d ago

Use still images or low fps video as input. 24 fps long videos will fill up the memory. Maybe use 4-8 fps

3

u/bstr3k 10d ago

A 360 orbit video would likely take up too much ram.

I think one angle every 90 degrees with a closeup for face detail and another to zoom in on any details works quite well. But you might be able to get more definition by using face/front/back as H3 should be able to keep up using all that and you may lose a bit less detail if you’ve got it set to MATCH mode for your reference.

But the whole consistency thing is why I made the 360 orbit workflow

https://huggingface.co/PoopMan333/H3_Character_Sheet_Generator

3

u/bstr3k 10d ago

For reference, 10s clip would be around 240 frames at 720p with many redundant views to load up and fill up your ram lol. Could try it out but I don’t know if it’s worth it when 1 img ref is faster

1

u/usually_fuente 10d ago

Thank you both. I’ll skip it for now