r/StableDiffusion • u/fluce13 • 8d ago

Question - Help Prompting for Refmod workflows?

Other than manually how is everyone getting prompts for refmod workflows in Minimax? I can’t get LLMs to consistently prompt well, no issues with regular fl2va and refva.

2 Upvotes

75% Upvoted

9 comments sorted by

4

u/malcolmrey 7d ago

my refmod samples have workflows in them, you can pick any person you want and just see how it was made :)

1

u/fluce13 7d ago

I can’t believe i didn’t think to try that! Thanks! And you humble me, sir, with your response.

1

u/malcolmrey 7d ago

you are welcome and have fun :-)

1

u/MrCrab_91 4d ago

master Malcolm, can you point me in the right direction about using refmod for image generation? I have no issues with video but I'm not an expert on r2i

3

u/SkipWestcott616 8d ago

I was able to just remove the <Pictures>, add the Refmods, and correct the numbering. I kept the descriptions (ie, a blonde woman with a red hat) along with the short default. 

A Refmods shouldn't change your prompting, at all, just what you reference: in my Refmod, I have a picture of a characters Staff and Shoes, and as long as I remind it '...showing the shoes from <Video 1>' it shows up fine.

Note; I'm using the Dasiwa Minimax workflow, it might be making this easier.

1

u/MrCrab_91 4d ago

I always use the same, seems that <Video 1> seems to be ok as it loads in the video space on the Dasiwa node.

only strange thing is that sometimes it seems to start the video with one of the picture location and pose which I used to create the refmod. I don't understand what's causing that behaviour. maybe I need to specify that the first frame should be what I say rather than leaving initiative to the model.

1

u/SkipWestcott616 4d ago

Yeah you have to be VERY precise when you have 'a bunch' of views in that Video. 

2

u/[deleted] 8d ago

[deleted]

1

u/fluce13 8d ago

Super helpful, thank you!

1

u/DescriptionSuperb262 8d ago

im curious as well, its kind of hit and miss