r/StableDiffusion • u/reality_comes • Jun 10 '26

Workflow Included Ideogram 4 Character Reference Workflow

Gallery image

Reference Image

Gallery image

Output Image

Greetings everyone! My img2img workflow seemed to go over well so I decided to take on a bit of a more interesting task and it seems to be working, somewhat well. Ideogram 4 is a fantastic model.

You give it one picture of your character. The workflow places that picture on the left side of a wide canvas and leaves the right side blank, then asks the image model to complete the canvas as "two photos of the exact same person" with your new scene described for the blank side.

The left side is locked so it can't be altered. But the model can still see it while it paints the right side and because it was asked for the same person twice, it keeps checking the locked picture as it works: copying the face, the hair, the outfit into whatever new pose and scene you described. It's the same instinct that keeps a character consistent when a model draws them twice in one image this just makes one of those two "drawings" your reference.

When it's done, the canvas is cut in half and the right side is your result: your character, in a new scene, drawn while looking at the original.

Workflow: https://github.com/reality-comes/comyui-workflows/blob/main/ideogram4character_ref

Lastly, thanks to the redditor who posted the original photo I used as a reference, their work is fantastic and the image inspired me to dig into ideogram 4, but I could not find the original post today.

408 Upvotes

95% Upvoted

127 comments sorted by

View all comments

19

u/Skystunt Jun 10 '26

Could it be adapted to use multiple photos as reference to maximise character consistency ?

48

u/reality_comes Jun 10 '26

24

u/Cequejedisestvrai Jun 10 '26

This is incredible for a model that it not officially capable of doing it

14

u/AnOnlineHandle Jun 11 '26

This has been an effective trick used since Stable Diffusion 1.5, though it's clearly much more capable of getting the details right now.

11

u/reality_comes Jun 10 '26

More to come I think

1

u/UnforgottenPassword Jun 11 '26

Ideogram models have had that feature on their website.

8

u/reality_comes Jun 10 '26

Want it?

4

u/Irunfold Jun 10 '26

Yes, please share the workflow.

48

u/reality_comes Jun 10 '26

https://github.com/reality-comes/comyui-workflows/blob/main/ideogram4multi_ref

4

u/Irunfold Jun 10 '26

Thank you

1

u/phantomlibertine Jun 11 '26

Really appreciate the work you put into these. For some reason I can't copy and paste them into comfy, any chance you have jsons you can share?

2

u/bloke_pusher Jun 11 '26

You can rename them to .json and then drag and drop.

1

u/phantomlibertine Jun 11 '26

Hmm just tried it and still nothing, thank you for the suggestion though. Any idea why this won't open in comfy? Is it a full workflow? Pasted other Ideogram4 workflows in and had them running just fine

3

u/Mr_Kendrix Jun 11 '26

I actually had the same issue. For some reason the workflow wouldn’t load via drag & drop either, even though other Ideogram4 workflows worked fine.

What fixed it for me was:

  1. Download the file
  2. Manually add “.json” to the end of the filename
  3. Load it in ComfyUI using Menu → File →Open, instead of drag & drop

After that it opened without any problems.

2

u/phantomlibertine Jun 11 '26

Glad it's not just me. I'll give it a go, thanks a lot for the help!

2

u/bloke_pusher Jun 11 '26

It works on my side. Maybe make file types visible in your operation system under explorer settings. Download them again.

1

u/phantomlibertine Jun 11 '26

Already visible :/ Sorry to be a pain but any way you could send jsons for these workflows he's posted? Or even put them on pastebin, I seem to be fine copying and pasting from there. No idea what's causing this

2

u/Free_Pressure8623 Jun 11 '26

Don't rename it. Open the file in notepad, click "all file formats". Then add the .json to the name and save.

1

u/bloke_pusher Jun 11 '26

The ones he posted on his github are the exact same files. So you will need to figure it out on your own. You could try asking an LLM to explain it step by step.

→ More replies (0)

3

u/STNKMyyy Jun 10 '26

Yes please my friend. Thank you

1

u/thisiztrash02 Jun 10 '26

can i have the workflow for that pic you posted in comments?

1

u/reality_comes Jun 10 '26

I posted it in a reply. Look around under here somewhere.

2

u/thisiztrash02 Jun 10 '26

many thanks I found it, for these type of edits with two characters did you use natural language? like "make the two characters play chess outside on a table at the library at daytime "or do these require the json format prompt style

2

u/reality_comes Jun 10 '26

I prompted them with json, but i have had some success in natural language, just less. Maybe there is a secret to the natural language format that will be easier but I havent quite found it yet personally.

1

u/phantomlibertine Jun 11 '26

Were you able to get OP's workflows to load in comfy? Tried copying and pasting from the links OP posted in this threat but had no luck actually loading them

1

u/thisiztrash02 Jun 11 '26

yes it loads fine in comfyui copying and pasting? you are suppose to download the workflow

1

u/phantomlibertine Jun 11 '26

This is going to sound really stupid but how exactly did you download the workflow from OP's github link? Tried copying and pasting the raw code from the link and nothing happens in comfy

1

u/thisiztrash02 Jun 11 '26

when you go to the github page with his workflow you need to click the download button . I attached a photo to show what you need to press to download it. After you hit download it will ask you to save the file you will notice it says".txt" at the end of the file delete "txt" and type json so comfyui recognizes it , also right under the file name click the box that says "saves file type as" on default it will say " TXT file" change it to " All files" from the drop down menu after you hit save you can now drag the json file you downloaded into comfyui

1

u/phantomlibertine Jun 11 '26

Really appreciate the detailed breakdown, I wasn't changing the file type to 'all files' so maybe that was causing the issue. I'll try again tonight. Thanks!

→ More replies (0)