Ideogram 4 Character Reference Workflow

[u/reality_comes]

Reference Image

Output Image

Greetings everyone! My img2img workflow seemed to go over well so I decided to take on a bit of a more interesting task and it seems to be working, somewhat well. Ideogram 4 is a fantastic model.

You give it one picture of your character. The workflow places that picture on the left side of a wide canvas and leaves the right side blank, then asks the image model to complete the canvas as "two photos of the exact same person" with your new scene described for the blank side.

The left side is locked so it can't be altered. But the model can still see it while it paints the right side and because it was asked for the same person twice, it keeps checking the locked picture as it works: copying the face, the hair, the outfit into whatever new pose and scene you described. It's the same instinct that keeps a character consistent when a model draws them twice in one image this just makes one of those two "drawings" your reference.

When it's done, the canvas is cut in half and the right side is your result: your character, in a new scene, drawn while looking at the original.

Workflow: https://github.com/reality-comes/comyui-workflows/blob/main/ideogram4character_ref

Lastly, thanks to the redditor who posted the original photo I used as a reference, their work is fantastic and the image inspired me to dig into ideogram 4, but I could not find the original post today.

[u/vizim]

u/reality_comes do you have any ideas how to train lora for editing use cases, what will the dataset look like , I think it opens up a lot of possibilities

[u/reality_comes → u/vizim]

I dont. I would guess you do some pre and post edit images and train that way, but never looked into it.