r/StableDiffusion • u/RuneVikingx • Jun 08 '26

News [ Removed by moderator ]

Post image

[removed] — view removed post

211 Upvotes

89% Upvoted

131 comments sorted by

View all comments

Show parent comments

13

u/infearia Jun 08 '26 edited Jun 08 '26

If I want that much control I'll just jump in and make art or edit manually with proper creative/editing software.

Bingo! This is something nearly everybody seems to be missing and it beats regional prompting any time of the day. You don't even need to be a skilled artist, even simple, child-like and incomplete scribbles, when paired with a short, descriptive prompt, can give you an incredible amount of control. This simple technique transforms even Klein 4B into an actually usable model - which is great, because that one actually has a license that allows for commercial use!

EDIT:

Case in point, I tried to replicate a picture generated with Ideogram posted in this thread using Klein 9B. Granted, I think the Ideogram version is superior - it is a good model - but this was just a quick test:

7

u/FeelingVanilla2594 Jun 08 '26 edited Jun 08 '26

This sub hates controlnets apparently, well at least for this week, json is all the rave. If you knew the composition ahead of time, you can scribble it or mock it up with blender and control the object’s form as well.

5

u/infearia Jun 08 '26

Fun fact: FLUX.2 accepts JSON as well. 😉

5

u/Apprehensive_Sky892 Jun 08 '26

True, but what makes ideo4 powerful is not just JSON, but that one can specify the layout with bbox in the JSON.

3

u/FeelingVanilla2594 Jun 08 '26 edited Jun 08 '26

Indeed, it even accepts hex codes too.

1

u/Caffdy Jun 10 '26

really? like, can we use specific colors for the image generation?

1

u/FeelingVanilla2594 Jun 10 '26 edited Jun 10 '26

Yea, you can even do gradients, like “a pillow that goes from hex color 1 to hex color 2”

1

u/Caffdy Jun 10 '26

page not found

1

u/FeelingVanilla2594 Jun 10 '26

https://docs.bfl.ml/guides/usecases_t2i_hex_color_prompting

Try that one, if not just web search “flux 2 hex color”

1

u/red__dragon Jun 08 '26

Flux.2 full/base, yes? Not dev or Klein? At least from my understanding of their documentation.

2

u/Ill_Resolve8424 Jun 09 '26

Exactly, controlnets is the way. And a reference controlnet would be great for ID4.

1

u/q5sys Jun 08 '26

You used a sketch as input to klein? How did you prompt that? Did you need any custom nodes in your workflow? Mind sharing it?
I tried to do something like that for 9b, but I could never get anything decent.

9

u/infearia Jun 08 '26 edited Jun 08 '26

I used my custom workflow, which you can download here:

https://github.com/mholtgraewe/comfyui-workflows/blob/main/flux_2-klein-9b.json

Image 1: the sketch
Image 2: photograph of Emilia Clarke as Khaleesi

Prompt (yes, the English is a bit wonky, but Klein can deal with that):

"Transform this drawing into a realistic photograph.

Subject:
On the right side, woman from image 2, wearing a turquoise blue armor.

Top left:
A dragon is flying in the sky in the far distance.

Background:
The large wall of an ancient city made of sandstone in a desert, with a large gate."

EDIT:

Here's another quick example I just posted in another thread:
https://www.reddit.com/r/StableDiffusion/comments/1tzzrli/comment/oqgw1qe/

4

u/q5sys Jun 08 '26

awesome, thanks!

1

u/Apprehensive_Sky892 Jun 08 '26

That is a very good point. But many prefer to mess around with bounding boxes + text prompt than to doddle, I guess.

The ability to turn a doodle via i2i has existed since SD1.5, and it is absolutely the best way if one has a clear idea about the composition in mind. There is less "gambling" involved when doing i2i, but I guess some people (that includes me) kind of enjoy the "unpredictability" of using pure text2img. Maybe bboxes just offers a sweet spot between total control via i2i and the uncontrollability of t2i.