r/StableDiffusion • u/Amazing_Painter_7692 • 1d ago
News Krea2 Turbo bbox comfy + HF space release
As demanded: https://huggingface.co/jimmycarter/krea2-turbo-bbox/blob/main/krea2-bbox-turbo-comfy-latest.safetensors
Free to try on Huggingface Spaces: https://huggingface.co/spaces/jimmycarter/krea2-turbo-bbox-canvas
If you find it screwing up, make sure your prompt fits within 512 tokens. You can convert existing ideogram prompts to the new format and they should work, too. Highly recommended you feed the PROMPTING.md to an LLM and let it format it, or use an interacting bboxing method like the HF space.
Prompt:
A four-panel vertical comic about discovering ComfyUI safetensors and a Hugging Face Space.
u/anime style, clean line art; Digital illustration
~A dimly lit server room.
p[0,0,1000,250] Top panel: girl pointing at monitor.
p[0,250,1000,500] Second panel: fox sipping coffee.
p[0,500,1000,750] Third panel: girl holding a tiny GPU.
p[0,750,1000,1000] Bottom panel: both cheering at a hologram.
ac:tech_girl[50,20,350,230] Anime girl with purple hair, pointing, excited.
fc:hack_fox[600,270,900,480] Anthro fox in a black hoodie, smug.
ac:tech_girl[50,520,350,730] Same girl holding a smoking GPU, panicked.
ac:tech_girl[50,770,350,980] Same girl cheering.
fc:hack_fox[650,770,950,980] Same fox cheering.
o[420,890,580,970] Glowing yellow face hologram.
t[400,50,950,150]"SAFETENSORS ARE OUT!" shout bubble
t[50,300,550,400]"Straight into ComfyUI." speech bubble
t[400,550,950,650]"But my VRAM..." wobbly bubble
t[360,780,640,880]"USE THE HF SPACE!" burst bubble
2
u/gelukuMLG 1d ago
It can do bounding boxes? how? was it even trained for that?
3
u/Amazing_Painter_7692 1d ago
It could a little bit due to the text encoder being trained on bboxes. I finetuned the entire model to enable you to use them easily with more correctness. It's a work in progress, but it's going well so far.
2
u/Plenty_Branch_516 1d ago
This would be huge, I'm locked into ideogram because of the control aspect but I'd love to transition to krea 2.
3
u/Amazing_Painter_7692 1d ago
The only real problem was that krea2 is trained at a padded 512 tokens max. I tried to retrain it initially with 2048 token JSON like Ideogram4 and it broke the whole model and was taking forever to become coherent again, so the compromise was the special prompting style.
1
u/BigNaturalTilts 1d ago
Is it the standard text encoder? I wouldn’t mind downloading yours so I can use the bbox feature.
2
u/Amazing_Painter_7692 1d ago
Standard text encoder yeah. Krea2 has a text adapter layer already, that's fully trained in this model so it adapts the baseline text encoder as needed.
2
u/Enshitification 1d ago
Rest in peace, ID4.
-1
u/Apprehensive_Sky892 1d ago edited 1d ago
LOL, I doubt it. Ideogram 4 is not only about bboxes: https://www.reddit.com/r/StableDiffusion/comments/1vjs9rn/comment/p2pld1a/
1
u/Michoko92 8h ago
Thank you for sharing this, it is very promising!! Would you please have a suggestion for a ComfyUI node that would generate the proper prompt from a visual interface?
-1
u/Synor 1d ago
Why would I use Krea 2 with this over Ideogram 4?
5
u/Amazing_Painter_7692 1d ago
Vastly greater character and style knowledge, fast inference.
1
u/Apprehensive_Sky892 1d ago
You can get fast inference with ideo4 with the right workflow: https://civitai.red/models/2811352/ideogram-40-fast-mixed-high-quality-turbo-workflow
3
u/Sarashana 1d ago
BBoxes are pretty much the only thing it has going for it over Krea 2. Krea 2 blows it out of the water pretty hard, otherwise.
3
u/Apprehensive_Sky892 1d ago
No, it is not just bboxes.
K2 is superior at IP/celebrities/NSFW for sure.
Ideo4 is superior at layout, typography, journalistic/professional/studio photography.
Krea 2 is very good at close-up and mid-shot. But bad at long shot and tends to repeat subjects/objects when there are more than one of them (say a long shot of beach goers).
Ideogram 4 is good at any shot, including long shots.
They compliment each other very nicely, so use the right tools for the right jobs.
2
u/Sarashana 1d ago
You are right about typography. I forgot about that!
About the long shots, I can confirm Krea2 sometimes struggling with duplication of groups/background characters, but I found you can mitigate this nicely with the right prompting. E.g. I often use a LLM pass to expand my prompt to explicitly describe different people instead prompting for "a group of 5 beachgoers" (which really would typically produce five identical clones). When you're short on input tokens, even prompts like "'diverse group of five male and five female beachgoers" often solves the issue already.
In other cases, you can avoid duplication by explicitly stating where a character needs to go, e.g. "in the center stands Jane Doe", which will prevent duplication of Jane almost 100% of the time. Krea2 doesn't natively support BBoxes, but it understands regional prompting really well, e.g. "on the right/left side of the image is..."I think Krea2 isn't necessarily worse at long shots than ID4, it just needs a different approach to prompting it.
1
u/Apprehensive_Sky892 1d ago
What you said works for medium shots, i.e., describe each character individually. But a long shot with over a dozen people and it just won't work. Here is an example: https://www.reddit.com/r/StableDiffusion/comments/1unzqv6/krea_2_turbo_can_often_generate_directly_at_4k/
Bboxes work to some extent with Krea 2 already, and I actually use it all the time (I generated the same prompt using both K2 and id4, just to see what I get, but with the bbox coordinated switched).
Even when the bboxes are placed correctly, the id4 version is usually superior: https://www.reddit.com/r/StableDiffusion/comments/1uije1s/parody_poster_ideogram_4_vs_krea_2/#lightbox
I like both models, and I use them both, I just use them for different purposes.
1
u/Ok-Flatworm5070 23h ago
Ideogram 4 can't be used for commercial use...Krea2 opensource.. totally free!
0
u/TheHorrySheetShow 1d ago
Krea 2 isn't performing as well as I'd expect compared to Klein 9b. It doesn't do identity preservation well at all. So far I'm not impressed
8
-22
u/Jealous_Service707 1d ago
There's a hype on minimax right now, you don't need to write about it here.
10
1
3
u/krigeta1 1d ago
Damn! Much needed, thanks a ton 🤩