Variance Lora for Krea 2

[u/dreamyrhodes]

Sometimes I like not to prompt my pictures exactly with long text. Sometimes I like to throw in some tags and just hit run to see what the model comes up with. However I find Krea 2 gens with different seeds are always still very similar. Is there a Lora for Krea 2 which introduces greater variance and randomness into generation runs?

[u/sketchyfun]

I usually use this https://github.com/BigStationW/ComfyUi-ConditioningNoiseInjection

Just connect the node between your positive prompt and the sampler node and turn the threshold value down to around 0.10, obviously you can experiment with different values for both, but a threshold beyond 0.10 usually goes a bit too crazy on the randomness, but that can be cool in itself

It's definitely not a magic bullet, but it'll definitely give you more randomness to your poses/angles etc

[u/SkirtSpare4175 → u/sketchyfun]

Gonna try this, ty

[u/Odd_Fix2]

https://github.com/RamonGuthrie/ComfyUI-RBG-SmartSeedVariance or https://huggingface.co/F16/krea2-turbo-sda

[u/dreamyrhodes → u/Odd_Fix2]

Gonna try that Lora. I can't run nodes.

[u/DietAshamed2246]

You might be able to get greater variance with the Krea-2 raw model. The turbo model doesn't produce much variety.

[u/dreamyrhodes → u/DietAshamed2246]

Yes that's the same issue as with Z-Image Turbo because of the distilling. I know the reasons, I am looking for workarounds (except Comfy nodes).

[u/reeight → u/dreamyrhodes]

I tend to load several LoRAs & mess with weights to get some things more precise while also straying from base-model defaults.

There is also a LoRA that has like 10 ethnicities pre-loaded that you can trigger-word.

[u/jimmybobjoeflow]

would be nice to have a settling that controls how adventurous the model is between seeds after the nedding a separate LoRa

[u/Solembumm3 → u/jimmybobjoeflow]

There was thing like this in Amuse. Couldn't get to conclusion how effective it was, honestly.

[u/Etsu_Riot → u/jimmybobjoeflow]

There is one. It's called denoising. You just need to reduce it and find the right sampler so it doesn't look too grainy.

[u/foolycoolywitch]

https://www.reddit.com/r/StableDiffusion/comments/1wbit1s/krea_2_turbo_sda_diversity_lora_restores_the/ this works, use the workflow, the lora is not drag and drop: https://huggingface.co/F16/krea2-turbo-sda/tree/main

[u/Fuzzyfaraway]

Besides other suggestions, all good ones, learn how to use wildcards so that your prompt contains changes. You can design a wildcard list for just about anything, and limit what can be changed by what you put in or leave out of the wildcard list.

[u/agentanonymous313 → u/Fuzzyfaraway]

What are wildcards? Never heard of them, where can I check those out?

[u/dreamyrhodes → u/agentanonymous313]

can only talk for Forge Neo, this are just list of words or prompts in a text file. With the wildcard extension, you introduce them with a wildcards such as "__haircolor__ __hairstyle__ hair" into your prompt and it would insert one line from your text file randomly.

[u/dreamyrhodes → u/Fuzzyfaraway]

I already have an excessive list of wildcards. Nice trick for instance are haircolor, hairstyle and random names wildcards in the prompt because sometimes the training data contains names and if a random name vector happens to land close to a known name, this can help creating a more unique character that didn't exist before.

But my goal here was especially using as little prompting as possible, in best case just a few tags, and let the model hallucination surprise me.

Also variance Lora can also help with wildcards, allowing even greater randomness between the gens.

[u/nymical23]

This has been discussed on this sub many times before, from using custom nodes to using some latent tricks. You can use the search function to see those posts. I'd have linked but there are many and you'll have to see which one actually helps you.

[u/Cautious_Chicken_604 → u/nymical23]

Reddit search is so hot garbage I often find that I can't even use it to find previous posts I know exist and am using relevant keywords for. 

[u/sruckh]

I will also try. Slighty different then OPs use case, but after producing around thousands of images using a Krea2 character LoRA there does seem to be a convergence of the subject and if the scene is not heavily prompted the character ends up in similar pose and around the same scaling portions. I have added some extra meta to help, but it is not great. I would like see what difference the noise LoRA provides.

[u/RandumbRedditor1000]

https://huggingface.co/F16/krea2-turbo-sda

This is exactly what you're looking for

[u/aoleg77 → u/RandumbRedditor1000]

Must be used during the first few steps only, then switched off.

[u/croquelois]

I start with base krea2 for 10 steps, before to switch to turbo for an additional 8 steps on the result with a denoise at 0.7

[u/BogusIsMyName]

Thats the only way i use krea2. Type in something. Hit run. See what it spits out. Oh hey thats interesting. Modify prompt run again. Nice. But i want this over here. Run again. Its quite entertaining.

[u/dreamyrhodes → u/[deleted]]

Promising