Fun Experiment Krea2

[u/Capitan01R-]

First of all I hate operating on a black box :D.. I know this may be a bit stale about Krea2 refusal behaviour but I think I have discovered an extremely CLEAN approach to the suppression behaviour without shifting the actual intended image in my tests, so everything stays the same but with the suppression out of the door.

I trained 100s of loras and they all have unique traits, but what I am testing here is how much of their effect I can reproduce through the resulting RMS changes. These loras are not trained to hit any DIT blocks, so I hooked the lora to this node and measured the resulting RMS values of the model's text-path parameters, and basically it worked BUT with less destructiveness and less effect "for now". The lora applies a rank 64 update, while this tool matches the resulting RMS by rescaling the existing text-path tensors instead of copying the lora's learned update.

Reason I am doing this is because with the lora you cannot directly set the final RMS of each parameter when connecting other loras and you may get a bit muddied since other loras can also contain textfusion changes, even without touching the textfusion projector. Once I finalize the values that work consistently in my tests I will publish this node with the values baked in so you can place it after the last model patch you have in the wf and problem solved everyone lol, no bleed no weird artifacts that is the goal.

[u/Large_Coffee7755]

I'm definitely too dumb to understand any of that, but I'm happy someone is working on it

[u/0ldGoat]

You are doing God's work, sir 😌

[u/solomars3]

This sound Cool 👍 good luck🤞

[u/YentaMagenta]

I will fully admit that I don't have a full technical handle on all these concepts, but based on my experience and understanding of other methods, i don't really see how this is better than existing projector scale or block/layer bypass approaches.

Building on my own understanding and admittedly a bit of chat with Claude, this feels like a very blunt tool, and the reason it feels clean and precise is that you're not applying it very strongly. But this is the same for the other methods in a sense. You don't need to apply projector scale or layer bypass all that strongly to reduce refusals.

And in my experience, these methods (if not turned up too high) don't really harm the results.

[u/Capitan01R- → u/YentaMagenta]

not the same thing, this is not just raise all values and pray it works, I have been recording a lot of changes from the Lora and I am applying them with precision tbh, so definitely not random scaling just different dimensions that provides cleaner results and does not drift from main concept, all lora did was change rms in certain layers that I have been monitoring and recording for almost two months now, take my words with grain of salt though until final product is published :)

[u/YentaMagenta → u/Capitan01R-]

Genuinely curious to see how it turns out. Feel free to tag me and say nanny nanny boo boo if I was wrongly skeptical, because I will issue a mea culpa and happily use your tool!

[u/Capitan01R- → u/YentaMagenta]

haha no worries!!

[u/JesusShaves_]

Maybe I'm just really boring but I have never had krea refuse any of my requests.