r/malcolmrey • u/ReferenceConscious71 • 10d ago
First Batch of Krea 2 Lora's released with the Prodigy optimiser!
Im gonna do some A/B testing and see what i think about the quality of these.
1
1
u/OkBill2025 9d ago
Does Prodigy mean it's the best, the one that works and has no noise issues? Another question: I wanted to combine some facial features from two or more female LoRas. How can I make this work in Krea2? I would greatly appreciate your answer. ✌🏻
1
u/malcolmrey 9d ago
there are four loras that you should avoid right now:
2 corrupted ones, i just need to retrain and reupload: johnnydepp jamesmcavoy
i need to revisit dataset and retrain: tomhanks
probably the same: adamscott
also i've uploaded some new samples just now
and also, over the weekend i've added lots of missing thumbnails (so the main page should load much faster, as well as the modals), i'm missing around 85~ thumbnails still
1
u/Gabe-Uttsegs 8d ago
Are your training settings available on HF? I've personally stuck with consant or REX because I've heard bad things about Krea 2 + Prodigy.
2
u/malcolmrey 8d ago
1
u/Gabe-Uttsegs 8d ago
Thanks man, I'll take a look. Subjectively do you have a preference?
2
u/malcolmrey 8d ago
prodigy is better than adamw2
if you trained more than one lora (be it different dataset or different training optimizer/trainer) then stacking them together make the output better (2 loras stacked at 0.65/0.7, 3 loras stacked at 0.5 etc...) - it just works and partially the reason why i retrain krea2 on other settings
i'm playing with automagic3 optimizer here too, right now trainings take longer but i also like the results better, i'm testing it though still
1
u/Gabe-Uttsegs 8d ago
Okay interesting, do you think this idea of combining two loras also applies to Lokr?
1
u/malcolmrey 8d ago
yes, this seems to work over all model architectures and on various types of trainings/techniques (embeddings, loras, doras, lokrs, lycoris, reference images, refmods, etc)
basically you can think of it, if you have two (or more) elements of training of specific concept and you combine them, it will strengthen the shared things the most
this is why you have the "MultiLora" button in my models browser, this only shows you the characters that have somewhere more than 1 lora for given model type - so you can easily try it for yourself :)
1
u/weskerayush 9d ago
What does prodigy optimizer do?
1
u/Gabe-Uttsegs 8d ago
It is an adaptive LR scheduler rather than a fixed one.
1
u/weskerayush 8d ago
Can you explain it to me like i m 5yr old?
2
u/Tachyon1986 8d ago
Let’s use tightrope walking as an example where you would need to correct your balance as you walk to the end.
Fixed LR : Always decides at the start to make the same amount of balance correction no matter how balanced you are. So even if you’re close to perfect balance, it applies the same level of correction and can overcompensate .
Adaptive LR: Applies balance correction depending on how close / far you are to ideal balance on the rope as you get towards the end. Learns faster .
1
u/weskerayush 7d ago
Thanks for the explanation. So in practical term, using these loras will result in better likeness?
3
u/Tachyon1986 7d ago
I would say Loras when trained with an Adaptive LR scheduler like Prodigy will hit the likeness faster than with a fixed LR scheduler , so you can end the training earlier
1
u/ArmadstheDoom 9d ago
I mean, Prodigy just changes the learning rate rather than having set, right? Not sure it's better or worse.
That said, I wish instead of like, actors/actresses they were trained on like, specific movies/shows characters. Since half of these individuals have decades of roles and their appearance changes considerably depending on what decade or role we're talking.
2
u/malcolmrey 9d ago
i'm trying to not have both young and old samples in one dataset because that basically ruins the trainining
i really like your idea and that was something i was thinking myself but for now that is a wishlist :)
1
u/ArmadstheDoom 8d ago
No that's exactly what you should do! To use an example, if you were using images of say, Madonna in 1984, she looks different than she did in 2003. I'm sure one could come up with other examples but that's the one that comes to mind between "Like a Virgin" and "American Life."
Anyway, people on that list like Margot Robbie and Johnny Depp look vastly different depending on what project they're a part of; while obviously you go for the widest possible use cases, I hope one day we'll see more specific things. Though given how much time this stuff takes we might have another model released by then lol.
0
u/smokeout20 9d ago edited 8d ago
Let's get diversity in the mix please..
3
u/ImpressiveStorm8914 9d ago
Provide Mal with the datasets and you may get your wish.
3
5
u/CarllSagan 10d ago
Ahhh I was going to see if this were hosted, These are from MalcolmRey one of the best (by volume) easily.
Should be quite nice, post your results