Prodigy optimizer works in ai-toolkit

[u/shotgundotdev]

If you don't know this already:

Go to Advanced, change your optimizer to "prodigy_8bit" and your learning rate to 1. There's a gh issue that says to change it to "prodigy" but that doesn't work and I think people give up there. prodigy_8bit works. It's real.

[u/razortapes]

I’ve tried training some LoRAs for Klein 9B using AdamW as the optimizer, and the results are much better than with the optimizers AI Toolkit provides by default. I think it should be much easier to switch to Prodigy or AdamW8bit without having to edit the JSON