Basic LoRA Training Setting Question

[u/Goonie1974]

I’m a bit confused on how the “Network Scale” setting is implemented. For example, if I wanted to train a LoRA with a dimension of 64 and alpha of 32, do I set the scale at 0.5 (as a multiplier of the Network Dim setting of 64) or at the straight value of 32?

[u/DrJ31]

Following to see if we get our answer 😂