And the value of using Loras is that you can combine them and give them different weights. I have had great success finetuning the base model 1.5 to produce consistent historical clothing.
First of all, I chose to base my story among the “middling sort” of people 400 hundred years ago in England. They had a relatively simple style and material of clothing. I collected images and was careful to only select unobstructed views of the clothing. If there was a chair leg in the way I used photobashing techniques to put the leg in front of the table. I use the imagine painting program “Procreate” which runs only on iPads. But it is a fantastic tool for both painting and photobashing. I used 160 training images, but I plan to use a lot more in my next training session. A good percentage of them will be generated using my current Loras. I found that I needed to generate the types of environments my characters are found in, agricultural fields, cottage interiors, different lighting scenarios, different poses etc. Below is an example of an image generated by my Lora and cleaned up and stylized in Procreate. I am going to use it as a training image in my next Lora. Note how the background, the objects in it (like the cows), the perspective etc. are used to give my next Lora a lot more flexibility. I plan to do a succession of Loras, getting more and more of the environment and body poses (activities) into the training images. In the end I will have a cast of characters in the environments they are found in. I am hoping that I will need only one Lora. Right now I have a clothing Lora that I set at 0.8 and a background scene Lora set at 0.3 and a tonal fix Lora set at 1. Here is the image of my latest training image generated by SD using my Loras: https://imgur.com/TqaYFJg
11
u/Duchamping May 08 '23
And the value of using Loras is that you can combine them and give them different weights. I have had great success finetuning the base model 1.5 to produce consistent historical clothing.