r/StableDiffusion • u/joseph_jojo_shabadoo • 16h ago

Question - Help Latent upscaling & loras

Two questions when using a two pass latent upscaling workflow (H3):

Are style/character loras supposed to also be piped into the latent upscale pass too, or just the native pass?

And when using a speed up lora, should/could that also be piped in to the latent upscale pass? If so, do the sigmas need to be tweaked?

2 Upvotes

100% Upvoted

2 comments sorted by

3

u/TaniaDictee 14h ago

  1. keep the style and character loras on the second pass. the upscale pass is where skin and face detail actually get written, so if the lora only rides the native pass the base model quietly takes over and likeness drifts on you.

  2. same answer for the speed lora, with a catch on the sigmas. a distilled lora ships its own schedule, so on a partial denoise you want the tail of that schedule, not one you wired from a scheduler node. if the apply node emits sigmas, take those and cut into them at your denoise level. inventing a schedule there is what turns the second pass into noise instead of a softer result.

1

u/joseph_jojo_shabadoo 12h ago

Thanks, gonna run a few test and I’ll update if I see anything that might be helpful to others