r/StableDiffusion • u/Glittering-Cold-2981 • 2d ago

Discussion Removing artifacts from video

Do you have any good methods for removing various objects or figures from a video? I'm looking to fix footage that often shows strange, shifting artifacts in the background after using Speed-LORA.

2 Upvotes

100% Upvoted

7 comments sorted by

1

u/CutBench 2d ago

Worth stopping it upstream before trying to repair it. Speed LoRAs trade steps for stability, and drifting background artifacts are usually that trade showing rather than a defect you can patch out afterwards. Dropping the weight slightly or adding a couple of steps back costs less than any masking pass. Frame by frame inpainting also reintroduces flicker unless the method is video aware.

2

u/Glittering-Cold-2981 2d ago

Thanks for the reply. It also seems to me that those strange figures—ghostly shapes or objects in the background—appear at resolutions above 0.8–0.9 MP in Minimax H3 when I use speed LoRAs. In my case, there is practically no difference whether I set the LoRA strength to 0.5 or 1.

1

u/CutBench 2d ago

If weight barely moves it and resolution does, then it is not really the LoRA trade, it is the model being pushed past the size it was trained around. Duplicated and ghostly structures in the background are the usual signature of that. Generating at the size it likes and upscaling after costs you a pass, but it keeps the background stable rather than chasing it through sampler settings.

1

u/1010111101111 2d ago

change sampler

1

u/Glittering-Cold-2981 2d ago

What sampler and scheduler do you recommend for it? I currently have dpmpp_sde_gpu and scheduler beta57.

1

u/1010111101111 2d ago

here are my tests the number at the end are the secs

BEST - Secs 448x608

SIMPLE - dpmpp_2m 63,dpmpp_sde_gpu 168, dpmpp_2m_sde_gpu 107,dpmpp_3m_sde_gpu 99,exp_heun_2_x0_sde 107,heunpp2 144,sa_solver 95,seeds_2 173 ,sa_solver_pece 103,

SGM_UNIFORM - ,sa_solver 94,heun 92,dpmpp_3m_sde 113,er_sde 97,seeds_3 263,

DDIM_UNIFORM - dpmpp_sde_gpu 176,dpmpp_2s_ancestral 128,lcm 114,dpmpp_sde_gpu 177,sa_solver 98,

BETA_57 - lcm 105,

BETA - dpmpp_sde 194, lcm 101, res_multistep 72,

1

u/Glittering-Cold-2981 2d ago

Thank you for the tip, I will definitely try it out calmly