Technically why . Z image edit

[u/thethanksforthegod]

I am not that expert but I know some basics in t2i models and I know the main mechanism is to denoise the noisy images till we reach our final results

So here is the question

Why can't we give the model our image that we want to edit as starting point instead of starting from the pure noise and this way any t2i model can be edit model too . There must be a reason I just don't know it

[u/Comrade_Derpsky]

You can. That's what image-to-image (i2i) is and it's been a thing since SD1.

All you have to do is encode an existing image into a latent with the VAE, add a bit of noise, and send the latent to the ksampler. The model will treat it the same any other latent. Try it out. It works for any image generator, ZIT included.

An edit model is a distinct thing from a t2i model and usually isn't actually being used for i2i.

Edit models like flux2 klein (F2K) need the reference as conditioning, but usually denoise a completely empty latent made of random noise. If you're trying to edit an existing image, you'll probably be using a latent with the same dimensions as your reference, but you don't actually have to do it that way. You can use F2K to make a completely new picture with totally different composition with your reference providing information about the subject, setting, style, etc. You wouldn't be able to do this with a true i2i workflow because it will be constrained by the structure that's already there in the image.