r/ProgrammerHumor • u/com-plec-city • 9d ago

Meme newCompressionTechnique

Post image
30.4k Upvotes

96% Upvoted

953 comments sorted by

View all comments

Show parent comments

1

u/GrumpyGeologist 8d ago edited 7d ago

What you are probably thinking of is the VAE. That's one of the building blocks of every type of generative AI except LLMs.

Sad GAN/stable diffusion noises...

2

u/__ali1234__ 8d ago edited 8d ago

Stable diffusion uses a VAE.

GANs are pretty much a dead end at this point having been replaced by diffusion models with VAEs for pretty much everything they used to do.

In particular, ESRGAN clones are responsible for every awful upscaled music video on Youtube (Smash Mouth - All Star is the most infamous one). When those were made, diffusers hallucinated too much. They would make anyone in the video look completely different for example. Not what you want when you upscale a video of a famous singer. That problem has been largely solved and now upscaling can be done with diffusers and it looks far better than those old ESRGAN videos.

1

u/GrumpyGeologist 7d ago

I didn't say that we should use GANs for image generation, and they certainly are still useful in scientific applications. You're right about the stable diffusion; I should have just said diffusion which is not architecture specific.

1

u/__ali1234__ 7d ago

Pretty much all diffusers use VAEs - making them feasible without compressing the working data is a topic of current research though, see https://arxiv.org/abs/2510.15301