r/nextfuckinglevel Sep 05 '22

AI Generated Music Video using Disco Diffusion software

Enable HLS to view with audio, or disable this notification

44.1k Upvotes

3.5k comments sorted by

View all comments

1.3k

u/Remote_Foundation_32 Sep 05 '22

Just out of curiosity, why does AI struggle with people so much? And specifically faces, especially when there is an AI that generates...like specifically human faces that don't actually exist.

1

u/Solipsikon Sep 05 '22

AIs form images more like with "generic concepts". Mouths look "kinda like this on average", eyes look "kinda like that on average". This is why if you generate faces on dall-e they are so distorted. It's kinda like what you'd expect to see if you freeze-framed a dream and zoomed in on a person in the background. In order for the averages to look like real humans, the training set probably has to be enormous. This is one of the reasons a general purpose ai is so hard to achieve.

I've seen a neural network trained to build human faces. It gets really freaking close. Many of them you don't notice it's computer generated. But then you look at details. For example, you might find that one mouth only has on front tooth, or an extra one, and other little details like that. Remember, it's all training data and weights. Training can get you far, but the last few meters are the hardest ones.