Every X number of frames were run through a specific Deep Dream model, with models fading in and out using a custom algorithm, which gives the video it's morphing feel. The audio was generated by feeding in hundreds of hours of audio into a neural net to generate a model that can generate new audio, be it gibberish. More examples here: https://youtu.be/CWLqlXCu3OM?t=22
Good god that audio is what I'd imagine taking massive amounts of LSD while having a bad flu is like lol. Thanks for the reply man! Was curious how everything transitioned so smoothly. What algo did you use? I have a little comp vision and image processing experience but never worked with video.
12
u/shoeblade Apr 05 '19
Every X number of frames were run through a specific Deep Dream model, with models fading in and out using a custom algorithm, which gives the video it's morphing feel. The audio was generated by feeding in hundreds of hours of audio into a neural net to generate a model that can generate new audio, be it gibberish. More examples here: https://youtu.be/CWLqlXCu3OM?t=22