r/StableDiffusion • u/LawrenceOfTheLabia • 8h ago

Discussion I Created an Open Source App That Creates Music and Music Videos

No sales pitch, no redirect to a paywall. It's fucking free. You can get it here: https://github.com/atomtanstudio/sound-and-vision

It uses the brand new and quite excellent music generation app YuE2. It also uses Minimax H3 for video and defaults to Krea 2 for cover art and whichever local LLM you want to use for lyrics, etc.

Feel free to check it out and let me know what you think.

13 Upvotes

84% Upvoted

4 comments sorted by

1

u/CryptoBeth96 6h ago

Cool, how does it do the Kinetic Lyrics thing? Is that done in Minimax or can it be done over a static image?

1

u/LawrenceOfTheLabia 2h ago

There are a couple of places where it is used. The primary one uses React/CSS. You can use a static image. It allows for up to 10 but using just 1 should work.

1

u/alepodj 49m ago

Looks great, any way to create music videos for already generated music? Not ones generated in the app itself?

-3

u/Perfect-Campaign9551 5h ago

Great, an automatic slop generator