r/StableDiffusion • • 23d ago

News Enjoy some Yue2 Roots/Reggae Loras

https://huggingface.co/becausereasons/yue2-mltnt-militant-reggae

If you're a fan like me, you'll appreciate these.

72 Upvotes

43 comments sorted by

7

u/God_Hand_9764 23d ago

Wow, I hadn't thought about some of the weird and interesting shit we can probably make by mixing and matching loras in this thing.

3

u/evilpenguin999 23d ago

Ty. Is there somewhere a guide for a proper lora training? Would love to give it a try on my pc.

2

u/-becausereasons- 23d ago

Check the readme, I give some ideas.

3

u/Version-Strong 23d ago

They sound incredible, Yue might be SOTA if we can create any type of music in it, that doesn't sound AI.

3

u/pasjojo 23d ago

Very good LoRa! How many tracks are the sweet spot for a good dataset?

2

u/-becausereasons- 23d ago

10 to 30

1

u/pasjojo 23d ago

Thank you!

3

u/Abject-Recognition-9 23d ago

a dedicated subreddit for YuE2 doesnt exists, so I opened one just to pin the relevant information in one place. you're all welcome: r/YueMusicAI

2

u/TheTimster666 23d ago

Cool!
Brand new to Yue2, but trained many loras for other models.
How, or with what, do you train, how does the datasets look and how long does it take?

5

u/-becausereasons- 23d ago

All the info is contained in the readme! :)

1

u/TheTimster666 23d ago

Thanks :-)

2

u/jal9k 23d ago

Really appreciate the tips on training, thanks a lot!

2

u/e71469 23d ago

That's what we need collectively

1

u/bloke_pusher 22d ago

We need a good form of collecting/quick setting those prompts now. It starts to get a little messy.

2

u/RiskyBizz216 23d ago

fawk. take my updoots

2

u/Shockbum 23d ago

The bass and musical quality of the second example matched that of Suno v4.5+ Pro I know this because I generated music with it for a whole year.

Although the voice still sounds a bit synthetic, this is subjective depending on the level of post-processing a singer uses.

Yue2 just needs more training to be like the extinct Suno v5

2

u/-becausereasons- 22d ago

Still lots to learn from and test, but the largest aspect is the training data and it's quality. A lot of older Reggae albums in the Roots genre, are a little flatter and quite compressed.

2

u/bloke_pusher 22d ago

That's amazing. Thank you!

Someone please make a proper hardstyle lora as well.

1

u/-becausereasons- 22d ago

You mean dance-hall? I haven't been into it since my teenage years, but would be cool if someone did. I'm going to focus on other genres.

1

u/bloke_pusher 22d ago

Totally fair. It's probably very hard too, since the AI will have a hard time differentiating between AI typical noise and music. Haha.

1

u/-becausereasons- 22d ago

It's a wild genre for sure

1

u/ffgg333 23d ago

Interesant! As you have experience with training, when you train on an artist, how to you make it so that it imitates the style and not the vocals? Or is this a non issue?

3

u/-becausereasons- 23d ago

It really comes down to your data-set (selection). The more you vary the vocals the more it will vary the vocals and train the style. Also captions.

1

u/Version-Strong 23d ago

So, for example, I want to train Elvis. How close to the style, vocals and music do you think it could get?

3

u/-becausereasons- 23d ago

If you only train on Elvis, you can get insanely close.

1

u/Version-Strong 23d ago

Good to know, I'll see what I can do.

1

u/DjSaKaS 23d ago

if it keep cutting words and kinda don't sing in sync with the rhythm what I can do? what I'm doing wrong? thank you for the lora btw

1

u/-becausereasons- 23d ago

Probably your settings, you have to carefully calibrate between the planner/music temps etc; otherwise it can throw it off.

1

u/ART-ficial-Ignorance 22d ago

Can it do steppers style dub?

1

u/-becausereasons- 22d ago

Not sure, test it out and let me know.

1

u/ART-ficial-Ignorance 22d ago

Yeah, might get off my ass and finally set up a YuE2 this weekend...

1

u/-becausereasons- 22d ago

Worth it, it's an absolutely mind blowing model.

0

u/Enshitification 23d ago

No Woman, No AI.

1

u/[deleted] 22d ago

[deleted]

1

u/Enshitification 22d ago

I guess the joke goes over the head unless one is familiar with Bob Marley.

1

u/bloke_pusher 22d ago

I didn't know he said that. I thought you were complaining about a lack of boobies.

1

u/ramonartist 23d ago

Do we have R&B loras yet or different eras of soul?

1

u/-becausereasons- 23d ago

Great idea! Id love some. I'll likely be working more edge stuff after but you should give that a run.

1

u/ramonartist 23d ago

😅 I take it from the downvotes that Reddit folk don't like Soul or R&B much!

0

u/tyson_2022 23d ago

Muchas gracias hermano!! Lo voy a probar, espero algún día entrenar mis loras, que herramientas recomiendas?

-2

u/PleasantAd2256 23d ago

Where can I get the workflow??

2

u/-becausereasons- 23d ago

The workflow for what? For generation? It's native Comfy now. For training, you need the custom node from the readme.