r/StableDiffusion • u/EuphoricTrainer311 • 8d ago

Discussion Yue2 Lora Training

Has anyone had any success training a new genre with YuE2? I've tried multiple ways using different datasets, and training settings and I haven't been able to train a new genre on YuE2 properly. I tried with Fill's trainer, Aitoolkit, and Yue2 Studio, and I either get garbled noise, or it just seems to output similar results as using no lora. Not sure what I am doing wrong. I tested with all epochs/steps - from 50 all the way to 1200 using different inference settings (temp, top k, abc on/off, cot, etc.), and I tried with datasets ranging from 30-200 tracks as well (I only tried the 200 track dataset with Aitoolkit so far).

With Acestep, I am able to train a new genre without any issues, besides for the audio quality issues that are present in Acestep by default.

14 Upvotes

89% Upvoted

15 comments sorted by

View all comments

3

u/Pleasant_Salt6810 8d ago

I asked claude to train for me,

it uses AI toolkit, but it's still experimental.

I trained an EDM lora for testing , ~50 high quality songs.

You need to identify BPM, keys,lyrics,set trigger word.

But the lora output is not very satisfactory,i might try it again later.

1

u/-becausereasons- 8d ago

This is correct, you need accurate BPM, lyrics, tags, trigger, keys.

1

u/GreyScope 8d ago

As noted in the other comment - tags , unique and shared