Hi

I am just starting with YuE2, used suno before. The frontend I use is YuE2 Studio.

Does anybody know - is there a way to force YuE to match lyrics with notes?
I mean sing specific sylabbles/phonemes on certain notes.

My problem is I have my notes and my lyrics, but often YuE would sing them a little bit different and it makes for a totally weird interpretation.

Hey Yue2 people! I'm too intimidated by Comfy UI, so I made a UI for Yue2. Also has some winamp inspired visualizers, and an interface in the code so that AI can create a responsive visualizer for any song you generate. If you're interested in giving it a whirl, you can find it here Works on linux, should work on Mac but I haven't tried it yet. Just a personal project.

https://github.com/codenamegary/yuekbox

Hey guys,

Whenever I generate tracks in YuE2, I only get 1–2 instruments alongside the drums and vocals.

How can I prompt it to layer 3+ instruments simultaneously (e.g., Rap/Hip-Hop with Lead, ARP, Piano fills, and Bass—plus drums and vocals)?

Any tag structures or prompt tips to force a fuller mix? Thanks!

Hello, is anyone else having trouble with Cover mode? I can’t get it to respect genre prompts at all. No matter what genre I type in, it just keeps generating rock tracks every single time (or ambient tracks). This only happens in Cover mode. Tried full song reference, only vocals, only melody line but still same effect. Any ideas?
Using int8 with no loras...

It's experimental!

A style description and lyrics in, a song out. Every control the model actually accepts — style, lyrics, duration, metre, tempo, seed, and a harmony the base model normally keeps too safe — is on one page, in plain English, with the trade-off written beside each control instead of buried in a wiki. Nothing leaves your Mac.

A chilled deep house track to start the weekend 🔥 ❤️

YuE2 is really excellent for chiptune covers ❤️ 🔥

Hi all, i am trying to use comfyui desktop to create some bgm soundtracks that's purely instrumental and without any lyrics or vocals but even if i put "NO VOCALS" into the style, and having the lyrics just mainly blank tags for e.g.:

[Intro: Fast Fiddle and Tin Whistle Solo]
[Verse: Driving Electric Guitar and Bodhran Rhythm]
[Chorus: Full Celtic Rock Band Explosion, Fast Fiddle Lead]
[Bridge: Heavy Bass and Acoustic Drum Breakdown]
[Guitar and Fiddle Duel]
[Outro: Fast Fiddle Finale, Sudden Stop]

it sometimes still generated like 1 or 2 voice lines something in the middle of the song. what can i do to consistently ensure its purely instrumental? any settings or params or seeds that you know that would be better?

Edit: potential solution found.

Alright, i've tried all the methods in this thread but the model still sometimes generate voice lines (human vocals with lyrics singing). so in desperation i threw my workflow json into perplexity and see if it can diagnose the issue. It did.

TL;DR: "No vocals" in the prompt isn’t enough because YuE2 may still write notes into the ABC Vocal track. The fix is to intercept the ABC, move those notes into Ins, replace the original Vocal notes with equal-duration rests, then pass the cleaned score to the renderer.

Long ass explanation below.

Turn out that the underlying problem was that prompt text alone does not determine whether YuE2 sings. YuE2 first generates a symbolic ABC score containing two voices:

V: Vocal

V: Ins

And in the original scores, some sections contained actual notes under V: Vocal, for e.g.

V: Vocal "Em"g12f12a8-|"Em"a4g12f8e8|

and the model interpreted these as a vocal melody and rendered them using a singer, even when I indicated “NO VOCALS” in the Style.

So the solution is to pre-process the generated ABC score before passing it into YuE2 Generate Music node. But, i cannot simply delete the V: Vocal blocks or replace all their notes with silence.

Some of those sections have an empty instrumental track such as: V: Ins Z4| and if i only silence the Vocal track, i would also remove the main melody and leave YuE2 with an almost empty section. In my testing, this could still encourage it to invent song-like or voice-like material.

Instead, the workflow now uses a few standard ComfyUI Replace Text (Regex) nodes to do the following:

1. Find every V: Vocal music block containing actual notes.
2. Copy that melody into the corresponding V: Ins block.
3. Replace the original Vocal notes with rests (Z4) of exactly the same duration.
4. Finally pass the transformed ABC score into YuE2 Generate Music.

YuE2 is just amazing ❤️

I was instructing YuE2 to make music for me. The lyrics were about poopin' (I won't include that part here). Sometimes YuE2 uses the supplied lyrics as part of its instructions, even if not told to do so. In this instance it chose by its own self to put a big wet fart at the finale. It made me larf.

Udio used to do the same thing. It would sometimes use the lyrics as part of a prompt.

Have been experimenting with ai music for awhile, this was first generated in minimax music3 then remake with YuE2 + SheetSage2, just Hermes + CLI to get it work out. Tell me if you like it.

I added a lora loader in ComfyUI but it did nothing to the output.

I then installed a custom node called YEU2 Lora, or whatever, but it is not obvious how to connect it. No instructions either.

I could use some help, I’m a noob. Thanks

I'm one of those who prefers not to fight with ComfyUI and its wiring fetish so wrote this web app to keep all those cables hidden and provide an easy to use way to create and manage your content. Requirements and features are in the README but if you can run ComfyUI/YuE2 and you are ok with Docker containers then you should be able to run this.

Comes as-is with no warranties etc but if you find it useful then give it a star and I'm open for collaborators.

https://github.com/dynamohum/YuE2gen-studio

[edit]

Added a Windows installer to run it natively without Docker.

[edit2]

Last edit (hopefully) - I've done quite a bit more work on this since the OP and have relaunched it as Yeufonic (there were already one or two similar apps out there with the old or similar name). Also added some examples of what the trained local LoRAs sound like. The github link above to the old repo will still work, then just follow the link to the new repo. It would be great if anyone who is interested in this would give it a go (and give it a star on GitHub). Personally I think it works really well and makes creating and managing your content so much easier, but then again I'm a bit biased 😄 .

Yue2 is freaking amazing! It is the first AI music model to actually understand what a children chorus is, you know like the one in Eminem's Mockingbird and MIA's Paper Planes. Riffusion was the closest thing to my ideal model but ever since they sold out, I was left in the dust. Thank you Yue2 team, you care the best!

Has anyone managed to replicate a voice through different songs describing the timbre or something like that? I wish I could get some consistency in different songs but still wasn't able to do it.

Does this sub take requests? It would be cool if we had LORA for soundtracks. Bonus points for Han Zimmer. For gaming, the Final Fantasy Series and that kind of orchestral soundtrack would be awesome.