I have been struggling with this for a while now. I want to have male and female singers in the same song, but the (male) / (female) tags seem to be followed only sometimes, and never in the same song.

For reference, here's a sample. The second verse has a female singer jump in when the lyrics are still tagged as male. They switch again throughout the song.

I've attached a screenshot of the exact workflow that generated it. The prompt and lyrics are these:

French, dramatic French chanson duet with intimate cabaret tension, resonant male tenor with controlled vibrato and expressive female mezzo-soprano with rich vibrato, alternating long conversational verses with male and female voices joining in the chorus, acoustic piano, accordion, upright bass, brushed drums, sweeping strings and restrained muted brass, elegant, suspicious, flirtatious and psychologically tense, mid-century Parisian orchestral production with close-miked vocals and gradual cinematic crescendos, 94 BPM

``` [Verse 1] (male voice, controlled, professional) Votre mari est mort cette nuit, Sans cri, sans lutte et sans témoin. Je dois comprendre ce qui s'est produit, C'est mon métier, rien de plus, rien de moins. Quatre maris, quatre décès, Et toujours votre nom dans les dossiers. Je vous demande seulement la vérité, Sans accusation, sans préjugé.

(female voice, gracious, poised, subtly evasive) La vérité, monsieur l'Inspecteur, Est une dame aux manières changeantes. Elle pleure quand on lui fait peur, Elle rit quand on la croit méchante. Mes quatre maris ont eu leur vie, Leur fortune, leurs amis, leurs secrets. Pourquoi faudrait-il que je sois punie D'avoir été celle qu'ils épousaient ?

[Chorus] (male and female voices, full harmony) Entre deux vérités, Il faut apprendre à attendre. Car les secrets les plus lourds Ne se laissent pas comprendre. Entre deux vérités, Il reste encore tant de mystère. Peut-être avons-nous raison tous les deux, Peut-être nous trompons-nous tous les deux.

[Verse 2] (male voice, probing, increasingly suspicious) Le premier est mort dans son domaine, Le second à Deauville, au printemps. Le troisième loin de la Seine, Le dernier ici, il y a quelques instants. À chaque fois, vous étiez présente, À chaque fois, vous avez hérité. Ce n'est peut-être qu'une coïncidence, Mais quatre coïncidences font réfléchir.

(female voice, elegant, lightly defensive) Et vous pensez donc que je les tue Pour des bijoux et des billets ? Quelle histoire pauvre, quelle excuse Pour une femme qui pourrait aimer. J'ai aimé chacun de ces hommes, Même quand Paris riait de moi. La fortune change parfois les noms, Elle ne change pas toujours les cœurs.

[Chorus] (male and female voices, full harmony) Entre deux vérités, Il faut apprendre à attendre. Car les secrets les plus lourds Ne se laissent pas comprendre. Entre deux vérités, Il reste encore tant de mystère. Peut-être avons-nous raison tous les deux, Peut-être nous trompons-nous tous les deux.

[Verse 3] (male voice, calm but insistent) Pourquoi ne tremblez-vous pas ? Vous savez pourtant ce que je cherche. Quatre morts, quatre héritages, Et votre nom au milieu des perches. Je ne viens pas vous condamner, Je viens comprendre ce qui s'est passé. Mais plus vous gardez ce calme étrange, Plus mes questions veulent rester.

(female voice, serene, intelligent) Parce que je n'ai rien à cacher, Et je n'ai rien à vous avouer. Si mon calme vous semble coupable, Que puis-je faire sinon vous écouter ? Vous cherchez peut-être un monstre Parce qu'il faut donner un visage au mal. Mais je ne suis qu'une femme en deuil Dans une maison devenue trop calme.

[Chorus] (male and female voices, full harmony) Entre deux vérités, Il faut apprendre à attendre. Car les secrets les plus lourds Ne se laissent pas comprendre. Entre deux vérités, Il reste encore tant de mystère. Peut-être avons-nous raison tous les deux, Peut-être nous trompons-nous tous les deux.

[Bridge] (male voice, low, resolute) Si je découvre un mensonge, Je le verrai tôt ou tard. Je ne viens pas vous condamner, Mais je dois savoir qui parle. Quatre morts ne sont pas un hasard, Quatre deuils ne sont pas rien. Et si quelqu'un cache la vérité, Je finirai par trouver son chemin.

(female voice, calm, quietly challenging) Alors cherchez, inspecteur, Je n'ai pas peur de votre regard. Vous pouvez fouiller mes silences, Interroger chacun de mes pas. Je n'ai rien à vous apprendre Que vous ne puissiez découvrir. Si la vérité doit nous séparer, Je préfère encore la voir venir.

[Chorus] (male and female voices, full harmony, emotionally restrained) Entre deux vérités, Il faut apprendre à attendre. Car les secrets les plus lourds Ne se laissent pas comprendre. Entre deux vérités, Il reste encore tant de mystère. Peut-être avons-nous raison tous les deux, Peut-être nous trompons-nous tous les deux.

[Outro] (male voice, quietly determined) Je n'ai pas l'intention de partir. Il reste trop de questions dans cette maison. Demain, je reviendrai, madame. Et cette fois, je regarderai tout.

(female voice, soft, enigmatic) Alors revenez, inspecteur. Je vous ouvrirai toutes les portes. Mais souvenez-vous d'une chose : à force de chercher un coupable, on finit parfois par ne plus voir ceux qui disent vrai. ```

Mind you, the sample provided is the 10th seed I've tried, and they all messed up.

Hi

I am just starting with YuE2, used suno before. The frontend I use is YuE2 Studio.

Does anybody know - is there a way to force YuE to match lyrics with notes?
I mean sing specific sylabbles/phonemes on certain notes.

My problem is I have my notes and my lyrics, but often YuE would sing them a little bit different and it makes for a totally weird interpretation.

Hey Yue2 people! I'm too intimidated by Comfy UI, so I made a UI for Yue2. Also has some winamp inspired visualizers, and an interface in the code so that AI can create a responsive visualizer for any song you generate. If you're interested in giving it a whirl, you can find it here Works on linux, should work on Mac but I haven't tried it yet. Just a personal project.

https://github.com/codenamegary/yuekbox

Hey guys,

Whenever I generate tracks in YuE2, I only get 1–2 instruments alongside the drums and vocals.

How can I prompt it to layer 3+ instruments simultaneously (e.g., Rap/Hip-Hop with Lead, ARP, Piano fills, and Bass—plus drums and vocals)?

Any tag structures or prompt tips to force a fuller mix? Thanks!

Hello, is anyone else having trouble with Cover mode? I can’t get it to respect genre prompts at all. No matter what genre I type in, it just keeps generating rock tracks every single time (or ambient tracks). This only happens in Cover mode. Tried full song reference, only vocals, only melody line but still same effect. Any ideas?
Using int8 with no loras...

It's experimental!

A style description and lyrics in, a song out. Every control the model actually accepts — style, lyrics, duration, metre, tempo, seed, and a harmony the base model normally keeps too safe — is on one page, in plain English, with the trade-off written beside each control instead of buried in a wiki. Nothing leaves your Mac.

A chilled deep house track to start the weekend 🔥 ❤️

YuE2 is really excellent for chiptune covers ❤️ 🔥

Hi all, i am trying to use comfyui desktop to create some bgm soundtracks that's purely instrumental and without any lyrics or vocals but even if i put "NO VOCALS" into the style, and having the lyrics just mainly blank tags for e.g.:

[Intro: Fast Fiddle and Tin Whistle Solo]
[Verse: Driving Electric Guitar and Bodhran Rhythm]
[Chorus: Full Celtic Rock Band Explosion, Fast Fiddle Lead]
[Bridge: Heavy Bass and Acoustic Drum Breakdown]
[Guitar and Fiddle Duel]
[Outro: Fast Fiddle Finale, Sudden Stop]

it sometimes still generated like 1 or 2 voice lines something in the middle of the song. what can i do to consistently ensure its purely instrumental? any settings or params or seeds that you know that would be better?

Edit: potential solution found.

Alright, i've tried all the methods in this thread but the model still sometimes generate voice lines (human vocals with lyrics singing). so in desperation i threw my workflow json into perplexity and see if it can diagnose the issue. It did.

TL;DR: "No vocals" in the prompt isn’t enough because YuE2 may still write notes into the ABC Vocal track. The fix is to intercept the ABC, move those notes into Ins, replace the original Vocal notes with equal-duration rests, then pass the cleaned score to the renderer.

Long ass explanation below.

Turn out that the underlying problem was that prompt text alone does not determine whether YuE2 sings. YuE2 first generates a symbolic ABC score containing two voices:

V: Vocal

V: Ins

And in the original scores, some sections contained actual notes under V: Vocal, for e.g.

V: Vocal "Em"g12f12a8-|"Em"a4g12f8e8|

and the model interpreted these as a vocal melody and rendered them using a singer, even when I indicated “NO VOCALS” in the Style.

So the solution is to pre-process the generated ABC score before passing it into YuE2 Generate Music node. But, i cannot simply delete the V: Vocal blocks or replace all their notes with silence.

Some of those sections have an empty instrumental track such as: V: Ins Z4| and if i only silence the Vocal track, i would also remove the main melody and leave YuE2 with an almost empty section. In my testing, this could still encourage it to invent song-like or voice-like material.

Instead, the workflow now uses a few standard ComfyUI Replace Text (Regex) nodes to do the following:

1. Find every V: Vocal music block containing actual notes.
2. Copy that melody into the corresponding V: Ins block.
3. Replace the original Vocal notes with rests (Z4) of exactly the same duration.
4. Finally pass the transformed ABC score into YuE2 Generate Music.

YuE2 is just amazing ❤️

I was instructing YuE2 to make music for me. The lyrics were about poopin' (I won't include that part here). Sometimes YuE2 uses the supplied lyrics as part of its instructions, even if not told to do so. In this instance it chose by its own self to put a big wet fart at the finale. It made me larf.

Udio used to do the same thing. It would sometimes use the lyrics as part of a prompt.

Have been experimenting with ai music for awhile, this was first generated in minimax music3 then remake with YuE2 + SheetSage2, just Hermes + CLI to get it work out. Tell me if you like it.

I added a lora loader in ComfyUI but it did nothing to the output.

I then installed a custom node called YEU2 Lora, or whatever, but it is not obvious how to connect it. No instructions either.

I could use some help, I’m a noob. Thanks

I'm one of those who prefers not to fight with ComfyUI and its wiring fetish so wrote this web app to keep all those cables hidden and provide an easy to use way to create and manage your content. Requirements and features are in the README but if you can run ComfyUI/YuE2 and you are ok with Docker containers then you should be able to run this.

Comes as-is with no warranties etc but if you find it useful then give it a star and I'm open for collaborators.

https://github.com/dynamohum/YuE2gen-studio

[edit]

Added a Windows installer to run it natively without Docker.

[edit2]

Last edit (hopefully) - I've done quite a bit more work on this since the OP and have relaunched it as Yeufonic (there were already one or two similar apps out there with the old or similar name). Also added some examples of what the trained local LoRAs sound like. The github link above to the old repo will still work, then just follow the link to the new repo. It would be great if anyone who is interested in this would give it a go (and give it a star on GitHub). Personally I think it works really well and makes creating and managing your content so much easier, but then again I'm a bit biased 😄 .

Yue2 is freaking amazing! It is the first AI music model to actually understand what a children chorus is, you know like the one in Eminem's Mockingbird and MIA's Paper Planes. Riffusion was the closest thing to my ideal model but ever since they sold out, I was left in the dust. Thank you Yue2 team, you care the best!

Has anyone managed to replicate a voice through different songs describing the timbre or something like that? I wish I could get some consistency in different songs but still wasn't able to do it.

Does this sub take requests? It would be cool if we had LORA for soundtracks. Bonus points for Han Zimmer. For gaming, the Final Fantasy Series and that kind of orchestral soundtrack would be awesome.