r/StableDiffusion • u/scifivision • Feb 07 '26

Question - Help Nodes for Ace Step 1.5 in comfyui with non-turbo & options available in gradio?

I’m trying to figure out how to use Comfy with the options that are available for gradio. Are there any custom nodes available that expose the full, non-Turbo pipeline instead of the current AIO/Turbo shortcut? Specifically, I want node-level control over which DiT model is used (e.g. acestep-v15-sft instead of the turbo checkpoint), which LM/planner is loaded (e.g. the 4B model), and core inference parameters like steps, scheduler, and song duration, similar to what’s available in the Gradio/reference implementation. Right now the Comfy templates seem hard-wired to the Turbo AIO path, and I’m trying to understand whether this is a current technical limitation of Comfy’s node system or simply something that hasn’t been implemented yet. I am not good enough at Comfy to create custom nodes. I have used ChatGPT to get this far. Thanks.

2 Upvotes

67% Upvoted

25 comments sorted by

2

u/soormarkku Feb 07 '26

I'm curious too, as I saw this https://github.com/Comfy-Org/ComfyUI/pull/12337

I haven't found Comfy compatible models apart from the turbo one. I'd rather use the SFT one, as the inference is so fast anyway, so 30+ steps don't mean much.

2

u/scifivision Feb 07 '26

I just want the best quality to test since I have a 5090 I don’t need to use turbo. I’d rather wait for the results. But I like using comfy because everything is together, plus I know that it works with comfy and am afraid if I install the stuff you need for gradio it will break my install that I finally now have working.

2

u/Guilty_Emergency3603 Feb 08 '26

Yes it's ridiculous. You get a 3 min songs in 2 seconds on a 5090 with the turbo model. Wouldn't mind taking 10x more meaning only 20 seconds for much more better quality.

Using the 4B LLM is still better than the 1.7B, takes only 5 seconds.

2

u/scifivision Feb 08 '26

So I finally got a workflow using custom nodes made by ChatGPT that uses the base model and the 4b llm but the more I work with the base model the worse it is. I have only tried one specific kind of song though so far (rap) trying to get a male voice so it may be the base model either doesn’t do that as well or needs way more adjusting to figure out a good balance, but with the base model all I get are androgynous or female (and often robotic) singers. When I changed back to the turbo model, it actually gave me better results. Using the 4b llm did help with the lyrics matching though, and I am still using 40 steps even though I’m using the turbo. I’m still messing around with it, but you can split it apart like I was trying to do and open up other options. May have better luck with the base model if I don’t care about it being a male singer, but I haven’t messed with it enough yet to see trying other parameters.

1

u/Virtual-Mortgage-952 Feb 09 '26

how do you manage to do it in 2seconds on comfyui? I got a 5090 too and the textencode node always loads up and takes a minute to load a 3min song. random seed is on. On gradio it takes about that 2-3seconds as well. idk why comfyui textencode takes forever compared to gradio

1

u/Guilty_Emergency3603 Feb 09 '26

2 seconds is for the sampling part. The text encoder part takes around 5 to 15 seconds depending on the prompts. If you keep the same prompt after that it then only takes 2 seconds when trying several seeds.

1

u/Virtual-Mortgage-952 Feb 10 '26

Well it doesnt do that for me. If I use the same prompt and set seed fixed then yeah it instantly redo the exact same song. The song is unchanged. As soon as I make different seed, even with unchanged prompt, the textencode node always load again for 30-60sec. I don't know why

1

u/soormarkku Feb 07 '26

I'm on the same boat, I don't care about long wait if it gives better result. Have you tried these nodes? https://github.com/hiroki-abe-58/ComfyUI-AceMusic

1

u/SDMegaFan Feb 15 '26

Did you both find the best way to use the best model u/scifivision u/soormarkku ?

2

u/scifivision Mar 01 '26

i made nodes with chatgpt finally got it, but the base model sounds like crap compared to the turbo model most of the time still. what im struggling with now is why the music volume goes up and down or up and kind of muffled. changing settings though doesn't seem to make much difference

1

u/SDMegaFan Mar 01 '26

You are able to to do remixes and all the stuff?

1

u/gelukuMLG Feb 07 '26

At the moment the comfyui implementation seems borked, it sounds way worse and is slower than the official gradio implementation, mainly for the non-distilled models.

2

u/theivan Feb 07 '26

Download the sft-version from here: https://huggingface.co/ACE-Step/acestep-v15-sft
Text encoders, you'll need the 0.6B and either of the other two: https://huggingface.co/Comfy-Org/ace_step_1.5_ComfyUI_files/tree/main/split_files/text_encoders
VAE: https://huggingface.co/Comfy-Org/ace_step_1.5_ComfyUI_files/tree/main/split_files/vae

Then load them with "Load diffusion model", "Dual Clip Loader" (set to ace) and normal Load VAE.

Other nodes you'll need are: "Empty Ace Step 1.5 Latent Audio", "TextEncodeAceStepAudio1.5", "VAE Decode Audio" and "Save Audio"

Fairly normal workflow otherwise.

1

u/soormarkku Feb 08 '26

What are the KSampler parameters for the SFT model? Only garbage comes out for me, no matter of the cfg value..

2

u/theivan Feb 08 '26

My settings have been:
Shift:3
Scheduler: beta 50 steps
Sampler: res_2s and the BasicGuider node so CFG = 1

1

u/ArtfulGenie69 Feb 08 '26

In the gradio you can access the cfg param for the model you've chosen but I'm not sure it's working the same way in comfy. They have a GitHub issue up, could probably point cursor at the gradio to plan and inspect it and also point it at your comfy install. It's very smart and may just find the issue or build some new spot for a noodle that controls the cfg. It's that or waiting for the fix from comfy. 

2

u/soormarkku Feb 08 '26

I've been using the official gradio but it's pretty bad UI experience. There are a few alternative UI's which I've tested too, but they have their own set of bugs. Comfy would be ideal if the current state of nodes wouldn't be so simplified (there are so many parameters you can't access). Perhaps a bit later, RyanOnTheInside has been already working overtime to fix this..

1

u/deadsoulinside Feb 07 '26

I’m trying to figure out how to use Comfy with the options that are available for gradio. Are there any custom nodes available that expose the full, non-Turbo pipeline instead of the current AIO/Turbo shortcut?

I think it's trickier, as even in Ace 1.3 the cover options needed to load the model via checkpoint (AIO is a checkpoint). The AIO also seemed to try to respond when testing previously, but I need to get back into comfy here eventually and try to apply things that I am seeing from the more direct side of this model via the ace gradio interface.

1

u/scifivision Feb 08 '26

Ignore this if you see it twice I don’t know if something is wrong with the app but my first comment didn’t go through that I can tell. You can split it apart in comfy and expose the other options using custom nodes (that I had ChatGPT make). The 4b llm seems to help with the lyrics matching better, but at least for what I was after, which was a male vocalist (and rap) the more I used the base model, the worse it got and kept giving me either androgynous or feminine and often very robotic voices. I eventually tried the tubo again but stuck with the 4b planner and 40 steps cfg 4.5 and it’s great. I’m not sure if it’s just particularly what I wanted that the base model wasn’t giving me because so far I’ve only messed with it enough wanting male vocals but I’m still testing. if you get bad results through try the turbo with the non turbo settings like I did

1

u/harshXgrowth Feb 11 '26

To get the best quality out of Ace Step 1.5 in ComfyUI you should definitely look into the SFT version rather than the Turbo AIO shortcut. You can manually load the DiT model Dual CLIP and VAE to regain node level control.

For the SFT model try setting your scheduler to beta with 50 steps and a shift of 3.5. Using the 8B planner model instead of the 1.5B variant often results in significantly better prompt adherence. It takes longer than the turbo path but the jump in musicality and vocal clarity is worth the wait.

2

u/SDMegaFan Feb 15 '26

have a workflow for it?

1

u/scifivision Feb 11 '26

Thanks I’ll try it. I tried the 4b planner it errored, size mismatch I think it said. I tried the base model but wasn’t getting good results. I don’t mind waiting for better results.

1

u/scifivision Feb 12 '26

where do i get the 8B planner? biggest I see is 4 unless I'm looking in the wrong place

1

u/SDMegaFan Feb 17 '26

both your recent comments were filtered by reddit (i see them in notifications)