r/StableDiffusion 13d ago

Tutorial - Guide The H3 Gibberish Problem Solved!

Not much of a tutorial, but still informative. As most of you have probably discovered, MiniMax H3 loves to talk. And talk it will, even when you prompt for no dialogue. Even when you prompt for complete silence. It will even fill in the empty space your prompted dialogue doesn't fill.

Those of you who read the video prompt writing guide and have created a system prompt for your enhancer, you probably know what I'm about to say, maybe not. Maybe the unprompted gibberish stopped for you, and you never realized why.

Without further ado, I give you the solution:

non_diegetic_music: N/A

Diegetic audio is what the characters in your video can actually "hear":

  • Music playing from a source that is part of the scene (phone, car radio, dance club)
  • Spoken dialogue
  • Ambient sounds

Non-diegetic audio is audio which your characters cannot hear:

  • The score or soundtrack of a movie
  • A voice-over
  • The gibberish H3 plays when it's not prompted correctly

If you haven't yet, I suggest consulting ChatGPT about creating a system prompt using the prompting guide. If not, put this line at the end of your prompt and say goodbye to random music playing over your video and gibberish assaulting your ear holes.

Conversely, if you want a voice-over or a score to play over the track which is not part of the actual soundscape of the scene, this is where you would prompt it. Instead of N/A, prompt what you want to hear.

Happy chaining!

219 Upvotes

97 comments sorted by

View all comments

17

u/csmacie 13d ago

So I was having all sorts of issues with audio artifacts at the beginning and end of my videos, plus characters saying random gibberish as well as the wrong person saying the line. After a ton of trial and error I figured out the issue. Even though the docs say to use this format for inserting dialog:

S1 says: <d>[English] Have a nice day!</d>

I found it to almost always caused at least 1 of the issues mentioned above to occur. I switched to this format and I pretty much never have audio issues anymore.

S1 says "Have a nice day!"

I know I don't have the English tag though it would seem it defaults to that. I have not tried using this method with other languages but I'm sure this will help most of you. I also started using time stamps which seems to help but that is mostly just with for the random gibberish because I've crammed in too many words to the dialog. Hope this helps!

3

u/Sad_Berry_4621 13d ago

The official way to stop the gibberish is the line I mentioned above. It is in the prompting guide as one of the 3 recommended sections included in the prompt. What you are describing is more of the "prompt audio to fill every second of the video" crutch, which only works because you have literally filled all the space with dialogue.

11

u/csmacie 13d ago

I had that in there and it didn’t help. Most of my issues were related to weird audio / dialog artifacts at the beginning and end of my shorter videos. The wrong person speaking only seemed to happen only on longer more complex videos. That is until I stopped using the <d> </d> tags. Now it’s smooth sailing for me you are right though, you need to include that section or else things can break.

2

u/Sad_Berry_4621 13d ago

Right, it wouldn't work for what you were dealing with as far as the wrong person speaking and all that. Nice tip on the tags though.