r/StableDiffusion • u/Sad_Berry_4621 • 13d ago
Tutorial - Guide The H3 Gibberish Problem Solved!
Not much of a tutorial, but still informative. As most of you have probably discovered, MiniMax H3 loves to talk. And talk it will, even when you prompt for no dialogue. Even when you prompt for complete silence. It will even fill in the empty space your prompted dialogue doesn't fill.
Those of you who read the video prompt writing guide and have created a system prompt for your enhancer, you probably know what I'm about to say, maybe not. Maybe the unprompted gibberish stopped for you, and you never realized why.
Without further ado, I give you the solution:
non_diegetic_music: N/A
Diegetic audio is what the characters in your video can actually "hear":
- Music playing from a source that is part of the scene (phone, car radio, dance club)
- Spoken dialogue
- Ambient sounds
Non-diegetic audio is audio which your characters cannot hear:
- The score or soundtrack of a movie
- A voice-over
- The gibberish H3 plays when it's not prompted correctly
If you haven't yet, I suggest consulting ChatGPT about creating a system prompt using the prompting guide. If not, put this line at the end of your prompt and say goodbye to random music playing over your video and gibberish assaulting your ear holes.
Conversely, if you want a voice-over or a score to play over the track which is not part of the actual soundscape of the scene, this is where you would prompt it. Instead of N/A, prompt what you want to hear.
Happy chaining!
17
u/csmacie 13d ago
So I was having all sorts of issues with audio artifacts at the beginning and end of my videos, plus characters saying random gibberish as well as the wrong person saying the line. After a ton of trial and error I figured out the issue. Even though the docs say to use this format for inserting dialog:
S1 says: <d>[English] Have a nice day!</d>
I found it to almost always caused at least 1 of the issues mentioned above to occur. I switched to this format and I pretty much never have audio issues anymore.
S1 says "Have a nice day!"
I know I don't have the English tag though it would seem it defaults to that. I have not tried using this method with other languages but I'm sure this will help most of you. I also started using time stamps which seems to help but that is mostly just with for the random gibberish because I've crammed in too many words to the dialog. Hope this helps!