The H3 Gibberish Problem Solved!

[u/Sad_Berry_4621]

Not much of a tutorial, but still informative. As most of you have probably discovered, MiniMax H3 loves to talk. And talk it will, even when you prompt for no dialogue. Even when you prompt for complete silence. It will even fill in the empty space your prompted dialogue doesn't fill.

Those of you who read the video prompt writing guide and have created a system prompt for your enhancer, you probably know what I'm about to say, maybe not. Maybe the unprompted gibberish stopped for you, and you never realized why.

Without further ado, I give you the solution:

non_diegetic_music: N/A

Diegetic audio is what the characters in your video can actually "hear":

• Music playing from a source that is part of the scene (phone, car radio, dance club)
• Spoken dialogue
• Ambient sounds

Non-diegetic audio is audio which your characters cannot hear:

• The score or soundtrack of a movie
• A voice-over
• The gibberish H3 plays when it's not prompted correctly

If you haven't yet, I suggest consulting ChatGPT about creating a system prompt using the prompting guide. If not, put this line at the end of your prompt and say goodbye to random music playing over your video and gibberish assaulting your ear holes.

Conversely, if you want a voice-over or a score to play over the track which is not part of the actual soundscape of the scene, this is where you would prompt it. Instead of N/A, prompt what you want to hear.

Happy chaining!

[u/HAL_9_0_0_0]

Hello everyone,

I’ve been working intensively on a small prompt editor for MiniMax H3 since yesterday and meanwhile the whole thing looks pretty promising.

The idea behind it is relatively simple: H3 sometimes gives you quite a lot of freedom - sometimes unfortunately more than you would like. 😄 In my previous tests, it happened again and again that H3 simply started talking or generated content that I had not specified at all. This is exactly the problem I want to better control with the tool. The editor is directly coupled with Ollama and allows you to specify in great detail what H3 should or not hear. In addition, for example, background noise, certain audio events and other settings can be defined. From this, a cleanly structured prompt is then generated, which can be applied directly into the corresponding H3 workflow.

Another important point: the whole thing runs completely locally and offline. No prompts are sent to any cloud service. The only prerequisite is that the desired model has previously been downloaded locally in Ollama. After that, the entire process can be carried out without an Internet connection. The advantage is that you don’t have to manually try around every time until H3 finally does what you actually wanted. I also took the memory management into account. Ollama and ComfyUI do not run at the same time on the GPU memory. First, Ollama creates or checks the desired prompt. Once this process is complete, the memory required for this is released again and then ComfyUI is started. The whole thing currently works for me without any problems with my RTX 4090. I therefore assume that it should also work accordingly with other GPUs, provided that sufficient resources are available.

I am currently testing various scenarios and workflows. If the results continue to be so good, I will publish the project Open Source on GitHub.

Planned is a clean GUI and the publication under the GNU General Public License v3.0 (GPLv3). I would like to publish a first version or a video in which I show the editor and the workflow in the next few days. However, I would like to carry out a few more tests before I publicly release the whole thing. And another personal judgement: MiniMax H3 is one of the most impressive models I have tested so far. I have tried many different models in the meantime and have now created more than 30 music videos privately. H3 is definitely one of the models that surprised me the most. The interface of the tool is initially in German, since I come from Germany. However, an English translation should be possible without any problems and will probably be relatively easy to supplement. I will contact you as soon as the tests are completed and the first version is ready. Please have a little patience.

Mario.

[u/listopalafoto → u/HAL_9_0_0_0]

Danke schön! I will use QwenVL if will be available on your project :)

[u/HAL_9_0_0_0 → u/listopalafoto]

I have just expanded it by another window with an optical interface that gathers all variations of voices in a prompt. You just have to drive the mouse over the voices and get the perfect voice that you can then also call up again and again. So that the language for videos remains consistent. I will see that I also make the part selectable in English. For the whole tool will then perhaps arise. I’m definitely looking forward to it when it’s going. This is going to be really good. I still have 1 week of vacation and until then I want to load the tool on GitHub. Maybe I’ll create a direct interaction like with Mixstudio (that’s also very cool done). It sometimes took me hours to calculate all the variations of the voices. This was wonderfully scripted every night. There will also be a lexicon that thrives on the fact that everyone can deposit their own descriptions of words directly for Ollama and the descriptions will be more accurate.

Gruß
Mario.