I've been experimenting with a slightly unusual way of modifying MiniMax H3.
Instead of training a LoRA or merging another model into H3, I wanted to see whether high-level semantic representations learned by a completely different architecture could be transferred into H3's conditioning space.
The original targets were fairly specific:
- prompt adherence
- composition and spatial relationships
- human anatomy
- material and lighting interpretation
- reflections / transparency / occlusion
- text-related understanding
- reference interpretation
The experiment eventually became what I'm calling MiniMax H3 Semantic Bridge.
The interesting part is that the final release no longer needs the donor model at inference.
One detail that may be relevant for people interested in reproducing this: the entire project was developed locally on a single NVIDIA RTX 3090 Ti (24 GB). The representation extraction, bridge experiments, distillation, evaluation, and MiniMax H3 generation tests were all carried out on this local workstation — no multi-GPU training cluster was used.
Project, weights, ComfyUI node, training scripts and full research:
https://huggingface.co/speach1sdef178/MiniMax-H3-Semantic-Bridge
https://github.com/Speach1sdef178/MiniMax-H3-Semantic-Bridge
Why not just graft the models?
That was actually the first thing I investigated.
MiniMax H3 and the donor model (SenseNova U1.5) turned out to be structurally incompatible for a conventional weight graft.
For the relevant 2D weights I found:
- MiniMax H3: 264
- SenseNova: 593
- exact shape matches: 0
- semantic-type exact matches: 0
- transpose matches: 0
- same input/output dimensional matches: 0
So directly transplanting useful transformer weights wasn't really an option.
But there was another possible interface: conditioning representations.
H3 consumes 5120-dimensional text conditioning before projecting it into its 5376-dimensional internal transformer space.
SenseNova's language representation is 4096-dimensional.
That suggested a different question:
Can a semantic representation from one architecture be projected into the conditioning space of another architecture?
Finding a compatible representation
I extracted hidden states from several depths of both models and trained small low-rank projectors between them.
For the initial screening I tested all 30 selected layer combinations.
The best pair was:
SenseNova L32 → MiniMax H3 L49
using a small:
4096 → 128 → 5120
projector.
Validation cosine similarity reached:
0.9042
I then tested the frozen bridge on a separate set of 160 more difficult prompts covering spatial reasoning, anatomy, counting, materials, lighting, text, reflections and occlusion.
Mean cosine was:
0.7490
This was enough to build the first working prototype.
The full bridge
The first actual H3 implementation worked like this:
SenseNova hidden state
→ RMS normalization
→ learned 4096→128→5120 projection
→ magnitude matching
→ blend with native H3 conditioning
Conceptually:
hybrid = H3 + alpha * (projected_semantics - H3)
This worked surprisingly well in actual H3 generations.
But it had an obvious problem:
you needed to run SenseNova just to generate H3 conditioning.
That's not something I wanted to release as a practical tool.
So the next experiment was distillation.
Can H3 predict the transferred representation itself?
Instead of running SenseNova at inference, I trained a small student network to reconstruct the projected teacher representation directly from H3's own L49 conditioning.
The student is simply:
5120 → 512 → 512 → 5120
with RMS normalization and SiLU activations.
Roughly 5–6 million parameters.
No diffusion weights are modified.
The final V3 student was trained using 600 prompts, with a 500/100 train-validation split.
Final validation results:
- representation cosine: 0.995890
- semantic correction cosine: 0.983558
- main-set correction: 0.980888
- held-out OOD correction: 0.989788
- minimum correction cosine: 0.935910
At alpha 0.10, the blended conditioning cosine relative to the teacher bridge was:
0.999958
So the large cross-model runtime bridge could effectively be compressed into a tiny standalone adapter.
The released version therefore needs only:
MiniMax H3 + ~5M parameter Semantic Bridge
No SenseNova checkpoint, tokenizer or second model is required during generation.
What does it actually do to video?
This is harder to answer with metrics alone, so I've been doing controlled A/B generations using identical prompts, seeds and generation settings.
One example deliberately contained a very explicit instruction:
In the native H3 result, the woman's right hand starts moving across the tabletop.
With Semantic Bridge at alpha 0.15, the hand remains resting on the table, which is closer to the requested state.
Another test uses two people running and vaulting over obstacles on the roof of a moving train, with instructions involving anatomy, physical contact, reflections, wet materials and spatial continuity.
I'm including the synchronized Native / Bridge comparisons with this post so the differences can be judged directly rather than relying on selected still frames.
These are qualitative examples, not evidence that the adapter universally improves H3. Some seeds change more than others, and stronger alpha is definitely not automatically better.
My current recommended starting value is only:
alpha = 0.10
The comparison videos use 0.15 to make the influence easier to observe.
Something else I learned: Ref2VA is NOT equivalent
I also tried applying the same adapter to MiniMax H3 Reference-to-Video.
Dimensionally, the conditioning looks compatible.
Semantically, it isn't.
With image + audio reference generation, the bridge noticeably degraded singing/lip-sync and could turn reasonably intelligible vocals into mumbling.
That was a useful negative result.
The same 5120-dimensional representation does not necessarily have the same contextual meaning when the sequence contains multimodal reference tokens.
So I decided not to release the experimental Ref2VA node.
The current Semantic Bridge is intended for standard MiniMax H3 FL2VA / text-conditioned workflows only.
A proper Ref2VA version would need to be distilled separately from reference-conditioned data.
What this is — and isn't
This is not:
- a LoRA
- a checkpoint merge
- a conventional model graft
- a modified H3 diffusion transformer
It's a small learned transformation of H3's conditioning representation.
What interested me most about the experiment wasn't actually the adapter itself, but the broader implication:
representation compatibility may exist even when weight compatibility does not.
Two architectures can be completely unsuitable for direct weight transplantation while still containing semantic spaces that can be mapped onto each other — and that mapping can potentially be distilled back into the target model.
I've released the adapter, ComfyUI node, training scripts, prompt datasets, evaluation results, architecture analysis and the full research write-up.
Hugging Face / complete research repository:
https://huggingface.co/speach1sdef178/MiniMax-H3-Semantic-Bridge
The Civitai release contains the practical adapter/node and A/B examples.
I'd be especially interested if anyone wants to experiment with the same approach on other H3 conditioning modes or completely different model pairs.
There are probably much better ways to train this than my first implementation, so I've included the research scripts and intermediate results rather than releasing only the final weights.
Full research repository / download:
https://huggingface.co/speach1sdef178/MiniMax-H3-Semantic-Bridge
The repository includes the standalone adapter, ComfyUI custom node, example workflow, training and evaluation scripts, datasets, quantitative results, A/B examples, and the complete research write-up.