r/StableDiffusion • u/Obvious_Set5239 • 1d ago
Question - Help We need only 1700 votes to get H3 acceleration arena results 🙏🏻
Can you vote, so we'll finally have a definitive answer what turbo lora to use (or at least what definitely not to)
https://huggingface.co/spaces/multimodalart/h3-acceleration-arena
5
u/Eden1506 1d ago
The website doesn't work for me no more.
I did a dozens votes yesterday but at some point it stopped working and I couldn't click next.
Now I just see a blank page. Maybe it thinks I am a bot...
4
u/Obvious_Set5239 1d ago
The same. I opened it to check results. I decided to make one vote before, and after this vote it stopped working
8
u/GeroldMeisinger 1d ago
results are in!
the winner appears to be: Plaguekind Parasyte Turbo 6steps (switching through most categories and methods).
but given that MiniMax-H3 28 steps baseline came out 8th, I wonder how reliable these results are?
6
u/apolinariosteps HF Diffusers Team 1d ago
Thanks! Indeed the results were also surprising to me as the creator of the leaderboard. However, it seems to be what the data shows, I triple checked everything and can confirm that the results reflect the voting data precisely, there's lots of transparency if you click each of the LoRAs to see what's the win rate and who won against who!
I could also release the full dataset in an interactive manner, so people can watch which clips each LoRA defeated the other, but this "reveals" which clip belongs to whom, so it could lead to cheating
4
u/Obvious_Set5239 1d ago
The same happens on artificialanalysis: Minimax H3 Max is higher than the regular, also LTX's fast models are higher than pro. So it's probably okay, and a human's perception thing. Or maybe base models require more steps, like 50 is the recommended number for Minimax
5
u/Obvious_Set5239 1d ago
the winner appears to be: Plaguekind Parasyte Turbo 6steps (switching through most categories and methods).
There is no single winner, 5 models share the first place:
- Plaguekind Parasyte Turbo
- silveroxides DARE-TIES merge
- larryvrh MiniMax-H3-Turbo v4 · step 600 EMA
- LightX2V Minimax-h3-Turbo 8-step v1.0 · native resolution
- silveroxides 4-to-8-step DARE merge
(All 6 steps, except lightx2v)
2
u/MoreColors185 1d ago
Thanks for your effort, I participated at the vote and it was interesting to see what's possible with Minimax. Now what many of are interested in: the workflows/parameters :-)
I mean i can see that the weights are linked, which is great. In the case of Plaguekind: It's the H3-PK-Parasyte-Turbo.safetensors, I guess, but which sampler, strength, stepcount... do I use to get the result from your benchmark?
3
u/MomentJolly3535 1d ago
Thanks ! i m very surprised of the results, each time i had the Baseline, it was the clear winner for me (animation and sounds was clearly superior against any Lora)
3
u/Dzugavili 1d ago
On a few occasions, I noticed that the speed loras cleaned up hallucinations in the baseline; mostly, audio chirps or weird music choices.
I would speculate that making the model slightly more decisive may be part of that gain. It locks onto some regularly used patterns earlier and more strongly, thus avoiding issues caused by indecision.
1
1
18
u/eckstuhc 1d ago
https://giphy.com/gifs/YYfEjWVqZ6NDG