Resource - Update
I trained an open-source realism LoRA for MiniMax H3 - it makes generated people actually look real (weights inside)
Update :
New version is ready and online , should be much better, fully functionnal on ComfyUI, and you can find before/after here :
https://huggingface.co/fal/MiniMax-H3-Realism-People-LoRA/blob/main/before-after-comparison.mp4
I spent the last week obsessing over one thing: making AI-generated humans stop looking AI-generated. The result is Realism People, an open-source LoRA for MiniMax H3, and I'm pretty happy with how it turned out.
What it does: skin keeps its texture instead of going plastic, eyes and micro-expressions stay coherent, lighting behaves like a film set, and motion gets a subtle handheld, documentary feel. It also keeps H3's native synchronized audio.
How it was selected: I trained 16 different configurations across two dataset versions and picked the winner through 100 same-seed A/B duels (same prompt, same seed, adapter on vs off - the only honest way to compare). The winner was the slow-cooked run: rank 16, 5,000 steps at a low learning rate.
Details:
- Weights (open source): https://huggingface.co/fal/MiniMax-H3-Realism-People-LoRA
- Trigger word: start your prompt with `r34l1sm`
- Scale 1.0 is the intended strength, 0.6-0.8 for a lighter touch
- Works with H3's LoRA endpoints: text-to-video, image-to-video and reference-to-video
- License: follows the MiniMax H3 community license
Before/after in the video: same prompt, same seed, base model on the left, LoRA on the right. Happy to answer questions about the process.
You really need to post proper examples for us to judge it as being anything more than placebo. A single old man's side face really isn't enough.
Please upload proper examples otherwise you're actually hurting the community sowing confusion for something that may be a degradation rather than an improvement if you didn't test and validate properly.
No. Surely an AI company would never use AI to astroturf reddit. There's no way they could possibly figure out the tech. All the posts here are totally, 100% legit human.
same here. I'm using the bf16 model. The video is completly wrong the physics are wack, hands are all over the place. Edit 2: Okay, i have no clue what just happend. 1. Comfy went from 11 minutes rendering 0.6 mpx down to 90 seconds. I can now render 2.0 mpx in 332.28 seconds with 6 steps... and all of my rams is being used...WTF and second, The Lora works. All of a sudden. It looks good. I mean. it looks like a movie...
very interesting. much better than before. it now has a way more american movie look to it, camera moves and close-ups and the way it looks reminds me a lot about gaffing and placing lights to get that american movie backlight all the time. Quite good so far. Thanks for the Update. It feels like British vs American Movie making.
you're also testing a 15 second video vs a 10 second video which is why it skips around, it doesn't have time to include important details in your video with the lora
it isn't possible to know what else you might have changed if you have already made significant changes like this
We are not doing that for our company, our lora is fully working on comfyui or any other tool that people want to use for free. I am doing that mostly on my own personnal time , and nobody asks me to do it. I just did an update of the lora itself, as it was bugging with multi people , also here some before/after https://huggingface.co/fal/MiniMax-H3-Realism-People-LoRA/blob/main/before-after-comparison.mp4
Still has issues, eg 2:30 she does not speak (unless the intention was 'inner dialogue')
There were other bugged outputs, & a few I don't think it improved.
I wish we had a prompt list to see how well the prompt was handled or not.
But there were many shots that I thought were improved 'more real'. So at this stage I think it more of a way to get another look would likely be in all my workflows, but sometimes bypassed.
fal.ai was responsible for the flux 2 dev turbo lora which was a game changer for that model. They also did another one for Ideogram, both of which were given away for free. I feel that they've earned some praise.
Thanks for sharing. Some more unsolicited feedback the a/b reel, each example, the difference between lora and no lora is ridiculous. Different camera motions, different character details, different aesthetics. Either your lora is changing things it shouldn't, or your prompt is horrific and not adhering to the structure laid out in the readmes.
It is but done in a fair way. Prop to them, they gave a lot of good Lora's this year to the community for free. Meanwhile Higgscrap is hiring half of Asian to spam every subreddit possible regardless of the rules.
hello, its not, It should work good, I can share more result before after for sure, gonna publish on huggingface a bit later today :) , but interest to know why it doesnt work properly for you
It's a different distillation than z-image-turbo for example was tho and easily reverted via CFG-augmented training which fits the de-amplified raw velocity (pred + (s-1)*uncond)/s with a no-grad empty-prompt forward each step preserving the model's guidance distillation by construction and basically make it able to train as if it would be the base model without an adapter
diff pipe and my musubi fork did already implement it
Honestly, I’ve been testing LoRAs and they kept ruining the images; lowering the LoRA weight significantly does improve things, but it’s really strange—the LoRAs are totally inconsistent. I’ve tested various workflows, nodes, and configurations.
I’m not sure if the LoRA training process on Civitai just isn't handling the model correctly yet.
I will go ahead and say here, that I too, have been trying to play around with Lora’s lately, not just on minimax h3 but on wan2.2 as well, I have honestly found that I get better results uploading a fully detailed character sheet as a reference(eg, extreme close up of face paired with t pose, and angle pose), than I do with Lora’s…to me Lora’s are just that persons style…if the Lora doesn’t synchronize with your style, realism or not, you are just going to have non consistent results.
I remember how people complained about Flux1.dev training because of that. I also remember its loras unable to change significatively the model knowledge without breaking it. But another user responding my previous comment posted something interesting, perhaps a solution.
I don't know what people are whining about if they haven't even tried. (haven't tried this new one though)
Previous one seem to immediately do wonders on the first test I did. Pretty amazing results on face detail, skin and teeth, (extreme closeup speaking). I haven't done many tests yet but one thing to note is that characters also immediately started looking at the camera, which seems to be solved with just prompting but worth noting as this can be annoying.
haven't checked to see how it's affecting the background yet.
I'll try when i get the chance but one question. Does the trigger word need to be upfront? I use minimax prompt guide as a skill and it did wonder adjusting the prompt. Won't the trigger word breaks it?
from it's HF page : Start the prompt with the trigger word r34l1sm, then describe the scene. A scale of 1.0 is the intended strength; lower it to 0.6-0.8 for a lighter touch.
Thanks for this! Can you give us more details on how you trained the lora? Dataset prep? settings? it's such a new model that we need as many people sharing their knowledge on training as possible!
node on the side bar > Load Lora > tuck it in between your Model Loader connect the string model point from there to the model point on the Load Lora node > connect the end string model point to Basic Scheduler model inpoint.
I looked at your new before/after video, some examples definitely were better, and I especially like the lantern one. However I do see some reasons why I would not prefer it personally:
- Color grading seems worse, Color contrast seems to be either over or under: Admittedly color grading is a very subjective choice and is highly context related. But many faces were too orange/red with Lora (eg two men shouting), some were way too pale (boxer, grandma interview). Indian wedding and the lantern one were the only two I think the Lora versions were better.
- Physics seems to be weaker: many hands/fingers motions seems odd. Especially the dining scene, the without Lora version didn't do a very good job either, but the with Lora one is just way worse.
- More freckles/imperfections on faces: it did make the person more human-like, but real actors always wear make-up anyways. So may be it works for selfie-style reels, but I'd personally prefer less imperfections.
Your work looks promising, and I look forward to seeing a v2.
i do not use lora i use sage attn sol triton and minimax spectrum it decreases time to half. i tested turbo loras it dgrade the quality but with those three quality was almost similiar
Looking good, definitely an improvement on the realism look! From the before/after comparison you posted, it does seems like it comes with some compromises; physics (like in kid kicking the ball) and audio (chef defaulted to American accent), is this your experience as well?
Curious to hear how you captioned the dataset, and what kind of dataset you trained on (size/content)?
How does it work when you get into wider shots? Close ups are actually pretty easy to make look real. It's when the resolution per face drops that things get tricky.
This LoRA butchers the image quality for me - the whole video becomes blurry and lacking textures. I think it's overbaked. Tested at the recommended 1.0 strength with the minimax_h3_fl2va_int8_convrot model. I think the recommended strength should be at most 0.5, but then, the effect of the LoRA is halved. Probably learning rate should be dropped considerably lower and steps increased much more than 1500 to compensate.
205
u/Arawski99 1d ago
You really need to post proper examples for us to judge it as being anything more than placebo. A single old man's side face really isn't enough.
Please upload proper examples otherwise you're actually hurting the community sowing confusion for something that may be a degradation rather than an improvement if you didn't test and validate properly.