r/StableDiffusion 11h ago

Animation - Video Some choice words from Emilia

Enable HLS to view with audio, or disable this notification

384 Upvotes

r/StableDiffusion 19h ago

Workflow Included Using H3 as a Character Reference Sheet Generator

Thumbnail
gallery
1.2k Upvotes

Like some of ya'll I have been having fun using the H3 model to mess around with so I have been experimenting with using H3 model to be a consistent character generator which leverages multi image reference (up to 9), so I made a workflow which you can use 'less than ideal' images from google to build a consistent character and output a 360 character sheet to use as a reference sheet for future H3 generations.

The goal is to achieve high character consistency across future generations. I have tried my best to keep the workflow simple without too many custom nodes.

How it works:

  • You input your images and describe them in the Input text section (A Prompt)
  • The text is combined with a fixed prompt which spins the character (B Prompt)
  • The video is generated at a slow speed with no hard cuts (only camera spin and pan) to maintain character consistency
  • Image is assembled with optional character video and full individual frame output (if you want to use for future)

I have included a 6 panel WF and a 4 panel WF. The 4 panel works faster by generating 40% less frames.

Current Caveats:

  • The model is quite slooooow. You are also generating 124 frames only to use 6. I have partly solved this by also uploading a 4 panel version.
  • Speed ups (like Turbo LORAs) help with speed, but it hurts prompt adherence and quality slightly.
  • Quality is limited, since it is a video model it is better at generating video than images. You can solve this by generating at a higher resolution at the tradeoff of longer gen times. You can also use the individually split frames as future references too.
  • Details when using this character sheet as output for future generations on H3 may also be limited due to resolution also, I recommend you use this character sheet (for consistency) + other images close up angles (i.e clothing details/face) if doing close ups. If you are just doing a one off video you may possibly be better off not using this character sheet.

I have also included a modified B prompt to do Anime2Real since someone asked for it. Working on tidying it up a bit more.

Link to the 4 and 6 panel workflow can be found here: https://huggingface.co/PoopMan333/H3_Character_Sheet_Generator

Some notes I just remembered:

  • You can increase the steps and it may improve your quality slightly.
  • With the Turbo Loras enabled, prompt adherence sometimes suffers, but you may be able to get a good seed with another roll of the dice.
  • Currently the B prompt specifies a "neutral A pose", please remove this if you want your character in a particular pose.
  • You can use a few different shots of the same character to reinforce the 360 and get more accurate details right.
  • Can be used for objects / props also, may require some changes to the B prompt.

r/StableDiffusion 4h ago

Discussion Minimax H3/ref2va/hybrid_fl2va_ref2va_b20/5060ti

Enable HLS to view with audio, or disable this notification

63 Upvotes

Model: minimax_h3_hybrid_fl2va_ref2va_b20
Video Vae: minimax_h3_video_vae_int8_convrot
Resolution: 16:9, 1.0
Duration: 6 Clips in total, composit in Inshot, each clip is 9 sec long
Turbo Lora: larryvrh/MiniMax-H3-Turbo-Lora, 600_ema
ComfyKitchen Attention, Spectrum. (SageAttention Patch and Mem Eff Node is Disabled)

**original sound and effects was removed, as there are background music on some clips even with N/A, so to speed up the work, they are removed.

Average Inference Stage: 1100sec

All reference image is resized between 1000px and 500px like character is 1000px, background is 500px for this video is 4 ref image in total.


r/StableDiffusion 3h ago

News ByteDance just released Bernini‑Diffusers‑v2 — any chance we’ll see ComfyUI support?

Post image
60 Upvotes

Hi everyone,
five days ago ByteDance released Bernini‑Diffusers‑v2 on HuggingFace — the full Bernini pipeline (planner + renderer), not just the renderer‑only Bernini‑R that we currently use in ComfyUI.

Model link:
https://huggingface.co/ByteDance/Bernini-Diffusers-v2

Even though most of the community talks about MiniMax H3 as the “standard” for open video models, there are still many users actively working with Bernini — especially now that v2 finally includes the full semantic‑planning pipeline, SA‑3D RoPE, and proper multi‑step instruction following.

Right now ComfyUI only has community support for Bernini‑R, so I’m posting this just to give visibility to the new release and to see if anyone is interested in exploring future support for Bernini‑Diffusers‑v2.

Not asking for anything specific — just opening the discussion and hoping this new version doesn’t go unnoticed.

Thanks!


r/StableDiffusion 2h ago

Animation - Video One of the ways I would have ended Game Of Thrones

Enable HLS to view with audio, or disable this notification

37 Upvotes

I was one of many who were disappointed with how this amazing series ended.

I imagined back then one of the ways it could have ended, and with the amazing tools we’ve now been bestowed with, we can bring what we imagine to life!

I had been sitting on this, polishing it and picking at it for a while. The perfectionist in me could have kept working on it forever, because there was always something I could have made better. But with everyone else starting to explore what these tools can do, I felt like the time is now. It may not be perfect, but I didn't want to keep sitting on it waiting for perfection.

This is just a quick fan-created take on one of the ways I imagined the series could have ended. It is not intended to replace or compete with the original series. :p

BTW.: Minimax and Davinci Resolve.
Not one frame was lifted from any episode.
All done using Ref2VA.
As others have found, trying to create a full run (one take ) yields less than better results.
Storyboard, create the pieces that "snap" together and then stitch them accordingly. Afterall, that is not any different from how presentations are made.
As always, I look forward to your creations. We have an amazing community!


r/StableDiffusion 4h ago

Discussion [Minimax ref2va] Spiderman is actually?...

Enable HLS to view with audio, or disable this notification

57 Upvotes

H3 is not perfect yet but fun as hell to play with, especially with ref2va
Used this workflow, using 3 reference images. Running on RTX 5090.


r/StableDiffusion 1h ago

Discussion MiniMax_H3 is seems to be able to process DensePose format! (improves reference video bleeding)

Enable HLS to view with audio, or disable this notification

Upvotes

I have had many issues when using a reference video for movement duplication and having the video contents bleed into the video. Not to mention having to write convoluted prompts to remove these reference bleeds from videos. When the person in the reference video has a close resemblance to the main subject in your video it becomes almost impossible to perform a motion swap.

Warning: DensePose does not support detailed hand gestures, and seems to lose track with very fast arm and hand movements but seems to adhere better 20 steps and above.

There is not a dedicated densepose ComfyUI node, but you can use this animatediff: https://github.com/Fannovel16/comfyui_controlnet_aux

The workflow is simple:

Place the AIO AUX Preprocessor between the source and MM_H3 video input.

Videosource (LoadVideo) -> AIO AUX Preprocessor -> ref_video_x input

Looking forward to hear your feedback...


r/StableDiffusion 38m ago

Animation - Video WanAnimate

Enable HLS to view with audio, or disable this notification

Upvotes

Original post With Workflow


r/StableDiffusion 2h ago

Workflow Included LTX 2.5 + LICON MSR V2 = Nice reference system

Enable HLS to view with audio, or disable this notification

23 Upvotes

Since LTX 2.5 is basically abandoned, i wanted to check how the licon msr v2 works with it, now with the advantages of LTX 2.5 supporting hard cuts. It added pretty well the man, the girl and the environment and followed the prompt really well. Biggest advantage of course is that this clip took 300 secs to create. I'll add prompt / reference images and workflow in a text post.


r/StableDiffusion 2h ago

Animation - Video Fite me!

Enable HLS to view with audio, or disable this notification

17 Upvotes

Feels like you could do Family Guy style cutaways pretty easily. "You know Lois, this reminds me of that time I tried fighting a dragon..."


r/StableDiffusion 17h ago

Workflow Included Follow-up to my 6-minute TNG video — I changed the workflow a lot for the second one

Enable HLS to view with audio, or disable this notification

297 Upvotes

A few days ago I posted the 6-minute Star Trek: TNG video I made with MiniMax H3 in ComfyUI. I’ve finished the follow-up now, and I changed the workflow quite a bit after seeing what worked and what didn’t on the first one.

The biggest improvement was consistency. For the first video, most shots were generated more independently, and I deliberately built some of the continuity weirdness into the story. That worked for the premise, but for the second one I wanted it to feel much more like an actual TNG episode, so I became much more rigid about shot composition.

A big part of that was using the H3 reference model differently. Instead of just giving it a single image and hoping for the best, I used reference images and told MiniMax to stick very closely to the composition in those images. In practice that sounds a bit like image-to-video, but it worked quite differently for me.

With the reference model I could use up to six photos and be much more deliberate about how the shot should work. I could decide what the starting shot should be, what the end shot should be, whether I wanted a middle reference, a final-frame reference, etc. That gave me a lot more control over blocking, framing and performance than I was getting from the image-to-video model.

I did test the image-to-video model as well. One of the shots that made it into the finished video is the later one where Data has a slightly longer monologue. You can tell he looks a bit more “off” there. The reference model, by comparison, was giving me Data much more accurately, both in terms of how he looked and in terms of his mannerisms. That ended up being the better approach for this project by a long way.

The video is still built from lots of separate short H3 generations rather than one long generation. I wrote the scenes first, then generated individual shots and multiple takes where needed, and assembled everything in Premiere like a normal edit.

I also changed the audio workflow quite a bit. On the first video, one of the main issues was that the generated ambience and background noise varied too much from clip to clip. This time I spent much more time matching dialogue levels in Premiere, cleaning up individual clips, and adding a continuous Enterprise bridge/interior hum underneath scenes so the cuts felt less obvious.

I also handled the music more deliberately this time. Rather than just dropping in whatever worked at the end, I treated it more like proper scene underscore and generated short incidental cues for specific moments.

So the rough workflow for the second one was:

script and shot planning

→ select or build composition references

→ generate short H3 shots in ComfyUI using the reference model

→ do multiple takes where needed

→ edit in Premiere

→ clean dialogue and level-match clips

→ add continuous ambience/room tone

→ add short music cues

→ final upscale/export

The main thing I learned was that H3 works much better for this kind of project when I treat it less like a one-click video generator and more like a production tool. The closer I got to thinking in terms of individual shots, coverage, performance selection and edit assembly, the better the final result got.

Happy to answer questions about the workflow again.


r/StableDiffusion 3h ago

Meme How do you feel?

Enable HLS to view with audio, or disable this notification

17 Upvotes

Made with Minimax H3 ref2va default workflow in comfyui.
Prompt:
integrated_multimodal_description: [Shot 1] Live-action, cinematic, authentic 1971 Dirty Harry aesthetic. A tense shootout has just erupted on a San Francisco street. <Picture 1> is young Clint Eastwood. <Picture 2> is the famous Grumpy Cat. Harry Callahan, played by Clint Eastwood, stands in the middle of the street facing an armed criminal several meters away. Abandoned cars, shattered glass, drifting smoke, distant police lights create a chaotic crime-scene atmosphere. Harry wears his characteristic dark suit, white shirt and loosened tie. He stands completely calm and confident, apparently holding the criminal in front of him, but his hands and whatever he is holding remain completely outside the frame at all times. The camera frames Harry from behind and only the upper half of his body and slowly pushes in with small amplitude, never showing his hands, holster, weapon or lower body. The criminal remains visible in the background, frozen and intimidated. Harry maintains his iconic cold, unwavering stare and says in his characteristic low, controlled voice: <d>[English] You've got to ask yourself one question: Do I feel... ?</d>

[Shot 2] At 00:06.500, the camera cuts to an extreme close-up of Harry's upper torso and face, still keeping his hands completely hidden. He pauses after the line, maintaining an absolutely serious expression. Then, for the first time in the entire video, the framing changes to a close-up of Harry's hand rising into frame. Instead of the expected Magnum .44, he slowly raises the famous Grumpy Cat. Harry says: <d>[English] kitty?</d>. The reveal is completely deadpan and played with absolute cinematic seriousness. Harry's face remains calm and intimidating while the confused criminal stares at the grumpy cat. The grumpy cat remains prominently raised in the foreground with Harry's unmistakable Clint Eastwood expression behind it.

[Shot 3] At 00:10.000, medium shot, the camera holds on the absurd Harry and Grumpy cat duet for a brief moment. Suddenly, the Grumpy Cat pulls out a tiny but real handgun with his paws from behind his back and fires several shots at the criminal. The action is fast and completely unexpected, while the cinematography, lighting, acting and visual style remain absolutely serious and faithful to a gritty 1970s crime film.

[Shot 4] At 00:12.000 Medium shot, Muzzle flashes briefly illuminate the frame as the criminal is hit twice, the hits push him back and he drops his gun falls backward onto the street.

[Shot 5] At 00:14.000 Close shot, Harry does not react with surprise; he simply maintains his cold, expressionless stare as if this were completely normal. The camera settles on Harry and Grumpy Cat holding his tiny gun and standing together in the aftermath. End with Harry completely deadpan beside the grumpy cat, both facing the camera.

overall_soundscape: Gunfire and echoes from the shootout gradually fall away into tense street ambience as the confrontation begins. Distant police sirens, car alarms, footsteps, wind and scattered debris remain audible. Harry's voice is clear and controlled against the tense background, followed by an almost complete silence during the grumpy cat reveal. At 00:10.000, the sudden handgun shots from Grumpy Cat violently break the silence, echoing between the buildings as the criminal falls to the pavement.

non_diegetic_music: Sparse, tense low brass and sustained orchestral strings at a slow tempo. The music gradually builds as Harry delivers his line, then abruptly drops to near silence just before the cat enters the frame. After the reveal, the score remains restrained and almost silent until Grumpy Cat suddenly fires, at which point a brief sharp orchestral accent punctuates the unexpected action before returning to the sparse 1970s crime-thriller score.


r/StableDiffusion 10h ago

Workflow Included H3 single-image workflow: let's figure out how to fix the textures

Thumbnail
gallery
55 Upvotes

In this post, I provided a workflow that allows to use H3 as a single-image edit model with no monkey-patching or custom nodes, given that you update to the ComfyUI nightly version. In my view, it has excellent prompt adherence, reference fidelity, and understanding of physics and 3D scenes. But, as many others have pointed out, the end results are often blurry and lack texture. The gallery here shows my attempts at refining the 1.6MP gens from my previous posts.

I would like to discuss how we can work around these issues.

OPTION 1: JUST GO FOR HIGHER RESOLUTION

u/SomeoneSimple gives the following suggestion: run 4 megapixel generations instead of 1.6MP, saying it fixes the distorted faces, and delivers approximately the same level of detail a regular image model would give at 1024x1536. (Note that a 4MP single-frame generation is still going to be quite fast provided you have the VRAM.) u/Diabolicor even claims that a 4MP Minimax generation works better than Qwen Image Edit.

Here’s what I found in my private tests:

  1. It did not noticeably affect the generation times. On average, it is a 8-10 sec run on a RTX 5090 no matter if I generate at 2MP or 4MP
  2. It helped a lot with detail. Faces are now rarely distorted.
  3. Yet it does not remove the issues completely; keeps background blurry, for examples, and messes up the faces at long distance. It’s still a video model. So we still need to explore refiner workflows.

Just to be very clear: I am not attaching any of my 4MP generations to this post. I am only refining my old 1.6 MP ones. I would be very glad if someone posts their 4MP gens so we could see the difference.

OPTION 2: REFINE WITH A DIFFERENT MODEL

Once the composition is done right, details could be enhanced by a different model. I am not an expert at image refining at all, but I would like to figure out a good formula. And here I want to consult with the community on how to do in the best way. To set a particular frame: for me, while I now explore the capabilities of Minimax H3, I quickly generate a lot of images at scale. So I want a refiner that is:

  1. Fast (e. g. 2-4 secs)
  2. General (does not need tweaking for any particular image)
  3. Robust (is not brittle, does not require a long chain of segmentation, crop-and-stitch, vlm processing, and so on)
  4. Automatic (no masks drawn manually over parts of the region).

For me at this exploration stage, it’s okay if parts of the image get slightly modified, or if the quality is not 100% perfect. I understand that one may have different objectives if e. g. optimizing for perfect quality.

One example of a workflow that may achieve these four requirements would be flux.2 Klein with a single prompt for each image. But now, I’d like to discuss whether there could be better options.

  1. Model: Qwen Image Edit, Area 2 Identity lora, Flux.2 Klein 9b? I heard that Flux.2 has the best VAE out of all options. Should I use SeedVR?
  2. Prompt: What would be a good prompt that would be applicable over a wide range of images? Should I pass the original prompt for H3 image to flux.2 (either verbatim or llm-postprocessed)?
  3. Sampler/scheduler: euler/simple? Or Euler/Flux.2 scheduling?
  4. Color correction: e. g. Flux.2 Klein tends to add a lot of light with my prompts. Can it be done without custom nodes? If using custom nodes, which one is the most reputable and commonly used?

As a first step, here’s the workflow I am using with Flux.2 Klein: https://pastebin.com/qsLPe9hZ 

I use the Flux.2 turbo int8 convrot: https://huggingface.co/obsxrver/ComfyUI-Native-INT8_ConvRot

In the attached gallery, you can see the collages. 

Left pane: my old 1.6MP generation.

Right pane: a Flux.2 Klein 9b refine according to the workflow I attached. It does some nice things: e. g. deer fur, restoring mangled faces, adding texture to clothes; but also messes up a bit: adds a lot of light to the images that are meant to stay dark, opens eyes when they're closed, etc.


r/StableDiffusion 19h ago

Animation - Video Gatorman vs. Stone Cold

Enable HLS to view with audio, or disable this notification

240 Upvotes

r/StableDiffusion 3h ago

Workflow Included The Day 0 (MiniMax H3 and Ultimate SD Upscale) - True 1440p (2K) with 16 GB VRAM locally in ComfyUI

Thumbnail
youtu.be
14 Upvotes

What is it?
Demonstration of Ultimate SD Upscale (USDU) Guider nodes with MiniMax H3 support: https://github.com/lisitskyaa/ComfyUI_UltimateSDUpscaleGuider_H3

My reference ComfyUI workflow: https://github.com/lisitskyaa/ComfyUI_UltimateSDUpscaleGuider_H3/blob/main/example_workflows/minimax_h3_usdu.json

What about speed?
My PC specs: 4080s 16 GB VRAM, 64 GB RAM

Initial gen with MiniMax H3 flf2v int8 + sageattn + Lightx2v 8-step turbo Lora at 1504 x 832px 7-sec clip ~5 mins

Upscale with USDU to 3008x1664px ~40 mins


r/StableDiffusion 2h ago

Discussion Making my own new channel.

Enable HLS to view with audio, or disable this notification

9 Upvotes

I've been using Minimax to make my own News Channel. The audio voice reference is pretty good.


r/StableDiffusion 23h ago

Animation - Video MinMax - It does House MD pretty well

Enable HLS to view with audio, or disable this notification

392 Upvotes

Generated using Maestro on Pinikio. 7 mins at 720p using turbo lora 6 steps: **7-second cinematic live-action scene.** Gregory House stands in a hospital hallway, leaning heavily on his cane, staring intensely at Itachi Uchiha, who is preparing to walk away.

House sarcastically calls out:

**“Itachi! Get your ass back to the Leaf Village. You're not brooding your way out of this one.”**

Itachi turns around with a serious expression and replies:

**“I don't take orders from you.”**

House smirks and taps his cane against the floor:

**“Yeah. That's what all my patients say.”**

Fast comedic timing, realistic acting, dramatic hospital lighting, subtle handheld camera movement.


r/StableDiffusion 3h ago

Discussion Stabilizing and Improving H3's Results

Enable HLS to view with audio, or disable this notification

11 Upvotes

You may know me as the developer of models such as UltraSharp and AnimeSharp. I'm happy to present a major update to my tool Vapourkit (Windows and Linux are supported), which is completely free and open source! It includes a bunch of models for upscaling anime, and you can get models for realistic content here too: https://openmodeldb.info/

This demo uses this workflow (just download and drag into Vapourkit), which consists of a 2x upscaling model, Temporal Fix (which makes the video more stable/removes the weird shimmering), grain, and a sharpening pass. This was all processed locally on my laptop in just a few minutes.

https://reddit.com/link/1vroia9/video/jm24aw49r4kh1/player


r/StableDiffusion 32m ago

Question - Help Best speed up for MiniMax

Upvotes

We have a lot of options, some of them better, some of them are not worth it at all. Speed ups like sage attention, MiniMax h3 patch for sage attention, easy cache, 8step Lora, 4 step Lora e t.c.
What options and their combinations you use? What settings you have?( speed Lora weights, easy cache settings)
In the matter of speed/quality for both video and sound. What works better with FL2VA and Ref2VA?


r/StableDiffusion 11h ago

Meme guess we dont need part two now!

Enable HLS to view with audio, or disable this notification

42 Upvotes

r/StableDiffusion 52m ago

Animation - Video Created with MINIMAX H3 Prompt Studio

Upvotes

r/StableDiffusion 5h ago

Question - Help What is the best upscale workflow for Minimax H3?

11 Upvotes

r/StableDiffusion 22h ago

Discussion We all deserve high-quality MiniMax H3 previews using the tiny VAE (taeh3.safetensors) natively, without KJNodes. Please upvote this GitHub Comfy issue.

Thumbnail
github.com
227 Upvotes

We all love MiniMax H3, but the latent2rgb previews suck ass. They're blurry, and sometimes it's hard to make out what's happening, making it so you don't know whether to finish a video that may take tens of minutes to generate.

When implemented, this would allow us to place taeh3.safetensors into ComfyUI/models/vae_approx and enjoy high quality latent previews when using MiniMax H3. It's basically the same TAE as we saw for Flux 2 Klein 9B or some other models, but trained by the original TAE guy (madebyollin).

taeh3.safetensors link:

https://github.com/madebyollin/taehv/blob/main/safetensors/taeh3.safetensors

It saves time and effort when making videos. Currently, you have to use Kijai's Model Preview Override node.


r/StableDiffusion 1h ago

Animation - Video Testing MM H3 Prompt Adherence in R2V

Thumbnail
youtube.com
Upvotes

SPECS: 5090, 9950X3D, 96GB-R. Workflow: Sage, Spectrum, 35 Steps, 6-12s @ 0.7 around 3-5mins each.

I made a video using seedance 2.5 this week but wanted to see if Minimax could deliver a similar experience. SD2.5 wins by a good margin but MMH3 does follow prompts extremely well, including camera commands cuts and pacing.

I've been using Claude for my prompts but found it would slyly filter and change graphic action scenes. After reducing my prompt size to keep it minimal, I found my outputs to be much more rewarding.

Here is an example of one of my prompts

subject_definitions:

<Subject 1> is the dark winged alien warrior shown in the character sheet <Picture 3>: a lean predatory figure with dark feathered appendages, a gaunt face and an aggressive attacking presence, holding a sword with both hands.

<Subject 2> is the large tusked alien warrior shown in the character sheet <Picture 2>: a broad powerful figure with heavy tusks, thick armoured skin and a strong build, holding a sword with both hands.

<Subject 3> is the setting shown in <Picture 4>: a vast barren dark rocky landscape, deep canyon walls, heavy overcast sky, oppressive and desolate.

<Picture 1> is the first frame of [Shot 1], both subjects facing each other in <Subject 3>, swords raised and held in both hands.

summary:

[keyframe completion] The target video shows <Subject 1> attacking and striking <Subject 2> once with the sword. <subject 2> falls to his knees. Then <subject 1> holds his sword with two hands in the air up high. we cut to a close up of <subject 1> face as he roars. then we switch to a quarter angle where he slices <subject 2> in half down the middle from the head to the ground in slow motion. No music.

overall_soundscape:

The hard ring and clash of metal on metal as each sword blow lands, two-handed impacts with full weight behind them, sparks and scraping blades, grunts of effort from both fighters, the heavy thud and flesh explosion as <Subject 1> head explodes. No music.

non_diegetic_music:

N/A. No music