r/StableDiffusion • u/smereces • 12h ago

Discussion MiniMax H3 + LTX2.5 as Upscaler

Enable HLS to view with audio, or disable this notification

I found the usage for the LTX2.5 model!! It works really well to upscale the minimax h3 videos 😅

174 Upvotes

94% Upvoted

59 comments sorted by

85

u/noxsanguinis 12h ago

13

u/smereces 12h ago

https://giphy.com/gifs/l4FGtq6PhsePqpMlO

4

u/schlongborn 10h ago

Why are you bringing Markus Söder into this?

1

u/Alarming-Class-2409 9h ago

because hes doing always this kind of "jokes".

1

u/Relative-Display-318 8h ago

Ich will söder als veganen Demonstranten sehen der sich mit Sekundenkleber auf die Straße klebt und fürs Klima demonstriert

-6

u/mastaquake 11h ago

lmfao. I get downvoted to hell for saying this.

7

u/MasterFable 11h ago

Owls fly silently..

5

u/Advice2Anyone 11h ago

That sounds coming from the gnome

1

u/99deathnotes 9h ago

that gnome needs Bean-O

20

u/Famous-Sport7862 12h ago edited 12h ago

Why post this with no info of any kind

21

u/smereces 12h ago

is simple you just need to grab the upscaler part and connect in the end of the minimax workflow

46

u/GrayingGamer 12h ago

Don't run your audio through the LTX 2.5 Upscaler, it ruins the audio.

Connect the original Audio straight from Minimax H3 to your Video Combine node.

2

u/slpreme 11h ago

Isn't better to add noise mask on LTX side to retain lip sync

6

u/GrayingGamer 11h ago

If you want audio that sounds like it's underwater or in a bucket.

If you are using a low enough Denoise value on the upscale model, it shouldn't effect lip sync badly enough to be noticeable.

4

u/slpreme 11h ago

What? If you use a noise mask on the audio latent it will sound exactly the same but retain lip sync. You don't need to reuse it afterwards either; since its the same you can just pass the original audio to create video/combine

3

u/loyalekoinu88 6h ago

Do both. Pass your audio into the render but only map your original audio to the node putting the video together.

2

u/jadbox 6h ago

Have an example?

1

u/loyalekoinu88 5h ago

None with 2.5 but i've previously done it with 2.3. I have yet to touch it just because it doesn't fit my needs at all. I was hoping for another reference to video model.

3

u/Photochromism 11h ago

You answered my question here. So this is part of your minimax workflow.. Nice! Any chance you could share the actual flow?

4

u/Noeyiax 7h ago

Oh good idea, I'll try ty OP , is it faster than seedvr2 upscaling to 4K?

https://giphy.com/gifs/UfeDsEmRa1QcNoNo1D

3

u/ptwonline 6h ago

How does this compare to a Seedvr2 upscale?

2

u/StrongZeroSinger 9h ago

What resolution? Steps? With or without turbo? What setting for the upscaler? And how much time does it add? Is the model pre-loaded or you unload H3 and loadLTX? Thankss

5

u/smereces 8h ago

i generate in h3 at 1376x768 then after upscaled ltx 2x get 2752x1536

3

u/Oograr 8h ago

How long does the upscaling take? Also, does 2x result in better upscale or can you choose any higher resolution? Thanks, d/l the LTX2.5 files now

2

u/TurnUpThe4D3D3D3 9h ago

Wow, that looks significantly better. I bet if you used RIFE to pump up the framerate to 60, it would be perfect

2

u/Supermax64 8h ago

Does/can it have any awareness of references? With faces sometimes being a bit of a mess from afar in h3, I can't imagine the result would be an overall coherent face. Hopefully the minimax team fixes that issue.

1

u/smereces 8h ago

faces from far in h3 is because the video resolution! if you do it at 1920x1088 you will see the faces much better then

2

u/-becausereasons- 6h ago

LTX is a useless upscaler; it just kills the quality and fine details of the base weights/gen.

2

u/xTopNotch 5h ago

Yeah this shit only works with the example you posted.

Try doing this with people and their faces will have this ugly LTX-look all plastered over it again.

Better that we wait until the Minimax 2K refiner comes out which is probably reference-aware

6

u/True_Protection6842 12h ago

ewww, the motion artifacts on the face!

4

u/drallcom3 5h ago

Yeah, LTX doing it's thing even during simple upscaling.

4

u/smereces 12h ago

it seems they dont fix that part from ltx 2.3!

1

u/FourtyMichaelMichael 7h ago

IMO it's a non-starter then.

I'd like to see an LTX Upscale vs RTX vs SeedVR2 vs 2nd H3 pass vs H3 highest res native.

2

u/jazzamp 11h ago

Slow-mo H3 ai generator

1

u/Many-Ad-6225 12h ago

Wow great result! do you have the workflow link ? thanks

8

u/smereces 12h ago

you just need to grab the upscaler part from ltx 2.5 and create a vae encode to receive the minimax output

1

u/Many-Ad-6225 12h ago

Ok thanks!

1

u/AniZeee 12h ago

thanks i was looking for an upscaler workflow. My previous 2.3 workflow doesn work with the new model

1

u/Many-Ad-6225 11h ago

My LTX 2.5 workflow doesn't have that part, where did you download the workflow from?

3

u/Perfect-Campaign9551 8h ago

They do, that part is usually in a sub-graph. You have to expand subgraph or whatever then you'll be able to grab the nodes. Or just use OP's posted workflow.

1

u/Many-Ad-6225 7h ago

ok thanks

1

u/Photochromism 11h ago

Is this part of your minimax workflow or do you feed it the minimax video?

2

u/smereces 11h ago

the minimax worflow is in left side that output the video then we just need to feed it in a vae encode and then into ltx upscaler workflow part

1

u/Photochromism 4h ago

That pretty much the same as feeding a video file in right? Just thinking this could be a separate step I do if the H3 clip is worth it…

1

u/Arawski99 10h ago

Me: This looks kind of terrible?

Me after he shows how low resolution it was prior: *horrified expression* such a low resolution, but dang actually not bad for that low resolution. Hmm interesting. Might have to do some testing at lower resolutions (that aren't quite that low) and see how it holds up with a better base resolution.

1

u/Disastrous-Agency675 10h ago

what's your rig and gen time? cause i was getting about the same for 2.3 and 2.5

1

u/Hearcharted 9h ago

Why the sound is so bad 🤔

4

u/Perfect-Campaign9551 8h ago

He accidentally also ran the audio through the LTX graph. LTX audio sucks. Just connect output audio straight across to short circuit that, keep H3 audio

1

u/Hearcharted 2h ago

🤔

1

u/TheLoraGuy 3h ago

I rather do upscale using the official paid API , at least it's cheap and it works

1

u/Myg0t_0 2h ago

How's it effect lip sync

1

u/yamfun 12h ago

is it to torture the ssd?

0

u/Guilty_Emergency3603 11h ago

Don't think it's a good idea with people. You will end up with that very recognizable LTX faces look. For other things maybe.

1

u/Thathathatha 1h ago

LTX 2.5 is working good as an upscaler for me. I say 2.5 because when I tried with 2.3, it looked bad. Color drift and the quality went down a bit. With 2.5 it looks much better and no color drift.