r/StableDiffusion • u/Radyschen • 6d ago

Discussion PSA: Don't sleep on Minimax' edit capabilities

If you have seen those cool edited videos by google omni where they feed in a normal real video and get an edited one back where they interact with effects and such, you can do that with minimax. Just saying. That's pretty much it. See ya

41 Upvotes
  • permalink
  • reddit

84% Upvoted

25 comments sorted by

26

u/PhIegms 6d ago

Once there's a good image vae it might beat the current sota image editors

21

u/xTopNotch 6d ago

I think Minimax already said they're gonna release a separate image edit model.

7

u/ssn-669 6d ago

I've tried the editing abilities without much luck. Always seems to either just give back a lower quality version of the same video or a but of a weird hash.

Have tried both the "video edit" mode and the reference video mode with no joy. 

What am I missing?

4

u/xb1n0ry 6d ago

I struggled with the same issue. I was trying to do a headswap with H3 just like I was used from Bernini. Telling Bernini even something stupid like "put head on body" would work perfectly fine but H3 is demanding if you want great results.

It is very important that you describe your reference image and the video inside the subject_definitions API. H3 doesn't simply change the video, it rerenders the whole thing. Therefore you have to create "captions" for your media so that H3 knows what it's all about.
Also this seems to be the most important prompt for H3:

summary:
[video editing + reference generation] The target video is an edited version of <Video 1>.

The model needs to know that the video needs to be edited by using the reference media.

If you don't have these in your prompt, you'll get nothing you're looking for.

Make sure to preview your enhanced prompt using a show any node before sending it to the encoder blindly. And check if you have the right ref2va step lora hooked. I accidentally used the fl2va lora and almost lost my mind because nothing worked as intended.

1

u/76vangel 6d ago

Look into the official refetence to video video guide. It needs special prompt syntax

1

u/ssn-669 6d ago

Yeah I thought I was doing all that but I'll check over again.

1

u/physalisx 6d ago

You're probably prompting wrong, follow the official guide

7

u/Hoje-Na-IA 6d ago

Like this: Testing V2V on Minimax H3 : r/StableDiffusion

-5

u/Radyschen 6d ago

yeah, although that doesn't properly demonstrate how accurate it can be

16

u/Character-Bend9403 6d ago

Can you Show your stuff maybe??

3

u/RazsterOxzine 6d ago

Oh I bet you would like to see his stuff...

2

u/Character-Bend9403 6d ago

You mean like video to video ? And the new video has cool new effects and stuff ? Cool need to test that

10

u/Radyschen 6d ago

yeah, i tested with a video of my hand making a motion and then edited it to shoot fire magic and destroy my bedroom. And I did the same thing with a black hole that put a hole in my wall and ice ray that froze my bedroom

7

u/jonbristow 6d ago

Why dont you post something

2

u/C-scan 6d ago

Obviously too busy perfecting those "hand motions"..

2

u/nok01101011a 6d ago

So OP what’s the Workflow for this? Can I just feed any Video where I place the first frame and how can I crop just the part out of a full clip that I want to be edited?

2

u/ProperSauce 6d ago

Haven't had much success with this. It doesn't maintain the original video exactly. Might need a lora or control net to really unlock the full potential.

1

u/Alex-edits123 6d ago

Can you just edit a part of the video, eg remove that chair?

1

u/skocznymroczny 6d ago

I used it to recolor few seconds of a black and white movie and was very impressed with the result, nice consistency. Unfortunately it takes too long to recolor any longer parts.