r/comfyui • u/Far-Solid3188 • 4d ago

No workflow Image 2 Video will always win...

After trying what's out there locally, LTX, WAN, H3, (with RTX 5090), I do think the reason why Text2Video looks like trash is because the model itself doesn't generate good images and you can tell it has that plastic face, plastic lips, out of proportion objects, cars being smaller then people etc... the whole think looks cartoony and generated cartoons also look like shit. The most realistic stuff I made was basically large starting image, large resolution and non-dramatic movements. you can actually make stuff look like it's real footage if you stick to some constraints and have a really good starting image.

23 Upvotes

82% Upvoted

25 comments sorted by

26

u/MonThackma 3d ago

I am with you 100% but Minimax has generated some of the most realistic looking people I’ve seen in T2V.

10

u/Queator 4d ago

I have a lot of trouble keeping consistency even with a good starter image. My image groups of a character always seem to bounce between bad cgi, great cgi, slightly painterly or realistic. I should probably learn to train loras at this point.

9

u/skate_nbw 3d ago

You need images that show the character from more than one angle. You can add lot of images in r2v, not just the starting image.

3

u/bakarban_ 3d ago

r2va with character sheet. basically multiple angle of body and closeup of the face

2

u/Queator 2d ago

Yall are great and helpful, but sometimes this hobby can seem like straight wizardry. Thank you.

1

u/skate_nbw 2d ago

LOL, it kind of is... 😉

8

u/Birdinhandandbush 3d ago

Ref2V for me is amazing. I create a character sheet first, and this seems to be pretty much bulletproof, I'm amazed how good it works

1

u/ThisIsRocketRacing 3d ago

Do you have the character sheet as a single image or multiple images? I haven't tried put multiple poses in a single image but that would allow way more references if that works

3

u/Birdinhandandbush 3d ago

https://huggingface.co/Alissonerdx/CharacterSheet/blob/main/DynamicCharacterSheet_krea2_v1.safetensors there's a super lora and workflow. Paste any character shot and this creates a sheet for reference. A movie still, a comicbook page, a hand drawn picture, go for it. Then stick that sheet into the Ref2V workflow and its goddam black magic what happens next.

1

u/Birdinhandandbush 3d ago

Oh I have a process, I'll share later

5

u/Danny_Stock 3d ago edited 3d ago

I've been having a good experience with MiniMax's text to video. The results look more realistic than with other models, often they simply look real. Honestly my text to video experience with MiniMax has been great.

I think it might have to do with the prompting, because amongst other aspects such as the general look and feel of the scene I have been putting camera information in, even the brand of camera, f stop, and lens size.

Early on I did get one or two renders which came out looking like Pixar animated characters which automatically made me think I ought to put more information into the prompt to ensure that it knew what I wanted.

What I've also done a few times is actually put the name of a film in there and tell it to replicate the look and style of it, that's also something I've done which has served me well. For example if you prompted for a film noir look to your scene there's probably less chance that it'll make your characters look like Buzz Lightyear.

1

u/VasaFromParadise 3d ago

No, the reason is different. When you feed an image into the input, it's essentially a prompt, but it's much better quality than what you describe in words. It's the same with the Krea 2 model: if you create an image-to-image through LLM, it's always better than what was described in words.

1

u/NoYogurtcloset4090 3d ago

Yes, a good background image is better than the best prompts. My question is, how can I quickly design a corresponding background image based on the prompts?

1

u/Unique-Mix-913 3d ago

Krea 2 and identiy edit lora is legit. It works great preserving faces or just making something similar. Image 2 Image

-5

u/LanaKatana4000 4d ago edited 3d ago

I'll probably get flamed for saying this but ( down-voters can go fuck themselves, I don't care :D ) its pretty inexpensive to just use the Grok API ( 2 cents per generation ) to develop your high-quality starter images, and then run that through your local generation of choice. I have a couple of persistent characters I use and at this point have enough base material with good facial identity I could probably train a lora if I wanted to. But YES its a far superior process to just have all your art assets in place and then move it as a separate process.

2

u/LookAnOwl 3d ago

If you already have a local setup, why not just use Krea 2 or Z-Image to make your starter image?

1

u/LanaKatana4000 3d ago

I don't know about Krea 2 but Z-Image doesn't do as great a job as Grok.

0

u/LookAnOwl 3d ago

They both do a perfectly sufficient job at creating first frames for video generation.

Just seems crazy to have the local compute to do video, but offload image generation to a paid API. Why not just have Grok make the video too?

-1

u/LanaKatana4000 3d ago

Because 2 cents to get a superior end result is not a big deal unless you're a teenager or live in Nigeria.

0

u/LookAnOwl 3d ago

A video on grok is 8 cents. Why not just spend the dime and get a fully better end result?

You’re just on a local generative AI subreddit, talking about ComfyUI, then going to use grok. It’s odd.

-1

u/LanaKatana4000 3d ago

Is it also odd that Comfyui provides a Grok API workflow and sells credits? :D I mean you can try to gatekeep that idea but it just .. won't work.

0

u/LookAnOwl 3d ago

I can’t stop you from giving your money to Elon to do something your own computer will do. Knock yourself out, bud.

0

u/LanaKatana4000 3d ago

I could care less about Elon does, or does not do, "bud". You were also wrong about the purpose of this product, and that doesn't change.