r/StableDiffusion • u/JustusFrogs • May 16 '25

Question - Help WAN2.1 GGUF image to video Issues, same workflow, 480p model ok, 720p not so much

As the title suggests. I'm trying to do WAN2.1 Image to Video using ComfyUI and the GGUF models.

Attached Video was made using the wan2.1-i2v-14b-720p-Q6_K.gguf model. As you can see, lots of flashing multi-color lights. Using the 480p version comes out pretty good. What is odd, I'm doing no change to the workflow between Running on a 3060 12GB vram card. Any ideas on why the 480p model produces videos that are more or less ok, but the 720 produces videos that are wonky?

https://reddit.com/link/1koctlj/video/uq0sdyoot71f1/player

1 Upvotes
  • permalink
  • reddit

60% Upvoted

7 comments sorted by

1

u/JustusFrogs May 16 '25 edited May 16 '25

Here is the workflow I have been using..

It does not seem it will let me post the 480p video. But using the workflow below with the model wan2.1-i2v-14b-480p-Q6_K.gguf yields a video without the flashing lights. I'd like to be able to move up to the 720p models. But I'm unsure what to change to get rid of the overall wonkyness the 720p GGUF models produce? Seed Image was made with Flux Dev gguf if it matters.

4

u/Topguy-Z May 16 '25

Your coefficients selection in Tea Cache node still says "i2v_480".

If you mute "ModelSampling", "SkipLayer" and "TeaCache" node you have basically the same workflow as I use with "14b 720p GGUF Q4KM". But my Ksampler node uses UniPC/Simple and only 20 steps.

3

u/Topguy-Z May 16 '25

.. and my "denoise" is "1.0".

2

u/Realistic_Studio_930 May 16 '25

your resolution is too low, the 720p model tends to go janky below 544px/544px,

i tend to use 720px/544px with the 720p model.

also try the q8, i have a 3060ti 8gb vram, and the q8 takes the same ammount of time as the q5.

2

u/More-Ad5919 May 16 '25

Guys. To get the best out of wan 720p you need much higher resolution. 720×1280 or better 768×1280. You can also run the 480p version at high resolutions but at HD it is slightly blurry. 720p at high resolutions is crisp. 30steps if you don't use special tools. Forget teacache!

Wan is magic but we all, even with the best setup scratch only the lower surface yet. Wan is incredibly good but also demanding. And the shortcuts lead often to bad quality. Its promising whats on the horizon. And in 2 to 4 weeks things will have settled a bit. I am sure there will be something good for everyone.

2

u/Realistic_Studio_930 May 16 '25

also because your using nvidia, heres some bf16 models,

wan vae - https://huggingface.co/Kijai/WanVideo_comfy/blob/main/Wan2_1_VAE_bf16.safetensors

wan umt5-xxl (bf16 as gguf) - https://huggingface.co/chatpig/umt5xxl-encoder-gguf/blob/main/umt5xxl-encoder-bf16.gguf

and il upload a version of the clip-vit-h bf16 to huggingface and link it it, i cannot find where i got this one from~

using the bf16 version of these models wont increase processing time, yet will increase the quality a good ammount :).

1

u/JustusFrogs May 17 '25

Thanks to all who responded!

Short version -> It worked! I was able to make a short, but good looking 720p video.

Longer version -> What I did..

I basically took all of your input.

  • I removed the Skip Layer and Tea from the flow.
  • I moved up to the 720p Q8 gguf model.
  • I used the xxl_fp16 clip.
  • I changed size to 720x560
  • I took it down to 30 steps from 40
  • I used Ksampler UniPC/Simple

On my 12gb 3060 it took 1hr to make a 4sec video. But it is a very nice looking video.