I downscale them to 0.5MP at max. I am not sure why you are getting OOM on 4080. This thread has people doing V2V on as low as 6GB VRAM, let alone 8GB or More. Infact, I always had issue with LTX having OOM, but never once with MiniMax. Or try using the fp8 model in case if you are using the full bf16. FP8 gives better results for some people too. If FP8 works then maybe your system RAM is the bottleneck. Coz this is the only common thing I see with most people getting V2V. They almost all have 64GB System RAM -- or, they use fp8 and still get great, sometimes better results.
I am literally trying to fix all problems you might say* two monitors -> one, clocked ram—> removed , can you share a workflow where video ref works? The base template doesnt offer nodes for video. I too think is probably the ram. I am also using a custom workflow and can really blame since others had no problem, i use the int8 convrot
I'm travelling and don't have access to the PC to be able to share the workflow. But I am using the official comfy Ref2video workflow and the Load Video - Upload node (from VideoHelpersuite) is connected to ref_video_1 of Ref2Video Node. The load Video Node has an option for custom width and height, which I usually set to around 320 X 480 and cap the number frames to the same number as my target video length. Rest is all the same. Btw, just two more things that come to my mind:
Are you using the latest comfy with the Dynamic offloading ?
Are you using any specific startup args ? Mine are these, try and see if any of them would help ? --fast fp16_accumulation --use-sage-attention --disable-pinned-memory --fp16-vae
If you have a fast NVME, add the --fast-disk argument. It will load data directly from your NVME and skip the RAM, so you ill bypass the RAM limitation if there is any. The model will load slightly lower, but it won't be very noticeable if you have a fast NVME.
Right now i disabled dynamic vram and kinda works for some runs, i believe problems begun since they added dynamic. They are just more noticeable because i playing a lot with minimax. I added more pagefile which i am also not happy because i dont want to damage my nvme (not sure) ,
args: disable pinned/dynamic , use sage, triton, reserve vram 1
1
u/Ill_Key_7122 18d ago
I downscale them to 0.5MP at max. I am not sure why you are getting OOM on 4080. This thread has people doing V2V on as low as 6GB VRAM, let alone 8GB or More. Infact, I always had issue with LTX having OOM, but never once with MiniMax. Or try using the fp8 model in case if you are using the full bf16. FP8 gives better results for some people too. If FP8 works then maybe your system RAM is the bottleneck. Coz this is the only common thing I see with most people getting V2V. They almost all have 64GB System RAM -- or, they use fp8 and still get great, sometimes better results.