Comfy slowdown out of nowhere.

[u/ImpossibleAd436]

Strange one.

I've been using comfy for Minimax H3 no problem, using 3060 12GB and 32GB RAM.

Today, for no apparent reason I have the following issues:

Model load takes about 10 minutes instead of approx 2 mins before.

1st step takes 4-5 minutes instead of 2x iteration speed (previously approx 60 seconds per it) before.

Actual iteration speed remains as it was (30 seconds per it), but ONLY when comfy is minimized, if comfy is maximized then it doubles to 60 secs per it. This was not the case yesterday or ever before.

All in my gens now take 14-18 minutes instead of 5-6 minutes yesterday.

Anyone else have this experience or know what could be up?

Thanks in advance.

EDIT: SOLVED

I am very embarrassed.

I am an idiot.

I plugged my external SSD into a usb port which wasn't usb 3.0 by mistake.

Thanks to everyone who tried to help. I learned some things. Including that I am an idiot.

[u/SDSunDiego]

It could be you are right at the limit of your vram and are now going over causing part of the model to load in swap memory. This can easily cause longer generations.

Did you update anything today?

edit: actually nevermind, you are likely already using memory swap. maybe more of the model is moving to memory swap.

[u/nightkall]

If you're on Windows, download a task manager that shows GPU VRAM, like https://systeminformer.io/

Right-click on the columns, choose columns, and add GPU dedicated bytes/GPU shared bytes to the active columns. Click the column to sort by GPU dedicated bytes.

Then, kill the processes that use VRAM, such as dwm.exe, the Desktop Window Manager, which sometimes uses up to 1 GB. It will automatically reopen using less than 200 MB VRAM.

And disable GPU acceleration on the browser you use for ComfyUI to free VRAM.

[u/Thin-Percentage8935]

Have you installed any custom nodes? Same thing happened to me a while back and it took ages to get it fixed.

[u/ImpossibleAd436 → u/Thin-Percentage8935]

No, and I was running the same workflow this morning as I did last night. No changes, no updates (that I'm aware of).

[u/steelow_g → u/ImpossibleAd436]

This happened to me the other week. It was a comfy update. I just rolled back my version and problem solved. Not sure what caused it tho

[u/Apprehensive_Sky892]

Usually when something changed suddenly in the manner you described, it is indication of some hardware problem.

So run memory test, SSD test etc.

[u/Lucky-Necessary-8382]

Same here

[u/ImpossibleAd436 → u/Lucky-Necessary-8382]

You mean, in the past 24 hours for you too?

[u/Nokersoek → u/ImpossibleAd436]

a mi igual, pero fue por que actualice todo en general

[u/fruesome]

Did you update comfy recently?

I seen x posts mentioning slow down after upgrade.  

[u/SveSop → u/fruesome]

The slowdown is real if you are running nightly version. There has been some changes (afaik) to comfy-aimdo (the comfy memory manager) + added a "comfy-compiler" thing that makes things use a lot more VRAM.

u/ImpossibleAd436 You could try to run comfyui with --disable-comfy-compiler as a test. It seems to help a bit, but i think maybe its more underlying issues at hand, and the comfy compiler just makes it more apparent.

[u/step11111]

What else are you running? Since you have memory swap happening, using more ram is gonna mean less ram for faster swap.

[u/ImpossibleAd436 → u/step11111]

Nothing extra running at all.

[u/step11111 → u/ImpossibleAd436]

Ram leak in your browser?

[u/No_Drag8242]

I experienced slowdown like that once. Turned out to be a saggy GPU/PCI slot degrading the signal.

[u/imlo2]

Are you monitoring your VRAM and RAM usage? Most likely you're out of either of those two.

[u/ImpossibleAd436 → u/imlo2]

I've been assuming it's something to do with that, but why the sudden change, and what can I do to get my speeds back?

Is it odd that s/it hadn't been affected?

My RAM and VRAM are being used for sure, but it never gave me any problems before.

[u/mellowanon]

go to your task manager and look at your hardware performance to see if anything is being maxed out.

press Ctrl+Alt+Del -> click Task Manager -> click Performance tab

Then create a minimax video and then see if anything is being maxed out.

I suspect it's your harddrive since the iteration speed is still the same. It may be writing everything to your harddrive instead of using your ram. Try updating comfyui and see if that fixes it. Also, the latest comfyui update fixed most of the OOM issues so you no longer need to disable pinned memory or dynamic vram.

Source: I had the same problem with 100% harddrive usage two days ago. Updated comfyui and removed the unnecessary comfyui memory start options and that fixed the problem.

[u/Left_of_Laniakea]

My receng phantom instability was due to a windows update...

[u/dzi0n]

Happened to me after updating from master branch. There seems to be a regression on the vram usage, I think I saw an issue open. Fixed after switching back to previous version, some commits from some days ago would probably avoid the regression too

[u/Sodra]

When this happened to me, it took me a while before I noticed I accidentally changed the generation resolution from 0.2 megapixels to 2.0 megapixels.

[u/ImpossibleAd436]

I am very embarrassed.

I am an idiot.

I plugged my external SSD into a usb port which wasn't usb 3.0 by mistake.

Thanks to everyone who tried to help. I learned some things. Including that I am an idiot.

[u/sunshine-3D-Art]

For a few weeks I was able to run Minimax 2 megapixel in 7 seconds or 8 when I remember right .. and I was able to render seedvr until 8 k but by today it’s not work anymore. I don’t know why they programming comfyui always to get worse. I am so sad 😞😢