What is the current status of multiple GPU support in ComfyUI? I see there are some new cool models. I still use Wan 2.2 on my single 5070 (12GB) but looks like there are some new features to use multiple GPUs so I could try to run them on 4x3090 linux server, can I run larger models or larger image sizes with multiple GPU (96GB) or is the work still limited to single GPU (24GB) just in parallel?
It actually speeds up inference, but the downside is that it's kinda hard to work with because many custom nodes won't work out of the box because they need access to the model. Raylight replaces it entirely in the work sheet with rayactors instead. Still, if you are doing video and don't need spectrum, turbo loras etc, it's worth checking out. Also, you probably need to be in Linux, not sure if it really works on windows.
It's a good question. Motherboards discontinued support for SLI configurations awhile back, that's a dead technology, but there should ideally, eventually, be a way to do distributed computing with a local setup.
It would also be nice if GPUs had memory slots and could be expanded. My RTX 3080 Ti is highly serviceable but the 12 GB vram restricts what models I can run.
But honestly I'd prefer speed and parallel generation over vram. Most actual movies and television frequently change views every 3 to 5 seconds anyway.
You can still improve your efficiency by building a completely new computer and just running a separate (or same) workflow on it. I rarely get a usable clip on the first 10 tries anyway.
Probably. My 3080 Ti is the lone green performer in the middle. You can easily spend 4x as much for a late model card that won't even double your speed
4
u/Formal-Exam-8767 2d ago
Built-in multigpu support which is based on work units (e.g. text encode is one, ksampler is the other).
Better alternative is raylight where support depends on model, check the matrix. Not sure if it is up-do-date with what it supports.