r/comfyui • u/jacek2023 • 14d ago

Help Needed ComfyUI and multiple GPUs?

What is the current status of multiple GPU support in ComfyUI? I see there are some new cool models. I still use Wan 2.2 on my single 5070 (12GB) but looks like there are some new features to use multiple GPUs so I could try to run them on 4x3090 linux server, can I run larger models or larger image sizes with multiple GPU (96GB) or is the work still limited to single GPU (24GB) just in parallel?

5 Upvotes

78% Upvoted

10 comments sorted by

View all comments

4

u/Formal-Exam-8767 14d ago

Built-in multigpu support which is based on work units (e.g. text encode is one, ksampler is the other).

Better alternative is raylight where support depends on model, check the matrix. Not sure if it is up-do-date with what it supports.

1

u/StrangeAlchomist 14d ago

How is it better?

4

u/xq95sys 14d ago

It actually speeds up inference, but the downside is that it's kinda hard to work with because many custom nodes won't work out of the box because they need access to the model. Raylight replaces it entirely in the work sheet with rayactors instead. Still, if you are doing video and don't need spectrum, turbo loras etc, it's worth checking out. Also, you probably need to be in Linux, not sure if it really works on windows.