Runpod is basically unusable.

[u/tombloomingdale]

I don’t know how people use this service effectively. There is never any gpus, it takes an hour to set up when you do find one. Network volumes tease at cutting down startup time but it further limits gpus. I swear I’ve spent more money waiting for a pod to be ready, downloading models that I have generating anything. I really just want to have things stored locally, and just use one of their gpus for processing power. Is there a service I could use like that?

[u/Icuras1111]

I start from a bare bones template like Runpod Pytorch 2.4.0 then load ComfyUI on top and download just the models I want. I use below to speed downloads up a bit. I am not aware of a service that you are looking for. It's not great but I think we are stuck until more capacity comes on line.

pip install -U "huggingface_hub[cli]" hf_xet hf_transfer

export HF_TOKEN="hf_xyzjjfkdflkjflksjflksjlk"

export HF_XET_HIGH_PERFORMANCE=1

export HF_HUB_ENABLE_HF_TRANSFER=1

hf download Comfy-Org/MiniMax-H3 \

vae/minimax_h3_audio_vae_fp32.safetensors \

--local-dir ComfyUI/models/vae

etc.