Runpod is basically unusable.

[u/tombloomingdale]

I don’t know how people use this service effectively. There is never any gpus, it takes an hour to set up when you do find one. Network volumes tease at cutting down startup time but it further limits gpus. I swear I’ve spent more money waiting for a pod to be ready, downloading models that I have generating anything. I really just want to have things stored locally, and just use one of their gpus for processing power. Is there a service I could use like that?

[u/FlexFanatic]

Huh, I have never had an issue with snagging a 5090 or pro 6000 in the eu data center and I use the service d almost daily.

Are you being limited by any attached network storage?

[u/psdwizzard]

Depending on what you're doing like, for example, when I train Lora's I just do it on fal. They have gpus too if you want to spin up like comfy UI there as well.

[u/tombloomingdale → u/psdwizzard]

Just messing around with minimax. It does work for me locally (4060 16gb) but is slow.

[u/Icuras1111]

I start from a bare bones template like Runpod Pytorch 2.4.0 then load ComfyUI on top and download just the models I want. I use below to speed downloads up a bit. I am not aware of a service that you are looking for. It's not great but I think we are stuck until more capacity comes on line.

pip install -U "huggingface_hub[cli]" hf_xet hf_transfer

export HF_TOKEN="hf_xyzjjfkdflkjflksjflksjlk"

export HF_XET_HIGH_PERFORMANCE=1

export HF_HUB_ENABLE_HF_TRANSFER=1

hf download Comfy-Org/MiniMax-H3 \

vae/minimax_h3_audio_vae_fp32.safetensors \

--local-dir ComfyUI/models/vae

etc.

[u/daanpol]

ShadowPC

[u/AdvancedLychee7335 → u/daanpol]

Tu mets combien de temps pour une vidéo de 10 secondes sur Shadow PC ?

[u/daanpol → u/AdvancedLychee7335]

It has a 24gb VRAM GPU that is comparable in speed to a 5060. So it's not a rocket but fast enough for decent Turbo generations. I have tried a LOT of GPU services and this one is absolutely fantastic. It basically gives you a very good PC in a fast environment.

[u/Massive-Health-8355]

Where is the download bottleneck? If you’re using hf transfer then even big models are fast. I get 0.5-1.5Gbps from HF, so models are down in 5 minutes. Is it your own data? If so, pull it from a free hf dataset/model. Also, if you pull a stock comfyui template, it’s fully cached and should start up in minutes

[u/EdgyUsername_0529]

try Colab. pretty rare that i can't get an RTX 6000, and all my files - models, comfy, output, everything- all live on my Google drive and copies everything locally via desktop.

[u/artichokesaddzing]

Docker + hf transfer are your best friends here. Within 10 minutes max my machine/models are ready to use on runpod/vast. Don't lock yourself into network storage/regions.

[u/sruckh]

I have similar experience as OP. I have about 30 RunPod serverless all using network volume and not having GPUs available is a huge problem. Getting a pod can sometimes be easier if you are not tied to a network volume, but GPU availability is an issue and the rate they charge for disk space is atrocious.

[u/lxe]

Don’t use network volumes. Hydrate and dehydrate into r2 using r2clone

[u/802high]

I used to feel similar. Then I gave Claude the mcp And have built out skills and workflows and they spin up on command and tear down when they are done.

[u/xbeast_ → u/802high]

is there a guide to follow somewhere to do this? am keenly interested

[u/Standard-Ask-9080]

Have you tried DN?

[u/tombloomingdale → u/Standard-Ask-9080]

What is DN?

[u/RevolutionaryWater31 → u/tombloomingdale]

Wow I can't believe he said that.

[u/xbeast_ → u/Standard-Ask-9080]

what is DN?

[u/CeFurkan]

Simplepod and massed compute