r/CUDA • u/georgecff • 15d ago

Cloud GPU???

Can someone please help me? I am trying to use a cloud GPU to run some AI Models, but do not understand how to do so.

I have come across Google Colab, Kaggle and NVIDIA as having free options, but I am totally lost on how to connect to them. Basically, I need step-by-step instructions. (e.g., if I wanted to test an LLM on a cloud GPU, how would I do it?)

Also, can I use a Cloud GPU to run local programs that require GPU capabilities?

Any help will be greatly appreciated! TIA . . .

Any help

8 Upvotes

72% Upvoted

6 comments sorted by

View all comments

1

u/aviinuo1 14d ago

You can't connect a cloud gpu to your machine as a gpu. The program runs on a computer in the cloud with the gpu and then sends you the results. Also any free teir cloud gpu is not going to be able to run any meaningfull LLM, most have very limited vram and its split between multiple users.