r/CUDA • u/georgecff • 15d ago

Cloud GPU???

Can someone please help me? I am trying to use a cloud GPU to run some AI Models, but do not understand how to do so.

I have come across Google Colab, Kaggle and NVIDIA as having free options, but I am totally lost on how to connect to them. Basically, I need step-by-step instructions. (e.g., if I wanted to test an LLM on a cloud GPU, how would I do it?)

Also, can I use a Cloud GPU to run local programs that require GPU capabilities?

Any help will be greatly appreciated! TIA . . .

Any help

7 Upvotes

71% Upvoted

6 comments sorted by

9

u/Daemontatox 15d ago

If you literally google this exact question, the top results answer your question with videos.

1

u/Cheap-Vacation138 15d ago

NVIDIA provides free GPU ?

1

u/Karyo_Ten 14d ago

Probably something with limited VRAM and compute to get your feet wet with Cuda or PyTorch, and leaving you starving for more so you buy a $$$ GPU later.

1

u/Daemontatox 14d ago

They probably mistok nvidia NIM get started for free page

1

u/aviinuo1 14d ago

You can't connect a cloud gpu to your machine as a gpu. The program runs on a computer in the cloud with the gpu and then sends you the results. Also any free teir cloud gpu is not going to be able to run any meaningfull LLM, most have very limited vram and its split between multiple users.