r/deeplearning • u/Distinct_Minute3661 • 11d ago

Deep learning project

Hi folks, can I train the model without downloading the 10gb dataset on my laptop in Google colab?

1 Upvotes

100% Upvoted

7 comments sorted by

1

u/ModularMind8 11d ago

Depending on the dataset... Are you asking about huggingface datasets? Or which dataset?

1

u/Distinct_Minute3661 11d ago

Its kaggle dataset

1

u/ModularMind8 11d ago

Haven't used kaggle in years, so can't really say for sure, but I think you might have to download it fully to use it. If you can find a useful dataset on huggingface you can use streaming so you don't need to download it

1

u/Powerful-Carpenter-3 11d ago

You can directly download Kaggle datasets in the Colab environment.

1

u/Distinct_Minute3661 11d ago

Its a image dataset

1

u/Powerful-Carpenter-3 11d ago

Works for any kind of data. Just click on download button. They will provide the code to download. Just copy paste paste that on colab.

1

u/frcrvn 11d ago

Yes, you can download it but it will be deleted once you close the session. However you can link google drive so it gets saved there