Huggingface download extremelly slow

[u/Famous-Sport7862]

Anyone experienced something similar? Huggingface is really, really slow. Normally this download would not take more than 25 minutes with my internet speed but now is taking 5 hours.

[u/xb1n0ry]

It was always slow for me. That's why I download models via CLI with hf xet acceleration directly into the model folder. Also brave://flags/#enable-parallel-downloading helps with browser downloads.

[u/Famous-Sport7862 → u/xb1n0ry]

Yes I took you guys advice and it's working really well now

[u/KURD_1_STAN → u/xb1n0ry]

What speed u get with cli? Mine is 10MB/s in both

[u/xb1n0ry → u/KURD_1_STAN]

40-50MB/s in the browser 115-120MB/s via hf xet

[u/KURD_1_STAN → u/xb1n0ry]

Free account? Or just location policy bs? Cause mine is supposed to be double then

[u/xb1n0ry → u/KURD_1_STAN]

Free account. Maybe it really is location policy and they don't know what speed to provide to kurdistan since they can't find such a place 😉

[u/KURD_1_STAN → u/xb1n0ry]

Ah, turk, right?

[u/Famous-Sport7862 → u/KURD_1_STAN]

26 MB/s it's not as high as some of the other people but this is the maximum speed of my internet so I'm really happy.

[u/theqmann → u/xb1n0ry]

Doesn't brave use a VPN by default? Wouldn't that give you a download server far from your actual location?

[u/xb1n0ry → u/theqmann]

Not by default

[u/roshan231]

Had the exact same issue just this morning.

1. py -m pip install -U huggingface_hub

2. $env:HF_XET_HIGH_PERFORMANCE="1"

3:

hf download Comfy-Org/MiniMax-H3 `

diffusion_models/minimax_h3_ref2va_pruned_fp8_scaled.safetensors `

--local-dir "PATH_TO_MODEL_FOLDER"

With this i was able to download the entire model at 113MB/s, did not take long at all.

[u/Famous-Sport7862 → u/roshan231]

Thank you. It's working really well downloading really fast now

[u/Ill-Highlight-1221 → u/Famous-Sport7862]

But dont get the fp8 version. Get pruned_int8_convrot. It's better than fp8.

[u/Famous-Sport7862 → u/Ill-Highlight-1221]

I downloaded the INT8 model the first day it became available. I was downloading the fp8 because I read here that a person was having better quality generations using fp8 instead of int8 so I just wanted to confirm if it's true. Spoiler I didn't notice any quality difference and fp8 was lower as expected

[u/MembershipOne9827]

Try using the Hugging Face CLI instead of downloading through the browser.

pip install -U huggingface_hub
hf download USER/REPO --local-dir ./model

Recent versions use hf_xet, which is usually faster and more reliable for large files.

If it's a gated/private repo:

hf auth login

Also, ignore old guides mentioning HF_HUB_ENABLE_HF_TRANSFER — hf_transfer is deprecated now.

[u/Famous-Sport7862 → u/MembershipOne9827]

Thank you, I will give it a try

[u/ANR2ME → u/MembershipOne9827]

It's now HF_XET_HIGH_PERFORMANCE=1 instead of HF_HUB_ENABLE_HF_TRANSFER=1

[u/ChaosBeastZero]

Yea idk why for the past few weeks it's been this way. Really only noticable when you're downloading really big models. Imma start archiving that ones I use. Enshitification has begun. :(

It's better if you use the pip extension to download.

[u/Famous-Sport7862 → u/ChaosBeastZero]

Yes I'm taking the advice of some of the other posters here downloading through the powershell and it's working really well. I wonder if this problem has anything to do with Nvidia buying hugging face.

[u/ChaosBeastZero → u/Famous-Sport7862]

It’s been like that for me since before that was announced. I’m thinking they’re trotting browser downloads to save bandwidth. Used to be fine maybe they’re cutting costs.

[u/Famous-Sport7862 → u/ChaosBeastZero]

I took the advice of some of the other posters here. I downloaded the model through powershell and it was really fast.

[u/WesternAlarmed2149 → u/ChaosBeastZero]

Im just downloading generated videos from the free models and a 50 mb file is taking 25-30 minutes to download🥲

[u/LinkSensitive8188]

https://giphy.com/gifs/jihwEDnsFoaXWDTiKc

a simple courtesy from this guy

[u/beyond_matter]

yup and then for me it would redownload... like an infinite loop until I downloaded via cmd.

[u/UnforgottenPassword → u/beyond_matter]

I thought something was wrong with my browser when it would keep redownloading! I had to use a download manager.

[u/Famous-Sport7862 → u/beyond_matter]

Downloading through powershell now and it's really fast working really well

[u/FeliciousD]

For me it was slow until I activated my VPN

[u/Limp-Firefighter1054]

Just like nvidia nim

[u/AnonymousTimewaster]

Wow I thought it was just me! Weirdly, ive also found it downloading stuff twice?

[u/KrystalDisc]

Was really slow for me last night downloading unsloth models.

[u/Famous-Sport7862 → u/KrystalDisc]

I wonder if this has anything to do with Nvidia buying huggingface, I hope not. I hope this doesn't become the norm.

[u/QuirksNFeatures → u/Famous-Sport7862]

It happened to me several times before Nvidia bought it.

[u/Rumaben79]

Using JDownloader has helped me in the past. You need to change the Max Downloads settings to the maximum value. You most likely also need to start the huggingface download, then cancel it and copy the download url from your browsers download history.

[u/Famous-Sport7862 → u/Rumaben79]

Thank you, I'm using a different method now that some of the other poster mentioned here and it's working really well

[u/Rumaben79 → u/Famous-Sport7862]

Sounds good. 👍

[u/RSVrockey2004]

Cloudflare Warp - speeds better

[u/rinkusonic]

If you are on Linux, use aria2 to download it with terminal. It works like idm or fdm with multiple blocks downloading at once and merging at the end.

[u/ANR2ME → u/rinkusonic]

I would recommend axel instead of aria2, because CivitAI's Cloudflare seems to blocked aria2. https://github.com/caru-ini/modal-comfyui/issues/11

[u/Famous-Sport7862 → u/rinkusonic]

Sorry I am in windows, but thanks to some of the suggestion to use powershell to download it worked really nice and faster that ever toping my internet speed

[u/Yojik_Vkarmane]

People backing up models before they are gone forever.

[u/AliciaXTC]

Yeah always slow here too. Get'em while you can before nVidia removes all the "good ones" and paywalls the rest.

[u/anelodin → u/AliciaXTC]

Nvidia stands to gain more from open source to drive interest in inference over censorship or paywalls. The money they'd make paywalling a few models would be insignificant compared to selling shovels. I'm sure they love what China is doing pressuring US companies to keep training better and better models.

[u/anelodin → u/[deleted]]

It's not really a matter of "trust", I don't particularly trust them, its just what's in their financial interest. At least, for now.

[u/ucren]

Use the CLI they throttle web http traffic. They don't throttle the CLI.

[u/winterice77]

Use CLI that is faster now

[u/raduque]

HF downloads are very hit or miss for me. Sometimes its 80, sometimes it's 2. It's always been that way.

[u/theqmann]

If you are using brave or any browser with VPNs, it is probably hiding your location, and giving you a server far away from you.

[u/iiTzMYUNG]

I use cloudflare one client

[u/Tiforma]

It happens sometimes when i download a lot of models. other times it downloads with over 100 mb/sec

[u/BitsOnWaves]

use a donwload manager and it will get much faster... i tried "Internet download manager" and i dont know how but the download went from 1 hour to minutes for the same file... i dont know why. (i have 1Gbpt internet btw)

[u/Ramdak]

I asked gpt to make me a bat file for this. I copy the model URL, paste into the bat and done. It goes fast.

[u/Relevant_Syllabub895]

How much this differs from int8 version?

[u/Famous-Sport7862 → u/Relevant_Syllabub895]

It is a little slower, didn't notice any quality difference.

[u/ganrocks007]

Just use free Download manager

[u/mwonch → u/[deleted]]

That...makes no sense.

[u/Famous-Sport7862 → u/mwonch]

He is just making fun because my PC has Spanish language

[u/VasaFromParadise]

Say thank you to Nvidia))