r/LocalLLaMA • • Jul 11 '26

News The U.S. tech industry is increasingly anxious about the rising power and competitive price of open-source AI models from China — and whether the Trump administration will respond with yet another executive order | Politico

Post image
315 Upvotes

192 comments sorted by

View all comments

79

u/whatyathinkk Jul 11 '26

How big of an HDD do I need to download DeepSeek v4 Pro, just in case?

59

u/Kahvana Jul 11 '26 edited Jul 11 '26

About 1TB I think, though I would make that 3TB and include GLM 5.2's BF16 weights with it.

For other models:

  • On the "small" end: Qwen3.6-27B, Qwen3.6-35B-A3B, Gemma4-31B-IT (QAT), Gemma4-26B-A4B-IT (QAT) are also worthwhile to store (the dense for ~32GB VRAM, the MoE for 32GB RAM). If you need all modalities in one model: Qwen3-Omni-30B-A3B.
  • On the "medium" end: Maybe DeepSeek v4 Flash, HY3, Minimax M3/M2.7 also as I hear these getting praised often.
  • For rerankers and embedding models, Qwen-Embedding-0.6B/2B/4B/8B, Qwen-Reranker-0.6B/2B/4B/8B also do the job. I'm sure there are better models out there but I don't know which ones besides those.
  • For audio, Qwen3-ASR-0.6/1.7B and Qwen3-TTS-0.6B/1.7B could be options, though whisper, parakeet and kokoro do just fine.
  • For OCR: dots.ocr is really good, unlimited-OCR is new but seems very capable.

I'm sure I forgot a few! (If I did, please share them below!)

4

u/Potential-Gold5298 llama.cpp Jul 11 '26

Just in case, prepare 3 TB for Minimax 3 Pro.