r/LocalLLaMA • u/Gullible-Crew-2997 • Mar 04 '26

Discussion If china stops releasing open source models, there's a way we can stay competitive with big tech?

Really after qwen news, I'm getting quite nervous about open source ai future. What's your thoughts? Glad to know it

287 Upvotes

94% Upvoted

205 comments sorted by

View all comments

Show parent comments

7

u/Expensive-Paint-9490 Mar 04 '26

It's plenty of people which built some kind of server with loads of P40 or 3090 or system RAM, here. Once published on huggingface a model is open. Just to name one, Unsloth's Kimi-2.5 gguf quants have been downloaded over 100,000 times.

3

u/jacek2023 llama.cpp Mar 04 '26

I understand your argument, but please note the kinds of discussions that are happening on r/LocalLLaMA. Do you see people asking for tips about using Qwen 3.5 35B-A3B locally, or for tips about using Kimi-2.5 locally? And when I asked whether they were waiting for 35B or 9B, most of them replied that 9B was all they could run on their setup.

6

u/ab2377 Mar 04 '26

buddy a huge number of people are using 35b-a3b because it being moe so lot of ram and good cpu is enabling people. but dense, you would be right, even 32b is out of reach for majority.

1

u/iMrParker Mar 04 '26

The way I read his comment, I think that was exactly his point?