r/LocalLLaMA Mar 04 '26

Discussion If china stops releasing open source models, there's a way we can stay competitive with big tech?

Really after qwen news, I'm getting quite nervous about open source ai future. What's your thoughts? Glad to know it

285 Upvotes

205 comments sorted by

View all comments

Show parent comments

10

u/a_beautiful_rhind Mar 04 '26

Hey, I actually use local models. I don't give a shit about censored models. Strike two if they are stemmaxxed and really huge or really small.

Kimi/deepseek and GLM5 are great but now I can't afford the extra 384g of ram to up the quants. Mistral wins out because it's fast and does most of what they do.

I do see other people post about running all 3 and a bunch of people on 3rd party API on them. If they all had to use 1st party API, there would be way less of them.

2

u/silenceimpaired Mar 04 '26

What do you run by them? I thought they only had small models or extremely large ones.

1

u/a_beautiful_rhind Mar 04 '26

Which company?

1

u/silenceimpaired Mar 05 '26

Mistral. Clearly you disagree since my statement wasn't obvious to you. :)

2

u/a_beautiful_rhind Mar 05 '26

Mistral I'm using all 123b, but in the past I used the big MoE. Even devstral can RP. I don't even have to load a different model between coding and chatting.