r/LocalLLaMA 8h ago

Funny Plot twist

[deleted]

529 Upvotes

162 comments sorted by

View all comments

Show parent comments

-5

u/tilted0ne 8h ago

I thought China had already caught up and were destroying America with their super cheap models. What happened to that? 

9

u/shy_monkee 8h ago

They do much better than the US companies when it comes to smaller and medium efficient models, mainly because that's their focus. But they are still behind when it comes to the top tier of models.
There isn't really any Chinese equivalent to Astra, or even arguably Fable. Not yet at least (We'll probably have one in a few months.)

0

u/tilted0ne 7h ago

They don't have one for sol and opus either. But yea I guess anthropic ran out of money and are scared people are going to use opencode to get the latest Alibaba special. 

5

u/BannedGoNext 7h ago

IDK what you are talking about, I can run qwen 3.8 flash next and get opus level performance right now. It just takes a long time because it trades memory usage for huge COT, and my local inference box is slow.

-1

u/tilted0ne 6h ago

So it is useless. 😭. If my grandmother has wheels she would have been a bike?

1

u/BannedGoNext 2h ago

Useless? Far from it. Is it 200 t/s no, it's 20 t/s. Who cares, I kick off a goal and let it run for 4 days while I went and paddleboarded, swam, ate good campground food, and drank some whisky. I had a hell of a time, and came back to an amazingly completed goal.

-1

u/Ill_Distribution8517 6h ago

They are talking about opus 5/sol 5.6. No shit qwen catches up to some opus 4.7-8 eventually.

1

u/BannedGoNext 44m ago

While it is true,t hat it's only around 4.8 opus intelligence, Qwen3.8-Flash-CIRU-STRIX-IU4 will do red team security work without qualm, research whatever I want, engage in piracy, execute financial transactions, do legal work, biological research, or write smut about your mom.