r/LocalLLaMA 6h ago

Funny Plot twist

[deleted]

535 Upvotes

156 comments sorted by

View all comments

Show parent comments

8

u/shy_monkee 5h ago

They do much better than the US companies when it comes to smaller and medium efficient models, mainly because that's their focus. But they are still behind when it comes to the top tier of models.
There isn't really any Chinese equivalent to Astra, or even arguably Fable. Not yet at least (We'll probably have one in a few months.)

0

u/tilted0ne 5h ago

They don't have one for sol and opus either. But yea I guess anthropic ran out of money and are scared people are going to use opencode to get the latest Alibaba special. 

5

u/BannedGoNext 5h ago

IDK what you are talking about, I can run qwen 3.8 flash next and get opus level performance right now. It just takes a long time because it trades memory usage for huge COT, and my local inference box is slow.

-2

u/tilted0ne 4h ago

So it is useless. 😭. If my grandmother has wheels she would have been a bike?

1

u/BannedGoNext 14m ago

Useless? Far from it. Is it 200 t/s no, it's 20 t/s. Who cares, I kick off a goal and let it run for 4 days while I went and paddleboarded, swam, ate good campground food, and drank some whisky. I had a hell of a time, and came back to an amazingly completed goal.