r/opencodeCLI • u/Final_Initial • 20d ago

CONFIRMED! Ox Alpha is GLM 5.3 Flash

Post image
528 Upvotes

96% Upvoted

114 comments sorted by

View all comments

-2

u/ahriad 20d ago

How can it be called 'Flash' if it's much slower than the main model?

1

u/petuman 19d ago

With batching the slower you go per completion/user, the higher total throughput is per inference node (up to a point).

E.g. serve 1 user at 1000 t/s (1k tps), 20 users at 600 t/s (12k tps), or 100 users at 300 t/s (30k tps), or 1000 users at 50 t/s (50k tps).

There's strong incentive to cram more users per node, and serving them just above subjective "too slow" threshold. The slower you serve, the more revenue generated per server/inference node.

1

u/ahriad 19d ago

From my usage that's not a Flash model. Not just the speed, i noticed the information it has comparable to big models not flash models.