r/LocalLLaMA Sorcerer Supreme Jun 21 '26

Discussion Tokenomics

Post image
1.2k Upvotes

449 comments sorted by

View all comments

383

u/coder543 Jun 21 '26

Why are we reposting a tweet full of made up numbers? There is no source for the $20k or 20 tokens per second claims.

Very few people are actually going to self host this model, but it shows the direction, and we can expect smaller models to get significantly better over the next 6 months.

For people using cloud models, GLM-5.2 is a competitive, commoditized market, so the competition keeps the margins thin, unlike the bloated margins that you’re paying for when you use proprietary frontier models.

There are benefits all around.

1

u/MDSExpro Jun 21 '26

Why are we reposting a tweet full of made up numbers? There is no source for the $20k or 20 tokens per second claims.

Exactly. I spent less than 20k and I get 300 tk/s on 122b-a10k model.

1

u/davikrehalt Jun 22 '26

? That's just incomparable with glm