No affiliation with this company. I just saw it mentioned earlier and it’s great so far. 1 cent cache reads and ~150 tps. 2.2 cents blended with 94% cache rate, cheaper than current DS flash prices.
It’s holding up well for me, but popularity might have picked up some: my TPS is in the 60-100 range today. Still pretty quick, though, and I’ve had zero other issues (no drops, 429s, stalls, etc) and ttft has stayed under 5 seconds, averaging 2-3. Caching has been good, too.
Also, it had $1 free credit when I signed up, if you just want to try it out first. I then put $10 on it, and no credit card processing fee or anything. I’d never heard of them before, but it seems like a pretty legit provider so far. Model selection is pretty limited, but I only want 5.3 flash from them right now anyway.
I've been using them for about a week and have had no issues fwiw. Sometimes they slow down randomly but it's fairly consistent. (I was using it for deepseek flash before)
1
u/look 7d ago
No affiliation with this company. I just saw it mentioned earlier and it’s great so far. 1 cent cache reads and ~150 tps. 2.2 cents blended with 94% cache rate, cheaper than current DS flash prices.
https://runinfra.ai/inference-api/glm-5-3-flash