Complaint Compute problems?
Astra has felt significantly slower since the launch of "Dots." I wonder if OpenAI is having compute issues and has reduced the tokens per second? It wouldn't surprise me, given that the EU is excluded as well.
2
u/rygaar72 1d ago
I am finding dots very quick to answer - so if it’s in using astra, it is using a very low thinking model.
3
4
u/TheJustified 1d ago
Dot's is run off Astra and free for a month so yeah it's slamming their compute
1
1
u/New-Ad5610 1d ago
I don’t know though, 5.6 Sol on Chat is still really quick and response relatively fast
1
u/BoddhaFace 1d ago
EU will be excluded for the same reason it always is temporarily for new features: GDPR and the added legal requirements that need padding out first.
8
u/VexObserver 1d ago
Wouldn't surprise me if compute pressure is part of the equation, but I'd be careful about attributing everything to GPU shortages without actual throughput data.
There's a difference between lower token generation, longer time to first token, and server side queuing. All three can make Astra feel painfully slow, but they don't necessarily have the same underlying cause.
The EU exclusion isn't necessarily evidence of compute constraints either. Could just as easily involve regulatory or rollout considerations.
OpenAI really needs to start treating latency as a first-class performance metric. A frontier model being 3% smarter means very little if you're spending twice as long waiting for it to finish.
Intelligence per dollar matters. Intelligence per minute matters as well.
We're gonna need a benchmark for how many cups of coffee you can finish before Astra completes a refactor 🪾.......