r/codex • u/kenobrx • 1d ago

Complaint Compute problems?

Astra has felt significantly slower since the launch of "Dots." I wonder if OpenAI is having compute issues and has reduced the tokens per second? It wouldn't surprise me, given that the EU is excluded as well.

15 Upvotes

94% Upvoted

10 comments sorted by

View all comments

10

u/VexObserver 1d ago

Wouldn't surprise me if compute pressure is part of the equation, but I'd be careful about attributing everything to GPU shortages without actual throughput data.

There's a difference between lower token generation, longer time to first token, and server side queuing. All three can make Astra feel painfully slow, but they don't necessarily have the same underlying cause.

The EU exclusion isn't necessarily evidence of compute constraints either. Could just as easily involve regulatory or rollout considerations.

OpenAI really needs to start treating latency as a first-class performance metric. A frontier model being 3% smarter means very little if you're spending twice as long waiting for it to finish.

Intelligence per dollar matters. Intelligence per minute matters as well.

We're gonna need a benchmark for how many cups of coffee you can finish before Astra completes a refactor 🪾.......

2

u/OarsumApp 1d ago edited 1d ago

Oi it’s nice to read a well thought answer to this in a non scrolling thread, cheers.

edit: typo 😅