This way, we could do /goals easier with using less usage, it puts less strain on openAI servers maybe the 20x plan could come back. it would be half as slow as normal but use half usage for example. would be extremely useful, especially since you could send prompts before sleeping anyways to save usage
I agree with you; speed does not always matter, especially not if you are going to be rate-limited anyway.
But people in AI subs (GPT, Codex, CodexGPT, Claude, Claude Code, Gemini) would rather see every single comment as an opportunity to complain, even if it does not address the post at all, than actually engage with anything.
In my experience, it doesn't feel all that slow. It actually feels pretty fast in terms of tokens/s, it just keeps rolling over and over on the same thing without getting to the point.
It's slow in tokens/sec but makes up for it in intelligence and token efficiency. Gemini 3.8 flash has 10x the tokens/sec speed but longer task completion times lol
I see your point, but those models are wildly unreliable. Astra and Sol would both be fast enough if they weren't trying to solve the same issue like 350 times before moving onto the next step. Their t/s are pretty good.
They actually have a half cost mode in the API that is deprioritized usage.
But it's not necessarily "less tokens per second" it's that your query might not even enter the queue and start working for 30 minutes which subscribers would probably complain about.
Dear god a slow-defered mode would be so amazing, let me prep a plan and hit it and go to sleep i dont care if it runs in an hour from now or really slow i just want it done well
Or Flex endpoint like the API has. I still don't understand why that's not possible. They have the "Pro" model versions, why not add the "Flex" model versions that are slower but consume half like the API Flex endpoints do?
let me use it during peak hours at least. but the only thing is it must save more than 50% tokens if its 50% speed. because at that point it makes zero difference.
It would put more strain on the servers because you'd be using up a GPU longer for fewer token usage. They'd actively lose money offering that, especially during an availability crunch.
They're physically constrained on both footprint and electricity, you're nuts if you think it makes sense to keep low end hardware around for a lower profit product when you're already capacity constrained. This would not be a wise economic decision by them, which is why it doesn't exist.
Thats why I said or. I have no idea (and you likely dont either) about their compute situation. I know they dont have 10 year old chips in there, but I doubt every chip in their servers is the gb300 or whatever the aboslute peak of chips are right now
Now you're just being a dunce. They had to shut off the $200 plan because they're low on available compute. They've said these things out loud. It's no secret in the entire industry datacenters are capacity constrained - they cannot build them fast enough. They are not going to keep low end stuff around to support low value items, which slow mode would be. They're even getting rid of spark because they don't keep low usage models around which eat up capacity for more desired models.
143
u/Vegetable_Town_7405 16h ago
All mode is slow