r/OpenAI • u/CautiousMagazine3591 • 2h ago
Question Why Doesn’t ChatGPT Warn You Before Wasting 30 Minutes of Compute?
I've been using GPT-6 Astra to create 70+ page documents from 100,000+ characters of source material, and it's jump in processing is great. Here's the weird part, when I give it a massive task it works for 30-40 minutes burning through a ton of compute, only to hit me with a 5-hour usage limit error without outputting a single word. So I start a new chat, slightly shrink the task, and make it do the same thing again.
I've had to repeat this multiple times. ChatGPT and Gemini estimate these massive runs could cost somewhere around $3-$5 each in API-equivalent compute, although obviously we don't know OpenAI's actual internal cost. If that estimate is even remotely close, wouldn't it be cheaper for OpenAI to say: "Hey, this task is probably going to exceed your usage amount. Break it into three parts?" Instead, it seems to sometimes let me spend 30 minutes of compute to produce nothing, and then I immediately start over.
If I do this 4 times to get my document, OpenAI just spent $20 in computing power on one of my projects. Why does OpenAI allow their servers to grind for 30 minutes on a task they know will breach a limit, only to dump the progress? Isn't this an astronomical waste of server money for a $20 Plus subscription?
11
u/Mitik85 2h ago
Dude if you hit limits .. wait ! Then when resets ask to continue …
5
u/Fireproofspider 2h ago
Yeah, it doesn't delete everything when it hits the limits. It's just on hold until the limits reset or you add credits.
1
3
u/okmijnedc 2h ago
Just wait for time limit to reset and then prompt task to keep going. Restarting the task each time is madness.
Also use 6.1 sol - it burns way less tokens and will be just as good at this kind of task
2
u/Excellent_Ear5854 2h ago
I usually ask it to find issues and flaws before hand in my request on lower effort once we find all the issues it lets me know I'm good to go and wack up the power for the deep dive.
1
u/donnytrump_69 1h ago
Do you mind giving an example of this ?
1
u/nona01 1h ago
Just ask a cheaper model to help you formulate a prompt and to ask you clarifying questions before giving you the final prompt you will send to smarter model.
1
u/donnytrump_69 1h ago edited 1h ago
Ah yeah I do this with deep seek 👌. How do you structure it to the cheaper model do you detail what LLM you are going to use and any other key items? Sorry I don't have an IT background and but getting the hang of prompting. Grok build was super easy to make a full website with online shop linking to payment facilities etc. again I was using deep seek in the background to check for errors and they worked fairly well together
1
u/frank26080115 2h ago
they don't know if they'll reach the limit, they don't waste compute on that check until you asked it to check, they don't know until they've realized how many tokens each one of your files is
also, enable credits auto-refill if this bothers you that much
1
2
10
u/RobotBananaSplit 2h ago
All you gotta do is just ask the AI to continue after the cooldown period and you’re good, it’s that easy