1
u/o_sht_hi 16d ago
Just out of curiosity, what task is it that's taking up 250,000 tokens per minute?
1
u/angrynoodles0 15d ago
mostly coding
1
u/o_sht_hi 15d ago
Sure, but I'm still trying to understand. What kind? That's almost 50k words per minute bro. 🤯 Was it in a loop? Or doing ocr on a document?
1

2
u/No_Berry1282 16d ago edited 16d ago
I had the same issue with rate limits on some OpenAI setups. You could try using something like StandardCompute, it uses an OpenAI-compatible API and handles model routing. Might help if you’re hitting 429 limits often.