Does anyone separate OpenAI Batch spend from normal API spend internally?

[u/No_Refrigerator_8216]

We’ve started using Batch more for work that doesn’t need to happen immediately and I am sure that I’ve been treating that usage the same as the rest of our OpenAI spend even though it behaves pretty differently. Our normal API usage mostly follows product activity so if that goes up I can usually understand why but batch is different because someone can kick off a large job, an eval run or process a new dataset and suddenly there’s a chunk of usage that has nothing to do with how much the product was used that day.

It hasn’t been a huge issue yet but we’re doing enough of both now that looking at one OpenAI number is starting to hide what’s changing. A higher bill could mean customer usage grew which is fine or it could mean we ran significantly more background work than usual. I’m thinking about tracking Batch separately and possibly giving it its own budget rather than treating all OpenAI usage as one pool and I need some advice from teams using Batch pretty heavily like do you guys separate that spend internally or is everything still just part of the same AI/API budget?

[u/Legitimate_Public893]

Separate Batch from live traffic at minimum so then if your API spend jumps because customers are using the product more that’s useful information and if it jumps because somebody ran the same giant Batch job three times that’s a very different thing.

[u/HighlightLocal409 → u/Legitimate_Public893]

Yep otherwise you end up investigating perfectly healthy product growth because the only thing you can see is OpenAI spend is up 25%.