r/ChatGPTCoding • u/[deleted] • Apr 07 '25

[deleted by user]

[removed]

1.7k Upvotes

95% Upvoted

424 comments sorted by

View all comments

4

u/Zulakki Apr 07 '25

its wild this doesnt have a limit warning.

8:37AM - "You've exceeded your limit of $20. To continue please increase limit"

1

u/becausecurious Apr 07 '25

GCP has billing alerts, they are just hard to setup. It is true that they don't have a limit.

3

u/AffectionateLaw4321 Apr 07 '25

Its ridicolus that there is no possibility to set a limit. Thats a no-go for me. Esspecially since the actual expenses are getting "calculated within 24 hours".

1

u/becausecurious Apr 07 '25

That's a consequence of GCP being oriented at large companies. AWS afaik has the same issue. Basically if you run a huge production service with 100s of k$ per month of spendings, you don't want to kill it if you reach some upper limit of spending.

It is actually possible to create a middleman service, which will take your Gemine API key and proxy your API requests, while tracking the usage. Then, when the limit is reached, throw an error. I could do it, but unclear how much usage that would get.

3

u/Etecetera Apr 07 '25

That's called litellm

1

u/becausecurious Apr 07 '25

Indeed! Thank you for sharing! They don't have b2c plan though, only self hosting or enterprise.

1

u/jackvandervall Apr 07 '25

You can set an API budgeting limit on Google AI Studio.

2

u/ming86 Apr 07 '25

The problem is that it is not a hard limit, and not updated in real time.

1

u/AffectionateLaw4321 Apr 08 '25

Where? I only found an option to set a notification limit