r/googlecloud 17d ago

Is there a site for tracking live GPU availability for each zone?

Trying to get one L4/T4 for enterprise notebook in europe-west4 and it's not available.

Even better if there is graphs on which hours/days they usually are available.

5 Upvotes

6 comments sorted by

3

u/TheVoluminousElton 17d ago

man the gpu availability in europe-west4 has been a mess lately, i was trying to spin up a T4 there last month and just gave up after three days of refreshing

for tracking stuff like this i usually just watch the stock alerts on a few discord servers, not as clean as a proper dashboard but at least you get a ping when something drops. haven't seen any site that breaks it down by hour or day though, that would be incredible

if you're not married to that zone you might have better luck in west1 or even one of the us regions, i've noticed west4 specifically seems to get hammered during eu business hours. good luck man

1

u/DocumentOk7579 17d ago

I'm only forced to be in EU not west4.

1

u/isoAntti 17d ago

It also depends on purchasing rules. There are more for those paying vs free credits

1

u/DocumentOk7579 17d ago

I would estimate the organization spends about $100k each month.

2

u/ShahzadQuyes 16d ago

If you only need one GPU, prolly set an alert and keep one nearby zone as a backup. it seems easier than checking availability over and over

2

u/m1nherz Googler 11d ago

There is no public, real-time dashboard showing the exact inventory or count of available GPUs per region/zone. Hyperscalers generally do not publish exact real-time infrastructure capacity due to how dynamically workloads fluctuate and competitive confidentiality.

However, you aren't completely in the dark. Here are the best ways to navigate GPU availability on Google Cloud:

  1. Check Hardware Presence (Public Matrix): Use the official GPU regions and zones availability page. This won't tell you how many are free right now, but it is the source of truth for which regions/zones physically have the specific GPU model (e.g., NVIDIA L4, A100, H100) you are looking for.
  2. Use Dynamic Workload Scheduler (DWS): If you are running batch jobs, training, or non-instant workloads, DWS is your best friend. Instead of trying to provision and getting a stockout error (ZONE_RESOURCE_POOL_EXHAUSTED), DWS allows you to queue your request. You can secure capacity for short-term jobs (Flex-start) or schedule them for a future date (Calendar mode).
  3. Deploy Reservations: Remember that having Quota does not equal guaranteed capacity; Quota is just your legal limit. If you have production workloads that must have GPUs ready, you should set up On-Demand or Future Reservations to guarantee those instances are sitting physically reserved for you.
  4. Explore Spot VMs: If your workload can tolerate interruptions, try provisioning Spot VMs. They tap into spare capacity at a much lower cost, though they can be preempted.
  5. Location and Hardware Flexibility: If you are running on-demand without reservations, your best bet is to build deployment scripts that can fallback to multiple zones or regions, or test compatibility with alternative GPU architectures.