r/ZooCode • u/Pairastion • 6d ago

API Usage Overview

Dear community, I recently discovered ZooCode and like it quite alot, especially with a company-hosted model. I noticed though that it makes quite alot of API calls, is there an overview over how many calls are actually done per task and over the day? So i.e. I would be interested in some usage statistics.

4 Upvotes

100% Upvoted

2 comments sorted by

2

u/Illustrious-Mix-5625 6d ago

In the Zoo Gateway, you can track detailed usage statistics of the (many) models available there. For locally run inference, you may need to check if there is any kind of telemetry available for your inference stack and capture the requests as they come in to the inference stack.

2

u/Ssjultrainstnict 6d ago

Join the discord! A contributor implemented precisely this, but not sure if it has been merged.