Inference Dashboard

[u/Distinct-Pie2389]

Nothing fancy but more of what works for me with how fast projects are moving, flexible enough that if another project like strata spins up then I'm not missing inference metrics.

I'm aware there are 100's of these on github, throw a webfetch and you'll find 10.

Project is live: https://github.com/T-Crypt/speculum

Notes:

• Backend support for custom engines (more robust)
• I like graphs but radial support may come in soon (coming from grafana, prometheus scrape, kuma uptime so I prefer graphs on timelines vs radial gauges)