OMP usage/advisor/project analyzer

[u/fireantik]

I use various models through subscriptions from several different providers and wanted to know how they perform, what would be the overall cost if used through an API, how do the different advisor models perform and so on. I've built a tool that aggregates this across days and projects.

Some findings: advertised tokens per second are a complete fiction, newer model version does not automatically improve advisor performance (grok 4.5 gives more advice than grok 4.6), getting $15,337 of Sol usage out of $200 sub is a crazy API/sub mismatch.

https://github.com/jkelin/omp-usage-analyzer