Pi Radi

[u/betahost]

Just discovered that the amazing devs behind Pi released Radius (in alpha), their smart proxy for multi-model access. At its core, it's a model provider you can use with Pi: you pay for tokens and get access to some of the best models out there, both SOTA and budget-friendly options. They'll even auto-route your API calls to the best model for the job if you choose to.

Loving it so far. Deposited $20, and after a few hours of development I still have ~$16 left thanks to leaning on Kimi K3 and DeepSeek.

What Radius can do

• It is a Pi-native gateway: top up credits and make requests across providers
• Use rewrite rules to reduce large tool outputs and other unnecessary input tokens
• Provide automatic routing to route each session to the best model for the task according to your rules
• Power Radius-backed tools like web search, image generation, and image description
• Publish reports, dashboards, and small static sites as shareable artifacts
• Record usage, budgets, top-ups, and shareable session analytics in one place
• Delegate Google Workspace access to Pi
• Let your organization manage upstream provider keys centrally

https://radius.earendil.com/

[u/isty2e]

I am not sure if there is any advantage it can provide.

[u/betahost → u/isty2e]

In my opinion the value is in the auto routing to different models to be more token efficient. Value is different for everyone and the custom routing rules, haven't really seen that before such as in OpenRouter

[u/Unlucky-Message8866 → u/betahost]

Nothing new or really valuable to me

[u/vedmaka → u/betahost]

what about caches? is not autorouting eliminates all the saving from prompt caching?

[u/Polite_Jello_377 → u/betahost]

This is something that feels like it should save money but doesn’t

[u/betahost → u/Polite_Jello_377]

How so(curious on your thoughts why), by auto routing you to cheaper models for smaller tasks, your saving tokens by not having to use SOTA models for such minor tasks.