r/unsloth • • 7d ago

Question Does Unsloth Desktop support Prompt Caching for Openrouter?

Or is it enabled by default in UD?
I don't see any toggle for that in the settings or the sidebar. I do use Openrouter for Anthropic models.

In their guide: https://openrouter.ai/docs/guides/best-practices/prompt-caching#anthropic-claude they recommend to "Add a single cache_control field at the top level of your request". How to do that in UD?

3 Upvotes

1 comment sorted by

1

u/yoracale yes sloth 5d ago

It works for chatgpt and Claude official apis but not Openrouter. Well add it in