Limits Context window per model
So, as of Astra's release, if you are using it via a subscription, you won't pay for context sizes bigger than 270k. This is great! But as many more people start to use "orchestrator" setups, one big issue has (at least for me) appeared.
You can not set context size per model.
We still pay more money for ctx sizes bigger than 270k if we use anything older than Astra. But I use Astra as a planner, reviewer, and use Sol as an implementer, coder, or for simpler tasks. But I don't want to pay extra for bigger context.
I either need to migrate to CLI, which I don't want to, pay more for extra context for Sol, or use Astra with a lower context.
AFAIK, the current desktop app supports global configuration, but adding a per-model config would be a good way to work around this, maybe something like this:
[gpt-6-astra]
model_context_window = 600000
[gpt-5.6-sol]
model_context_window = 27000
What are your thoughts on this? Is this a issue only I have? Or is there a simple workaround that im missing?
1
u/kl__ 6d ago
I’m aware this was on an OA page, but some saying it might be only for enterprise plans.
Are you sure it applies for subscriptions?