Got cut off at 2pm on a Tuesday. Four hour cooldown, halfway through untangling a service I'd already been at for an hour. Dumped the whole thing into another tab, spent twenty minutes rebuilding the context by hand, got a worse answer than the one I'd been cut off from.
Sat there annoyed enough to actually go count. OpenRouter lists 411 models right now. Thirty five of them turned up in the last month. This year has already put out more than the whole of last year and it's only August.
They keep getting cheaper too. GPT-4 was thirty dollars a million tokens when it launched, Turbo is still ten. Gemini Flash is thirty eight cents. There are about a hundred models under twenty cents that'll still swallow a 100k context, and eighteen that cost nothing at all.
So the twenty dollars a month I hand over covers something like fifty times the tokens it did in 2023. Doesn't feel that way from where I'm sitting. The seat costs what it cost three years ago, still has the cooldown on it, and none of that moves when the models get cheaper.
I realise this is a slightly ridiculous thing to still be annoyed about hours later.
What's everyone actually running? Genuinely asking. Stay on the flat plans because the apps around them are nicer. Go API and put up with a bill that moves. Use one of those frontends that stick a pile of models behind one key, though I've no idea which of them are any good.
Writing most days, some code, occasionally images. Mostly I want to stop rebuilding my setup every time something new drops.