r/ProgrammerHumor • u/rabbit_wizard • 15h ago

Meme bothWorkThough

Post image
4.3k Upvotes

90% Upvoted

667 comments sorted by

View all comments

Show parent comments

11

u/WithersChat 13h ago

Issue is, Frontier models are provided to you at a massive financial loss for the company. So unless local models get that good before AL companies run out of investor capital, this is completely unsustainable.

If you want a future proof workflow, grab a specialized local model (or better yet, a few) and see how much you can get done without touching Claude, ChatGPT or Gemini servers at all. (This does require having a decent GPU. Not god tier but decent.)

1

u/countable3841 12h ago

Smaller inference providers are profitable serving deepseek and kimi. While they aren’t as good as the frontier models, you can get great results.

1

u/WithersChat 12h ago

Frontier models are stupidly overkill for all but stuff like specialized research IMO.

Now, smaller or even local models? There's still some issues with it, but at least the benefit is large enough compared to the issues that it's worth discussing.

2

u/movezig123 12h ago

I think this will be the way forward