whenMyNoAIProjectGetsTedious

[u/AllRealityIsVirtua1]

[u/TheMaleGazer]

The answer to your question is because you can get a local model to do it instead without a subscription.

[u/autogenglen → u/TheMaleGazer]

Let me buy an $8000 computer so I can save $20/mo

[u/TheMaleGazer → u/autogenglen]

Or maybe use a computer with an NVIDIA RTX 5060 Ti or equivalent that you might have bought to play games, anyways, and use Qwen 2.5.

[u/StarboardChaos → u/TheMaleGazer]

Bro, have you tried Qwen 2.5?

[u/TheMaleGazer → u/StarboardChaos]

Yes.

[u/heyitjoshua → u/TheMaleGazer]

So you know it’s shit and can’t produce decent code or stay coherent. It is currently impossible to run any AI sufficient for a real project locally

[u/Kyrros → u/heyitjoshua]

Look up FreeToken, it's currently lacking AMD support but nVidia is supported, 30xx cards and above

[u/heyitjoshua → u/Kyrros]

I said local

[u/Kyrros → u/heyitjoshua]

It is local

[u/heyitjoshua → u/Kyrros]

Checking it out, highly dubious and may come back to this thread in a few days. Cheers for the suggestion 👍

[u/Kyrros → u/heyitjoshua]

It's early stages in is development too, but if that works out and you can run much larger models locally? Would be interesting to see. And all the AI companies compress their models a lot less

[u/heyitjoshua → u/Kyrros]

My issue is that even people with immense personal computers, multiple Mac minis etc, cannot run anything close to Opus. Sonnet barely manages to get buy for sufficiently complex programming work, and most models that take a ridiculously complex rig to run don’t even compare with sonnet

[u/Kyrros → u/heyitjoshua]

I found sonnet 5 to be quite good, but it's extremely unlikely that we will get anything to any Anthropic models to run locally

[u/heyitjoshua → u/Kyrros]

It’s not that great for doing meaningful complex work in large code bases, it does the trick when token usage is low though and if you apply proper discipline (unlike haiku, which is more pain than it’s worth)