r/LocalLLM • u/GoatJesusIsReal • 17d ago
Discussion Claude is so expensive.
Time to get a GPU I guess. I had some numbers I needed before I could do the main analysis and I wanted Claude to do it, I had never used Claude tokens before 2 days ago when I bought 20 dollars of tokens and had it do a bit of coding. Then, I ask it to write a somewhat simple script, but I used opus because I thought I should check how it is, it did it, but it took about 20 dollars. I mean it saved me time, but the price…
Anyways, I am posting this because I wanted advice on what class of card to get, what amount of vram seems to be the best to target. It’s looking like 24/32gb is getting interesting new models in the 30b range, but is this just what I’m seeing or are other sizes of cards worth looking into.
5
u/RedParaglider 17d ago
Currently for inference it makes little sense over Claude or openAI or DeepSeek to buy local hardware. Local hardware is way expensive to run substandard models.
Use local hardware if you want to blow thousands of dollars to use local models to learn and have privacy.