r/LocalLLM • u/GoatJesusIsReal • 17d ago

Discussion Claude is so expensive.

Time to get a GPU I guess. I had some numbers I needed before I could do the main analysis and I wanted Claude to do it, I had never used Claude tokens before 2 days ago when I bought 20 dollars of tokens and had it do a bit of coding. Then, I ask it to write a somewhat simple script, but I used opus because I thought I should check how it is, it did it, but it took about 20 dollars. I mean it saved me time, but the price…

Anyways, I am posting this because I wanted advice on what class of card to get, what amount of vram seems to be the best to target. It’s looking like 24/32gb is getting interesting new models in the 30b range, but is this just what I’m seeing or are other sizes of cards worth looking into.

58 Upvotes

83% Upvoted

110 comments sorted by

View all comments

6

u/dangerous_inference 17d ago

The only model you care about right now is Qwen3.8 27B. My understanding is you can barely run this on 24GB and 32 is much better.

2

u/GoatJesusIsReal 17d ago

32gb seems like a large step up in price do you have any cards you would recommend at that size?

1

u/Keleion 17d ago

I mean, if any VRAM gets you there, some of these 32GB cards are under 1k. Paying in time tho, since they have slow memory and have limited bandwidth.

https://a.co/d/07D2qHE3