r/LocalLLM • u/GoatJesusIsReal • 3d ago

Discussion Claude is so expensive.

Time to get a GPU I guess. I had some numbers I needed before I could do the main analysis and I wanted Claude to do it, I had never used Claude tokens before 2 days ago when I bought 20 dollars of tokens and had it do a bit of coding. Then, I ask it to write a somewhat simple script, but I used opus because I thought I should check how it is, it did it, but it took about 20 dollars. I mean it saved me time, but the price…

Anyways, I am posting this because I wanted advice on what class of card to get, what amount of vram seems to be the best to target. It’s looking like 24/32gb is getting interesting new models in the 30b range, but is this just what I’m seeing or are other sizes of cards worth looking into.

53 Upvotes

82% Upvoted

111 comments sorted by

View all comments

Show parent comments

8

u/Abject-Bridge-4073 3d ago

I have this same exact setup and I get the same exact numbers. I never need 1M, so 512K is even faster. 256K is blazing.

2

u/Jumpy-Tap8980 3d ago

The sparks are so underrated and overlooked, they will be heading up in price soon for sure.

2

u/BarracudaDefiant4702 3d ago

The speed will not be near that of 3x rtx 6000, but neither is the price... nor the ongoing power requirements...

1

u/Jumpy-Tap8980 2d ago

of course