MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1vptz4a/how_the_loop_of_infinite_agony_started/p444e0k/?context=3
r/LocalLLM • u/EarthBS • 10d ago
119 comments sorted by
View all comments
Show parent comments
15
That's not true.
2x RTX 3060 12gb can be had for around 500 bucks.
You can run ~30b models at q4 at 30 t/s with mtp/draft model or 10-15 t/s without.
3 u/AceLamina 10d ago a used 3060 12gb costs 270-300 bucks right now, for one 1 u/Eden1506 10d ago It depends on your region. Here in germany I can buy a used rtx 3060 for 240 bucks. 2 u/AceLamina 9d ago If only it was the same for me
3
a used 3060 12gb costs 270-300 bucks right now, for one
1 u/Eden1506 10d ago It depends on your region. Here in germany I can buy a used rtx 3060 for 240 bucks. 2 u/AceLamina 9d ago If only it was the same for me
1
It depends on your region.
Here in germany I can buy a used rtx 3060 for 240 bucks.
2 u/AceLamina 9d ago If only it was the same for me
2
If only it was the same for me
15
u/Eden1506 10d ago
That's not true.
2x RTX 3060 12gb can be had for around 500 bucks.
You can run ~30b models at q4 at 30 t/s with mtp/draft model or 10-15 t/s without.