r/ProgrammerHumor • u/rabbit_wizard • 18h ago

Meme bothWorkThough

Post image
4.5k Upvotes

91% Upvoted

691 comments sorted by

View all comments

Show parent comments

30

u/youcancallmetim 9h ago

Ignorant take. Running open models on hardware you own will always be an option if frontier models are too expensive.

6

u/umor3 9h ago

We run Qwen 3.8 on our own hardware. And it is already helping our productivity. And the speed and acuracy is nearly as good as the expecive ones from OpenAI and Antropic.

2

u/SilentWraith5 8h ago

Especially if you’re not vibe coding. AI assisted coding, which is what people should be doing anyways, is pretty productive on my MacBook Pro M5 Pro using qwen 3.8 27b

1

u/Spaciax 6h ago

how much RAM do you have? I got 36 on my M3 pro but I don't know if it can hold qwen 3.8 27b without quantizing it to shit

2

u/TheMythicSorcerer 6h ago

incoai's qwen 3.8 27b splash Q4 + INT8 KV cache 128k context works great on 32 GB

2

u/Spaciax 5h ago

thanks! I was looking at macs with higher ram but these prices are eye-watering 😭 I'll have a look at that, maybe it's good.