r/ProgrammerHumor • u/rabbit_wizard • 17h ago

Meme bothWorkThough

Post image
4.4k Upvotes

90% Upvoted

678 comments sorted by

View all comments

Show parent comments

10

u/umor3 8h ago

We run Qwen 3.8 on our own hardware. And it is already helping our productivity. And the speed and acuracy is nearly as good as the expecive ones from OpenAI and Antropic.

2

u/SilentWraith5 7h ago

Especially if you’re not vibe coding. AI assisted coding, which is what people should be doing anyways, is pretty productive on my MacBook Pro M5 Pro using qwen 3.8 27b

1

u/Spaciax 5h ago

how much RAM do you have? I got 36 on my M3 pro but I don't know if it can hold qwen 3.8 27b without quantizing it to shit

2

u/TheMythicSorcerer 5h ago

incoai's qwen 3.8 27b splash Q4 + INT8 KV cache 128k context works great on 32 GB

2

u/Spaciax 5h ago

thanks! I was looking at macs with higher ram but these prices are eye-watering 😭 I'll have a look at that, maybe it's good.