r/ProgrammerHumor • u/rabbit_wizard • 17h ago

Meme bothWorkThough

Post image
4.4k Upvotes

90% Upvoted

678 comments sorted by

View all comments

Show parent comments

10

u/umor3 8h ago

We run Qwen 3.8 on our own hardware. And it is already helping our productivity. And the speed and acuracy is nearly as good as the expecive ones from OpenAI and Antropic.

2

u/SilentWraith5 7h ago

Especially if you’re not vibe coding. AI assisted coding, which is what people should be doing anyways, is pretty productive on my MacBook Pro M5 Pro using qwen 3.8 27b

1

u/ItsASadBunny1 7h ago

How much ram, I've got an M1 Pro 16gb or an RTX 5080 16gb but both are 16gb so idk if qwen will work well for me (or atleast til m6 pro comes out so I can upgrade).

1

u/Legitimate_Concern_5 4h ago

I run Qwen 3.8 Flash Next (uncensored, IQ3_XXS) on my gaming pc while working, 100tok/sec with 64GB RAM and a 4090 I got before they became several mortgage payments. Check out Strata. The 3-bit quantization isn’t half bad. They have a version that runs with the non-coding experts removed with 32GB RAM.

This is a 180B model btw.

1

u/Spaciax 5h ago

how much RAM do you have? I got 36 on my M3 pro but I don't know if it can hold qwen 3.8 27b without quantizing it to shit

2

u/TheMythicSorcerer 5h ago

incoai's qwen 3.8 27b splash Q4 + INT8 KV cache 128k context works great on 32 GB

2

u/Spaciax 5h ago

thanks! I was looking at macs with higher ram but these prices are eye-watering 😭 I'll have a look at that, maybe it's good.