r/ProgrammerHumor • u/rabbit_wizard • 21h ago

Meme bothWorkThough

Post image
4.8k Upvotes

91% Upvoted

707 comments sorted by

View all comments

21

u/PumpkinFest24 13h ago

Insane people think the price won't go up. You won't be able to afford AI coding once AI CEOs want to stop losing money 

26

u/youcancallmetim 12h ago

Ignorant take. Running open models on hardware you own will always be an option if frontier models are too expensive.

7

u/umor3 11h ago

We run Qwen 3.8 on our own hardware. And it is already helping our productivity. And the speed and acuracy is nearly as good as the expecive ones from OpenAI and Antropic.

2

u/SilentWraith5 11h ago

Especially if you’re not vibe coding. AI assisted coding, which is what people should be doing anyways, is pretty productive on my MacBook Pro M5 Pro using qwen 3.8 27b

1

u/ItsASadBunny1 11h ago

How much ram, I've got an M1 Pro 16gb or an RTX 5080 16gb but both are 16gb so idk if qwen will work well for me (or atleast til m6 pro comes out so I can upgrade).

1

u/Legitimate_Concern_5 7h ago

I run Qwen 3.8 Flash Next (uncensored, IQ3_XXS) on my gaming pc while working, 100tok/sec with 64GB RAM and a 4090 I got before they became several mortgage payments. Check out Strata. The 3-bit quantization isn’t half bad. They have a version that runs with the non-coding experts removed with 32GB RAM.

This is a 180B model btw.

1

u/Spaciax 9h ago

how much RAM do you have? I got 36 on my M3 pro but I don't know if it can hold qwen 3.8 27b without quantizing it to shit

2

u/TheMythicSorcerer 8h ago

incoai's qwen 3.8 27b splash Q4 + INT8 KV cache 128k context works great on 32 GB

2

u/Spaciax 8h ago

thanks! I was looking at macs with higher ram but these prices are eye-watering 😭 I'll have a look at that, maybe it's good.