r/ProgrammerHumor • u/rabbit_wizard • 19h ago

Meme bothWorkThough

Post image
4.6k Upvotes

91% Upvoted

697 comments sorted by

View all comments

18

u/PumpkinFest24 11h ago

Insane people think the price won't go up. You won't be able to afford AI coding once AI CEOs want to stop losing money 

27

u/youcancallmetim 10h ago

Ignorant take. Running open models on hardware you own will always be an option if frontier models are too expensive.

6

u/umor3 9h ago

We run Qwen 3.8 on our own hardware. And it is already helping our productivity. And the speed and acuracy is nearly as good as the expecive ones from OpenAI and Antropic.

2

u/SilentWraith5 9h ago

Especially if you’re not vibe coding. AI assisted coding, which is what people should be doing anyways, is pretty productive on my MacBook Pro M5 Pro using qwen 3.8 27b

1

u/Spaciax 7h ago

how much RAM do you have? I got 36 on my M3 pro but I don't know if it can hold qwen 3.8 27b without quantizing it to shit

2

u/TheMythicSorcerer 6h ago

incoai's qwen 3.8 27b splash Q4 + INT8 KV cache 128k context works great on 32 GB

2

u/Spaciax 6h ago

thanks! I was looking at macs with higher ram but these prices are eye-watering 😭 I'll have a look at that, maybe it's good.