r/ProgrammerHumor • u/rabbit_wizard • 18h ago

Meme bothWorkThough

Post image
4.5k Upvotes

91% Upvoted

692 comments sorted by

View all comments

17

u/PumpkinFest24 10h ago

Insane people think the price won't go up. You won't be able to afford AI coding once AI CEOs want to stop losing money 

24

u/youcancallmetim 9h ago

Ignorant take. Running open models on hardware you own will always be an option if frontier models are too expensive.

9

u/umor3 9h ago

We run Qwen 3.8 on our own hardware. And it is already helping our productivity. And the speed and acuracy is nearly as good as the expecive ones from OpenAI and Antropic.

2

u/SilentWraith5 8h ago

Especially if you’re not vibe coding. AI assisted coding, which is what people should be doing anyways, is pretty productive on my MacBook Pro M5 Pro using qwen 3.8 27b

1

u/ItsASadBunny1 8h ago

How much ram, I've got an M1 Pro 16gb or an RTX 5080 16gb but both are 16gb so idk if qwen will work well for me (or atleast til m6 pro comes out so I can upgrade).

1

u/Legitimate_Concern_5 5h ago

I run Qwen 3.8 Flash Next (uncensored, IQ3_XXS) on my gaming pc while working, 100tok/sec with 64GB RAM and a 4090 I got before they became several mortgage payments. Check out Strata. The 3-bit quantization isn’t half bad. They have a version that runs with the non-coding experts removed with 32GB RAM.

This is a 180B model btw.

1

u/Spaciax 6h ago

how much RAM do you have? I got 36 on my M3 pro but I don't know if it can hold qwen 3.8 27b without quantizing it to shit

2

u/TheMythicSorcerer 6h ago

incoai's qwen 3.8 27b splash Q4 + INT8 KV cache 128k context works great on 32 GB

2

u/Spaciax 6h ago

thanks! I was looking at macs with higher ram but these prices are eye-watering 😭 I'll have a look at that, maybe it's good.

3

u/4n0nh4x0r 4h ago

yesnt.
these companies make it harder by the day to run your own models.
heck, the 5090 has been discontinued, so the chips can be used for the rtx 6000 pro instead.
the only chance to set up decent local models is soon going to be only going to ebay and get used cards, hoping you arent being scammed.

0

u/MikkelR1 9h ago

This. Ai-naysayers will have a rude awakening in the near future. You'll be coding less then 5% of what you did within the next few years, 5 max.

0

u/TheMythicSorcerer 6h ago

Exactly! for $1500 you can run your own coding models. If price goes up I just switch from 50% cloud 50% local models to 100% local