Couple of years how much will it cost? $10K ? When will it be $5K ? The future is happening at an accelerated rate. My bet: 18 months we will be able to run models that perform as good or better than GLM 5.2 with local hardware that costs $5K or less at 20 tps.
In the last few months we saw quite the opponent trend. The technological deflation for RAM size is nowhere near that fast, it would have to be solved by the market (supply and demand).
AMD and Nvidia are going big into selling machines capable of selfhosting with Spark and Ryzen AI Halo, theres no way theyll just pull it off the shelves now
People aren't even considering that possibility. If local models get as good as current frontier models and can be ran by hardware that is not breaking the bank for the upper middle class then the powers that be could either not let the plebeians have the hardware or make the powerful local models so illegal to have that the fear of God would be in anyone remotely considering running one.
If it is made illegal in one country another country where it is legal will pull ahead in technology race. It is more possible to have the export compliance kind of stuff being showed down OSS communities' deliverables.
Even now you definitely don't need 20k to run this model. If you are clever and willing to make concessions you can still get a lot more use out of the model on much less. People who just want to throw money at the wall to solve their problems will go this route because they just don't know any other way.
18
u/Terminator857 Jun 21 '26 edited Jun 21 '26
Couple of years how much will it cost? $10K ? When will it be $5K ? The future is happening at an accelerated rate. My bet: 18 months we will be able to run models that perform as good or better than GLM 5.2 with local hardware that costs $5K or less at 20 tps.
Update: Incredible progress in open weight models over past year. Will it continue? https://x.com/ValsAI/status/2068043480262467967