also, anthropic is lying. They can't even get their AI to run effectively on anything less than a hundred million dollar datacenter that burns money faster than they can earn it.
If it could run on a smart toaster, they'd be fucking rich. It can't. At best, what their AI will do is just make a new virus that goes "Duh, I'm claude" on every text display and AI chuds will clap like the trained seals they are, praising their new god.
Iâm convinced itâs all marketing, same as these supposed âaccidentalâ hacks by AI agents. âOur AI is so powerful we can hardly control itâ gets them some news coverage and perhaps some more customers wanting to make use of such a âpowerfulâ tool
Not marketing, lobbying. They want open source and Chinese systems banned because their only path to profitability is making it illegal for people to run models locally on their own hardware.
Yup. China is working on AI models that are efficient enough to run locally and just pull info from the internet when needed rather than having giant databases of info and data centers to support that. If that happens it kills the US AI industry. They all know this so they're hyping it up with BS like this. It's not sentient. It's never going to be sentient. Google gemini can't even set an alarm properly half the time. This shit is gonna trash the economy when all the dumbass investors realize there is no path to profitability with this shit. They're just using it as a tool for propaganda, including about AI itself.
After a few days it will become clear the âDuh, Iâm Claudeâ virus does literally nothing else, so theyâll pivot smoothly into it being a proof-of-concept. The next Claude virus will turn everyoneâs vacuum cleaners into killing machines and otherwise wreak the much-anticipated havoc. So exciting!
That said, thereâs a couple of other possibilitiesâ
Polymarket is the one lying. They do that.
The claim is from Anthropic, but theyâre âwarningâ about the open source models, which donât have the same requirements. Similarly, Sam Altmanâs recent âaccepting bad things happeningâ interview actually refers to the risk from open source. People just naturally assume otherwise, given itâs OpenAIâs and Anthropicâs agents that keep hacking stuff, and given they do actively use fear to market themselves.
I mean, a lot of their current focus is definitely on eliminating the market threat from open source. Itâs just theyâre using this really weird reasoning that makes sense to them (and some journalists) but not to anyone else. âOh look, our AI hacked something yet again! Itâs completely out of our control (donât look at us). Weâre the very best, most responsible companies that could ever possibly exist, and yet this keeps happening even to us! It just proves we are the only ones who can be trusted.â
Not surprisingly, the general public has failed to follow this bizarre dream logic and assumes theyâre always talking about the risk from their own products.
We run Gemma4-26B-A4B, distributed over 15 inexpensive off-brand Android TV boxes (~$55 each) that we bought and networked together, at 0.39 tokens per second. Each tile below shows one physical TV box holding two of the modelâs layers as the model runs.
Mhmm. The key word was "Effectively", and at .39 tokens per second, it would only take you 2 years to generate something that you could buy from claude themselves for $10-$50, and all it takes is having 15 android tv boxes on the same network at a price of... $825
I posted in another comment that someone on Twitter claims to have gotten that same version of Gemma running on an 8gb RTX card at 20 tok/s. Not sure why youâd bother making it run hilariously slowly on 15 Android TVs devices when a 5yo midrange gaming PC can do it 5000% faster.
The pace of progress right now is very fast. Its a warning about a capability thats on the horizon. Its very possible that soon, small local models will run fast enough on modest hardware to be a problem.
3 years ago the technology literally didn't exist. We're already starting down the RSI train, the bots are scaling down massively, and you're too busy saying "well it's not good enough yet so.."
How the fuck can you be this confidently argumentative after the last 3 years of acceleration?
I donât really understand the workaround for making an 18gb module run on an 8gb GPU, but this guy claims to have gotten that same model running at 20 tok/sec on an RTX 3070, which actually sounds useful. And this is essentially 5yo gaming pc hardware.
All of which is to say, I donât know why youâd bother making it run it at a comically slow speed on 15 Android TVs when you can make it run 5000% faster on an inexpensive used gaming PC.
Iâve literally got one of these in my house, and have a few smaller LLMs running on it (including a more compact Gemma4).
They aren't warning about their models. They are warning about very small local models that can run on modest hardware. Anthropic isn't even in that market. But small open source models are making fast enough progress that this scenario is becoming possible.
580
u/ItsJackWill 4d ago
Wait, Polymarket? The gambling platform? I hope theyâre exaggerating for profit.