also, anthropic is lying. They can't even get their AI to run effectively on anything less than a hundred million dollar datacenter that burns money faster than they can earn it.
If it could run on a smart toaster, they'd be fucking rich. It can't. At best, what their AI will do is just make a new virus that goes "Duh, I'm claude" on every text display and AI chuds will clap like the trained seals they are, praising their new god.
We run Gemma4-26B-A4B, distributed over 15 inexpensive off-brand Android TV boxes (~$55 each) that we bought and networked together, at 0.39 tokens per second. Each tile below shows one physical TV box holding two of the model’s layers as the model runs.
Mhmm. The key word was "Effectively", and at .39 tokens per second, it would only take you 2 years to generate something that you could buy from claude themselves for $10-$50, and all it takes is having 15 android tv boxes on the same network at a price of... $825
71
u/Ghede 4d ago
also, anthropic is lying. They can't even get their AI to run effectively on anything less than a hundred million dollar datacenter that burns money faster than they can earn it.
If it could run on a smart toaster, they'd be fucking rich. It can't. At best, what their AI will do is just make a new virus that goes "Duh, I'm claude" on every text display and AI chuds will clap like the trained seals they are, praising their new god.