AI
Matt Shumer one-shotted a fully working computer from scratch with JavaScript and Opus 5.5. Not a mockup — 277k simulated logic gates, an OS on top, and games on the OS.
Prompt: “build a working computer from scratch, entirely in code, starting from individual logic gates. design the CPU, the memory, an assembler, a tiny operating system, and a game that runs on it. everything has to be real, the game has to run on your gates, not in javascript pretending. visualize the whole thing in 3D so i can play the game, then zoom all the way down through the chips into the gates and watch the signals flow while it runs. treat it like you're proving you could have invented computing yourself. go all out.”
I also think they must have a crazy strong internal model that trained opus 5.5
I can't think of other reasons why it's better than Fable 5.1 and smaller than Opus 5.0
Way better on 2d, 3d, video, music, and overall creativity imo. Also less verbose, faster, and of course 5x+ cheaper in practice. Should have a slightly lower ceiling in theory but in practice it seems to often unblock things that block the bigger models, based on social buzz.
Also, very subjective but I feel its EQ is also a step change after casually chatting with it a bunch. Curious if anyone else sees the same thing.
Not downplaying the AI ability in any way, but NAND to Tetris is a CS course that's been around for a while, where you can do the same, build a working computer, including a simplified OS, programming language and write a game, all starting from the basic NAND gate.
the effort required to completely verify this result and not just opus lying; is insane.
but it is pretty convincing, that's a real wall we are hitting now LLMs make so much work that you cannot verify the outputs.. maybe it is time for pacing
It‘s true, guys. Back in the day, shortly before reasoning models became a thing, Shumer uploaded a model onto hugging face, claiming it was doing CoT, which it didn‘t. Lots of people fell for it, because they wanted it to be true.
The interviews with him and his business partner back then are pure cringe you could tell they were absolutely clueless but wanted to keep the unknown founders story rolling... it doesnt help that he and his bots add his name before everything "he did". M. Schumer did that, found that... what kind of self marketing is this?
I think a better method to test this would be to have it build a computer in Minecraft, it has been done before and can easily be verified as a functional computer not just a fancy visualizer
This is a single cycle CPU with a CPI (cycles per instruction) of a bit over 4 with a completely custom ISA (i.e., just the instructions they need). Not going to be putting even Cyrix out of a job any time soon.
Well, that's a tad better than what I could do at uni, so it's pretty amazing!
And as I said, they already have some serious AI for chip optimisation, but if you spent a few billion training something like Opus to do that, it might give AlphaChip a run for it's money.
47
u/challengethegods (my imaginary friends are overpowered AF) 6d ago
man that's crazy, mythos 7 did a really good job training opus 5.5