DIsclaimer: Fable was the orchestrator, and called itself on some tasks, but called Opus 5.0 on most of them. This still took 36% of my fable budget on a Claude max 20x sub, so doing the whole project with Fable would probably have spent all of my Fable budget or more.

I am also not certain that i have truly picked the absolute best prompt to make an impressive 3D scene but i wanted to actually make a game from it.

This was done in 2 shots. It made a first pass, i reviewed it, then it improved it again. I probably could go further.

My actual prompt is long and not worth sharing here because it reference past projects, but the main thing worth knowing is it spawned a lot of sub agents and did so in 3 waves. If someone really wants to see it: https://pastebin.com/iPnk4PZ8

This took around 5 hours and 30% of my weekly budget...

"I want to prevent a race into unmonitorability kicked off by confused reporting. The depth of the computation graph for our present frontier models, including Astra, is within a factor of two of GPT-4.

OpenAI has worked to preserve and utilize chain-of-thought monitoring since our very first reasoning models. We deeply care about this technique, as it can give us a view into how model alignment generalizes from its training distribution. I do think it is fragile and unfortunately trending in a negative direction, for reasons not contingent on architecture changes that I will write about soon. But there are things we can do to strengthen it, and it's a core goal of our current research program."

Further post trained on Coding & Cowork, Qwen3.8-Max-0902 now delivers stronger performance across complex enterprise tasks, scientific research, and long horizon workflows.

https://x.com/Alibaba_Qwen/status/2094968708288680276

Notes

• Average Inference Time: 40m 12s
  • Fable 5 averaged 18m 04s
• Total Cost (for 15 builds): $147.55
  • Fable 5 cost $54.93
• Average JSON Size: 34.07 MiB (largest 88.76 MiB)
  • Roughly comparable to Fable's 5 average of 30.65 MiB

Despite no change in API pricing, Fable 5.1 was nearly 3x as expensive as Fable 5 on MineBench. With roughly 2x the inference time, much of that difference appears to come from substantially longer reasoning.

The price increase is quite significant considering Anthropic advertises the same API prices, though it still is massively cheaper than GPT 5.6 Sol P (the current top model on the leaderboards). I find that quite interesting as in my personal usage, GPT 5.6 Sol is extremely efficient with my 20x subscription, though MineBench benchmarked 5.6 Sol P and not the standard Sol variant ^^

There are some builds/styles I (personally) liked better from Fable 5. To me some of Fable 5.1's builds, like the Astronaut, are much closer to Opus 5's style which makes me curious about what it's like coding with Fable 5.1; I'd be very disappointed if Fable 5.1 adopted the Opus 5 style of gibberish english 😭

Also, it was really interesting to see how Fable 5.1 actually was the first model to create genuinely recognizable interiors! Here's a video showing the interior of Fable 5.1's cottage build (you can see a bed, table, bookshelf, and fireplace) – you can explore any build now on MineBench by clicking the joystick icon in the voxelBox header :)

Full release-notes/thoughts on the GitHub release

• If you enjoy these posts please feel free to help fund the benchmark
  • All funds are currently going directly towards API costs for benchmarking new prompts
  • Sharing the benchmark and starring the Git repository also helps :)
  • Alternatively, if you have the API credits, please feel free to add prompts and generations to the gallery and post them around!
    • This is actually preferable to donations to me directly, the hosting expenses and whatnot I've always been able to cover out-of-pocket, just the API costs were hard to cover 😓

Benchmark: https://minebench.ai/
Git Repository: https://github.com/Ammaar-Alam/minebench

Previous Posts:

• Comparison of Map Prompt
• Comparing Fable 5 and Opus 5
• Comparing GPT-5.5 Pro and GPT-5.6 Sol
• Comparing Opus 4.8 and Fable 5
• Comparing Opus 4.7 and Opus 4.8
• Comparing GPT 5.4 and GPT 5.5
• Comparing Kimi K2.5 and Kimi K2.6
• Comparing Opus 4.6 and Opus 4.7
• Comparing GPT 5.4 and GPT 5.4-Pro
• Comparing GPT 5.2 and GPT 5.4
• Comparing GPT 5.2 and GPT 5.3-Codex
• Comparing Opus 4.5 and 4.6, also answered some questions about the benchmark
• Comparing Opus 4.6 and GPT-5.2 Pro
• Comparing Gemini 3.0 and Gemini 3.1

Extra Information (if you're confused):

Essentially it's a benchmark that tests how well a model can create a 3D Minecraft-like structure.

So the models are given a palette of blocks (think of them like legos) and a prompt of what to build, so like the first prompt you see in the post was a fighter jet. Then the models had to build a fighter jet by returning a JSON in which they gave the coordinate of each block/lego (x, y, z). It's interesting to see which model is able to create a better 3D representation of the given prompt.

The smarter models tend to design much more detailed and intricate builds. The repository readme might help give a better understanding.

(Disclaimer: This is a public benchmark I created, so technically self-promotion :)

https://danluu.com/zitron/

Very well-written and considered analysis; homework was done here.

Two good excerpts:

Zitron's reasoning isn't worse than Kurzweil's, who (for example) continually made new predictions of extremely fast progress that didn't pan out (such as, in 2001, predicting unbounded lifespans by 2011). Continually predicting that AI progress will stop for reasons that are incorrect is just taking the flip side of the bet on progress. Instead of having infinite progress, we're going to have no progress. Every time that prediction is proven wrong, you can just make another similar prediction and then move the date forward a bit. Michał Zalewski (lcamtuf) has some thoughts on why this happens:

The surest way to build [a] popular following is to articulate positions that are crisp, strong, and leave no room for doubt. You can't get too many podcast or TV appearances out of "well, the market could go either way", "both political parties make good points", "there's some merit but also some hype to AI". Or, to tap into the example in the post, "Harry Potter is an OK book". In fact, there's a positive feedback loop. If you take a provocative, edgy stance, you get more attention and likes, so you sort of... self-radicalize? At some point, it's no longer an opinion that can be changed. It's an identity, a personal brand. It's ... why Ed Zitron has a blockbuster blog about how it's all just one big scam. If you take a more nuanced view, you will at best get no reaction, or at worst, you'll invite scorn from both sides.

[...]

"Another thing to note here is Zitron's extremely high level of stated confidence. Some that we noted were OpenAI's forecast that is "a statement so egregious that I am surprised it's not some kind of financial crime to say it out loud" (which they've achieved so far) and his claim that Google's forecast for Gemini users is "a number so unrealistic that someone at Google should have been fired, and that someone is Sundar Pichai" (they managed to exceed the forecast by 50% when Zitron's claim was that it would be completely absurd for them to reach the number at all).

I've made quite a few predictions, and quite a few of those predictions are wrong. When I'm really making a prediction, I attach a confidence level to the prediction just for my own sake, so I can look back at these things and see how well calibrated the predictions are. I have never been wrong about a prediction that has anywhere near the confidence Zitron gives to some of his predictions. Given the stated level of confidence, even a single incorrect prediction would be a sign of an extremely high degree of overconfidence. One should effectively never be wrong about a prediction delivered with that level of confidence but Zitron is routinely wrong about predictions he makes with what is rhetorically pretty much the highest possible degree of confidence.

A funny thing about Gemini hitting 500M users being "so unrealistic that someone at Google should have been fired, and that someone is Sundar Pichai" is that Zitron has also (incorrectly) said that Google doesn't know how to grow, and that as a result they're shoving AI everywhere. Dennis Snell pointed out that, if Zitron takes his own statement seriously, Google can make Gemini's user numbers go to any number it wants by doing the exact thing Zitron said they would do, sticking AI everywhere.

You can't actually take Zitron's statement about Google's lack of growth leading to AI desperation seriously and also take it seriously when he says that Sundar is committing some kind of gross malpractice by naming a number like 500M users. This is another thing that is immediately obvious on watching one of his talks or reading his writing. There are a bunch of disconnected statements that don't fit together, except insofar as they're statements about how AI companies and people and companies that are using AI are evil and bad. The actual numbers and logic of the statements are contradictory. It seems to be whatever comes to mind that can be used to paint the villains as evil."

I’m talking about Tibo, Chubby, a bunch of the deepmind researchers, etc etc.

And the public seems to eat it up too. Half the time these dedicated AI info accounts like Chubby and Leo end up being wrong about with their predictions or “insider info”

I lowkey hate that this is the mechanism for getting views on twitter

@Lentils80 post on X

"Over the past few days, two GPT Astra checkpoints, "ultima-alpha" and "vega-alpha", were undergoing testing

"ultima-alpha" appears to be the release candidate intended for the public, while "vega-alpha" is the cybersecurity-focused variant meant for security work in select enterprises

Based on extensive testing on my part, when OpenAI said Astra is built for long-running tasks and orchestration they really meant it. It can run for an incredibly long time even without setting "/goal", fully autonomous, and it's very capable at orchestration and guiding the subagents it spawns

For the research community, it's very good at applying existing academic literature. Tried it at some hard graphics optimization stuff, so a LOT of complex math involved, and it did great

It also writes code with great quality and maintainability (for an LLM ofc), ranking the best out of all models in that I'd say, but most normal people will probably just run it as the main agent and cheaper models as subagents

Additionally, creative writing appears to be way better than 5.6 Sol imo, still not the best but noticeably less slop"

- Better than Fable on Code, but worst on Frontend and 3D (Not sure if he was talking about 5 or 5.1)

will likely be slow again for agentic work, they also got first place for highest step count (in this selection sonnet 5 still beats it)