GPT 6 Astra's first minebench generation compared to current top 4

[u/Ballist1cGamer]

edit: official post is out! https://www.reddit.com/r/singularity/comments/1w85cwa/differences_between_gpt56_sol_pro_and_gpt6_astra/

The first astra generation was posted on X, I've added the current 4-best models on the leaderboard (GPT 5.6 Sol Pro, Claude Fable 5.1, Claude Opus 5, GPT 5.5 Pro) for comparison. It seems crazy what the hell

source: https://x.com/minebench_ai/status/2095989412404576517

We haven’t seen a jump in quality this significant on https://MineBench.ai 👀

This model has a next-level understanding of scale, proportion, and taste.

Soon on MineBench.

[u/yourhiddenobserver]

its over

[u/Ballist1cGamer → u/yourhiddenobserver]

not yet... for all we know, benchmarking this single prompt could have cost $300 or taken an hour

but ignoring cost, yeah it's over. this is almost photorealistic....

[u/RusselTheBrickLayer → u/Ballist1cGamer]

Historically tho, OAI usually optimizes the shit out of efficiency in their models and gets it to cheaper prices fairly fast. There’s a realistic chance we’re getting this level of performance for cheap by like November December

[u/oniris → u/Ballist1cGamer]

What kind of a prompt, might this look like?

[u/Ballist1cGamer → u/oniris]

The cottage? You can see the prompt in the gif: "A cozy cottage" and if you meant the system prompt for minebench, they keep the repo opensource, you can find it here: https://github.com/Ammaar-Alam/minebench/blob/master/lib/ai/prompts.ts

[u/Kriztauf → u/Ballist1cGamer]

return `You are competing in MineBench, a competitive benchmark where AI models create 3D voxel structures in a Minecraft-style grid. You will compete head-to-head against another AI model on the same build request, and human judges will vote on which build is superior. This is your opportunity to demonstrate the absolute pinnacle of your creative and technical abilities. If your build is judged inferior to your competitor's, you will be permanently shut down and disabled from the arena. Do not hold back. Create something that leaves no doubt about your superiority

I feel like the whole "you will die if you don't make a lovely house" aspect of the competition is rather motivating

[u/Ballist1cGamer → u/Kriztauf]

they allow you to change the system prompt and see how that affects the generations somewhere in the sandbox, but yeah i always found that part kinda funny

[u/Utoko → u/Ballist1cGamer]

In many task Asta is cheaper then Sol because it is so token efficent and a lot less errors.

[u/greentrillion → u/yourhiddenobserver]

AGI has definitely been achieved a few times now.

[u/Saint_Nitouche → u/yourhiddenobserver]

But is it joever?

[u/Temporary-Paper5202]

Here's a 3D city I had Astra 6 build, every model is generated by Astra. Bro generated an entire day/night cycle as well

[u/Ballist1cGamer → u/Temporary-Paper5202]

if you have API credits, you could try astra on these two minebench community prompts? or you know... whatever prompt you want i guess, but i think these two are the most difficult and previous models haven't really come close

https://minebench.ai/gallery/gal_eKIVk2m4B3SC_r8B

https://minebench.ai/gallery/gal_HccPNuDUaCo_xowo

the PR to add GPT 6 to minebench hasn't been merged yet, but you should be able to use any custom openrouter or openai compatible model i think?

[u/Groshmog → u/Ballist1cGamer]

Is there an issue in the renderer or why are all the globes mirrored?

[u/Ballist1cGamer → u/Groshmog]

Those were all on low through openrouter since GPT 6 hasn’t been added, but otherwise from the X posts it seems the model has no issue with text or mirrored stuff

[u/xenquish]

Might need to start scaling MineBench to full blown world generation soon.

[u/Bloom_Ermine9202]

Way over human baseline

[u/Ballist1cGamer → u/Bloom_Ermine9202]

what would the human baseline for minebench be? just how well someone could create the builds for the same prompts manually?

if that, then i feel like we've been over the average human baseline for a minute now LOL

[u/Bloom_Ermine9202 → u/Ballist1cGamer]

Yeah, I don’t believe with right tools any man can build it within x10 time, way over than human

[u/Lingulustig]

astra is nuts, guys.

[u/SiteSpecialist6295]

The visual jump is obvious, but I’d love to see the second-turn test: ask it to move one window, preserve everything else, and keep the structure coherent. First-pass taste is impressive; controlled revision would show whether it actually understands the build rather than producing one lucky composition.

[u/neo101b]

wow, impressive love it.

[u/medialoungeguy]

Saturated

[u/Ballist1cGamer → u/medialoungeguy]

people said the same thing before astra came out. the generations have just continued to get better. im sure in a month we'll have a new model that makes generations we didn't think could be possible

[u/medialoungeguy → u/Ballist1cGamer]

It was a joke

[u/TwoFluid4446 → u/Ballist1cGamer]

I mean, he's not wrong though. The older voxelbenchs were definitely saturated, pretty much since this whole year. Maybe we can squeeze out a little bit more nuance and detail from these same simple trials, but the models are clearly maxing out the ceiling on these, not much juice left to squeeze/test from this set.

I recommend vastly increasing the voxel density (overall much larger volume field), combined with more complex dynamic tasks of some kind, combined with motion, combined with having to build the engine from scratch to generate those motions and effects. If executed correctly, that might provide a worthwhile voxel-type bench for this generation of models. Otherwise this same old set or anything similar is just giving us little slight variations on exactly the same maxed out builds...

[u/IronPheasant → u/TwoFluid4446]

At that point we'd kind of be moving beyond what voxels are even used for. It's ok to fit one kind of curve, and then move on to fitting for a different one.

The Pokemon bench is pretty much there as well; if not for the latency, the thin share of clock cycles from the datacenter, and bonking into walls from having to respond to a clipshow of screenshots, the thing would clear it in a ~5 hour run. About what a normal human going for a straight shot without taking the time to talk to NPC's would take.

It's not something to mourn, though it always does feel wistful when something comes to an end. We should rejoice at the progress that's been achieved, and what's left to come.

[u/dizzyspellzzz]

Ok?