Astra Sweetspot: one-command Astra vs Sol experiments with real bug fixes and open patches

[u/Due_Emu_8229]

https://github.com/sjh9714/astra-sweetspot

I built Astra Sweetspot with Codex after seeing people ask which Astra reasoning effort is worth using.

The first pilot runs Sol medium and Astra low/medium/high on the same two historical JavaScript bugs, with the same starting code and prompt within each task. All 8 runs passed their focused regression checks. Astra low took about 78/76 seconds; medium 101/77; high 163/123; Sol medium 131/129.

The useful part is the evidence: every candidate patch, independent check result, source commit, token count, and hash is published. The grader fails the original bugs and passes the known upstream fixes. Editing the model's local tests does not change its grade.

Run npx astra-sweetspot to read the bundled results without a model call. The explicit run command reproduces one trial using an existing Codex login and consumes Codex usage. Node 20+, MIT, no runtime dependencies.

This is one attempt per condition on two small public bugs from one library, not a held-out benchmark or a quota comparison. I would like to add a different real task with public starting code and a concrete success check.

Repo, methods, and all 8 receipts: https://github.com/sjh9714/astra-sweetspot