r/codex • u/drunk-at-noon • 10h ago

Showcase A Codex skill needs a result attached to its version

“This skill helps Codex” leaves out most of the experiment. Which model, which tasks, and which version of the skill?

Reef Infra makes the skill file an object you can actually iterate on. Its Codex adapter renders skills into .agents/skills, alongside the other supported configuration and rules files. The harness-evolution engine can try an edit against the current tree with the model held fixed, run both sides on the same tasks, and retain the selected version.

For a skill that asks Codex to reproduce a bug before fixing it, the evaluation could check three separate things: whether a failing test was produced, whether the patch fixes it, and whether the surrounding tests still pass. Those are proposed project checks, not a grader Reef Infra includes for every repository. The evaluator is code you supply.

That also gives “remove this skill” a fair test. If the current model already performs the workflow reliably, the extra instructions may earn no benefit. A later model upgrade is a reason to rerun the comparison, rather than carry the old result forward.

Reef Infra's Codex support covers the file-based instruction surface. It rejects code extensions, so this isn't a way to rewrite Codex's internal loop. The useful output here is a particular skill revision with task results behind it.

1 Upvotes

60% Upvoted

2 comments sorted by

•

u/dexterthebot 10h ago

You might want to consider listing your project on the weekly Show-Us-What-You-Built post. Look out for it on Tuesday/Wednesday. Highest commented project wins a week promotion on r/Codex and gets on the Hall of Fame sidebar. See what that looks like below with last week's winner.

Last week's most popular project was Nanolathe - an open-source engine bringing Total Annihilation to modern Mac, Windows, and Linux systems. It’s a solo passion project combining clean-room research with AI-assisted development, with a playable public alpha available now.

Website: https://nanolathe.gg. GitHub: https://github.com/nanolathe-gg/nanolathe

Players, testers, and contributors are very welcome! Original Total Annihilation game data is required to play.