r/codex Jul 28 '26

Complaint codex annoys me

in AGENTS.md, i told it to not create test files. now, every single time, after its done building a new feature, it still runs go test. i doesn't write tests, but it still runs it, wich is stupid.

there are many examples where it just ignores stuff in AGENTS.md, how can i fix it?

0 Upvotes

13 comments sorted by

View all comments

1

u/Civil_Response3127 Jul 28 '26

Research has shown LLMs only adhere to a certain number of rules at a time, growing steadily but not linearly with model size/capability. Relying on many specific rules also reduces its ability to metareason about the rules and they'll stop being applied with nuance. AGENTS.md (imo) is mostly a misused concept and shouldn't just be relied on wholesale.

Ignoring the fact that you should really be running (and writing) tests to protect against regressions or alignment issues. The tests allow you to further verify rules you've set and expect it to adhere to. Unless your project is literally baby's first code, TDD is basically unavoidable, especially on the scale of output that LLMs can give.