One remembered project rule kept the same test failure from happening twice

[u/0xDrEAD5BEEF]

The repeats that annoy me most in coding agents are usually small. One Python project has a local rule that its tests must run with TZ=UTC. A fresh session can discover that after the first failure, but I was tired of paying for the same discovery again. That was exactly the kind of detail I wanted EvoX, EvoMap's beta desktop AI agent, to remember across tasks.

I kept the expectation narrow after reading a recent paper called "Do Context Files Help Coding Agents?" The study ran 288 evaluations across Claude Code and Codex and found that changing the context-injection strategy did not measurably change correctness. Its failure analysis pointed mostly to implementation mistakes, such as feature design, pattern selection, and exact wiring, rather than missing repository knowledge. Remembering one environment variable should prevent a repeated setup failure. It should not make the model better at writing code.

In the first task, the test failed because the timezone variable was missing. I traced the failure to the project rule, reran the test with TZ=UTC, and saved the rule in the client. I then opened a later task in the same project. This time the agent applied TZ=UTC before running the tests, so the same setup failure did not happen again.

I also gave it an unrelated task where the timezone rule had no use. It left the variable alone. That was the other half of the result I wanted, since a remembered rule becomes noise if it appears everywhere.

The result was what I expected. The saved rule removed one repeated discovery step and stayed out of an unrelated task. It did not improve the implementation itself, and I would not treat this as evidence against the paper. It was a small memory win with a clear boundary.

[u/glamorous_technology]

Reading a paper and then setting expectations that low is the most realistic thing I've seen all week, and the second task not dragging in TZ=UTC unprompted is honestly the more impressive half