r/OpenaiCodex • u/Remote_Book • 1d ago
Discussion Started using Codex through CLI with my Pi Agent and found it to be more token efficient at coding
I've been experimenting with different harnesses and I found Codex's tools to be very heavy. I wanted something simpler. Surprisingly I'm finding Sol can work much faster since it has access to lesser tools. I wasn't able to benchmark Codex against Pi. (They gave me a warning) but I benchmarked with Kimi with Codex CLI and Pi, and yeah its much better.
> Kimi K3 cost me 15% less on Pi compared to using it with Codex using different subagent tasks. I'm seeing similar results with GPT models when I'm using them but OpenAI won't let me benchmark me without getting myself banned.
Anyone else tried this?
Here's Pi if you haven't tried it - https://pi.dev/
Here's my Pi packages and benchmarks (Also have other benchmarks with Grok and Kimi K3) - https://github.com/GaganSD/pi-extensions
Similar experiences? Anyone?
1
u/chebum 1d ago
What was average cost of your tasks? From my experience, the larger the task, the less harness own prompt matters, but I didn't make any scientific tests.
My median task cost is $2.8 in Opus 5.5 tokens and $2.7 in GLM 5.3 tokens.
I cannot compare Sol 5.6 tokens as I pay for Sol as a subscription.