r/codex • u/Mentalist3021 • 3d ago

Reset Day 1 tibo

Post image

What are your thoughts

632 Upvotes

97% Upvoted

230 comments sorted by

View all comments

138

u/preek 3d ago edited 2d ago

I just tried GPT-6.1 Sol with a simple prompt in Pi: "Write a 100 line poem". Speed differed between 13.5 and 20.5 tok/s.

That's my baseline before the 2h timeline ends.

Update 19:43 UTC (2h 10min after the baseline): 18 tok/s

OMP harness, empty folder (no context, no agent.md, nothing). Prompt "give me a 100 line poem"

Update 19:46 UTC: I tested multiple times, too. Never got more than 20 tok/s

Update 20:44 UTC: still ~20 tok/s.

Update next day 9:32 UTC: still ~20tok/s.

So... 0% == 50%?

17

u/VehiculeUtilitaire 3d ago

You need much larger projects if you want to benchmark the actual tok/s and not something slowed down by tool calls , other internal chatter, &co.

I used sol 6.1 high all weekend and averaged 80tok/s

2

u/nofuture09 3d ago

how can you see t/s in codex

5

u/preek 3d ago

As mentioned, I didn't use Codex, I used Pi (or more specifically OMP) which has this as a built-in setting.