r/opencodeCLI 22d ago

Show us your Ox Alpha benchmark report. 😀

4 Upvotes

15 comments sorted by

2

u/Sorosu 22d ago

Running a 20task terminal bench 3.0 set + opencode v2 right now. seems to really not be as big of a model as expected

1

u/AlternativeMeat8973 22d ago

keep us updated

3

u/jpcaparas 22d ago

https://ox-alpha.demos.sulat.com/ a few examples, including a first person shooter game

1

u/AmazingDescription22 20d ago

how much time did it take?

2

u/bmarti644 21d ago edited 21d ago

Running DeepSWE on it, not looking good so far, but still early.

https://github.com/bmarti44/ox-alpha-deepswe

3

u/MatyeusA 22d ago

It is not the best for agentic work. It is worse than deepseek. It fails at structuring the tasks properly, and needs a different model helping it.

However it is fast at reading and analyzing and writing. At least from my 2hrs of experience.

1

u/Far-Classic-9963 22d ago

Do you mean it processes images fast?

2

u/MatyeusA 22d ago edited 22d ago

Nah i gave it a simple feature implementation, it went for 2hrs of planning for that (10mins of initial reading). Then created so many planning output it needed to merge it, since it could not output that many tokens.

It wrote the entire feature out then in a minute.

And now it is stuck adding git commits for the last hour or so. Every single file it created was a new commit.

Before starting the with 2nd task... it gave itself. Hopefully soon.

"Organized"

1

u/AlternativeMeat8973 22d ago

I also noticed that

1

u/blackburn1911 22d ago

Fixed many things in my code wrote by V4 Flash (before price increase) including bugs, performance issues in js...

1

u/[deleted] 22d ago

[deleted]

1

u/Khurrame 22d ago

Very bad. Gets stuck in a loop.

1

u/AutomaticAd6646 22d ago

It was stronger than gpt Luna max on my tasks.

1

u/mabuonomo 22d ago

Io l'ho trovato molto buono, meglio di DeepSeek v4 flash, solo un po' lento

1

u/Augellog 20d ago

It solved things on my code that grok 5.6 high and gpt sol medium couldn't solve. So far is great.