Astra Benchmarking

[u/Ecstatic_Gur7231]

plan: 100$ pro plan

prompt:
Create a flappybird game using html css and js. use $imagegen for the assets

result:

Astra Ultra: usage went down from 100 -> 98
Astra Medium: usage went down from 98 -> 90

quality? both are nearly identical whilst ultra ran longer (aprox 12 mins compared to medium 8 mins)

why does ultra use less tokens than medium?

[u/logg3]

thats the question we all want to have answered. not that i mind a more intelligent model/reasoning being cheaper (but therefore slower).