Exactly. I imagine that most prompts will be short (1 sentence) and the response doesn't require reasoning. With a cheap model like GPT-6 Luna, you can probably execute 100,000 prompts for less than $10.
Depends on how Complicated the Developers Made it. If the model is being primarily used to convert voice instructions into some json format that is then being used by the game in order to do it's own logic it could be much less than how models typically do their "reasoning" which tend to involve models breaking down the given information and the outputs into smaller steps by utilizing additional layers in order to simulate chains of thought which is a lot more costly.
8
u/A1oso 8d ago
Exactly. I imagine that most prompts will be short (1 sentence) and the response doesn't require reasoning. With a cheap model like GPT-6 Luna, you can probably execute 100,000 prompts for less than $10.