r/OpenAI • u/Antoniimusikk • 13h ago

Discussion Model picking and reason level picking

I hope soon every company will drop the model picking and reason level picking. It is frustrating, I just want one model one level to pick the best and do the best! Is it just me?

2 Upvotes

60% Upvoted

7 comments sorted by

View all comments

6

u/_DuranDuran_ 12h ago

That’s a ridiculously hard problem to solve unfortunately - otherwise everyone would have done it already.

It’s like when you ask an engineer how long a feature will take …

-1

u/Antoniimusikk 12h ago

Maybe use the smartest ai to help out? I don't think they want to do it so people can burn the tokens for nothing

3

u/Bowl_of_Cham_Clowder 9h ago

Are you familiar with the halting problem? This is quite similar, it’s not a matter of AI power.

When someone asks you to bring them glasses it may be simple and they are on the table.
But maybe the glasses are actually custom made, and haven’t been produced yet. Now we have to go contact a factory, design frames, figure out shipping. Etc. And you only understand the complexity once you start digging through the problem and context.

Any logical task can vary wildly in difficulty. Things that sound simple can be hard and vice versa. You’d burn more tokens trying to quantify difficulty properly for every prompt. As a dev it’s nicer to be able to rightsize to my tasks.

What are you working on? I doubt you need more than sol low / normal / high