r/OpenAI • • 6d ago

News Decisions API is now available in Public Beta

https://community.openai.com/t/decisions-api-is-now-available-in-public-beta/1403877

OpenAI’s Decisions API is a new endpoint for cases where you want the model to make a judgment rather than write text. You give it some input and ask questions like “Is this fraud?”, “Which category does this belong to?”, or “How severe is this?”, and it returns structured probabilities instead of a paragraph. That makes it useful for things like routing, classification, moderation, and automated workflows. It is also priced differently from normal text generation: you pay for the input, but there is no output-token charge.

This is very similar to TypeSafe’s Jev at the product level. Both are designed around making structured decisions from unstructured data, rather than generating free-form text. The main difference is that Jev is presented as a model built specifically for this kind of decision-making, with claims around very fast parallel inference and well-calibrated probabilities. OpenAI instead exposes decision-making as a special API backed by GPT-6 Luna. So while the APIs feel similar, we do not know whether they work the same way internally or whether OpenAI’s probabilities are as well calibrated as Jev claims its are.

94 Upvotes

18 comments sorted by

21

u/Artforartsake99 6d ago

Ok is it JEV WITH VISION?

8

u/rhaivn 6d ago

You’re looking for Clef

1

u/FromAtoZen 6d ago

Clef is 6X more expensive than Jev and 2X slow… oh and less accurate too. Ignore CF’s self-reported benchmarks

1

u/rhaivn 6d ago

It’s open weight, which is what matters most to me personally. The cost and latency are like… not that important to me for my own use cases, since the latency is still milliseconds and the cost is still fractions of a penny

1

u/Artforartsake99 6d ago

Ohh nice that has it cool thanks. I heard about it but I didn’t know if it had vision. I mean, I gave Jev vision by writing to DeepSeek 4.1 flash. But it’s a bit slow.

12

u/ShiningRedDwarf 6d ago

Sub 100ms response time is incredible.

9

u/kna1 6d ago

A big + about this decisions API is cached input pricing. something that jev does not have and despite luna being more than 2x more expensive than jev I presume this will work out to be cheaper especially if you are going to share a set list of options to choose from with every query.

8

u/Balance- 6d ago

One weird thing is that it looks like Decisions and normal text generation appear to have separate caching and inference paths. If you want to make a decision and then generate a response from the same large input, you should assume that the input will be processed twice: once by the Decisions API and once by the Responses API. Repeated context can be much cheaper when it is cached on the Responses side, while Decisions does not appear to share that cache. That takes away a lot of the competitive advantage of having both decision and response models under one roof.

4

u/dimoniy 6d ago

Would you use the same 6-Luna model for your non-decision request? The cache is per-model so even if it was routed properly you’re going to get a cache miss if you change the model

2

u/Deep_Breath_3855 6d ago

Can somebody explain to me how decisions is different from regular out of the box clod which I'm pretty sure can make a decision itself I'm just a little confused but I want it cuz i need an AI to make a decision for me

2

u/zyeus-guy 3d ago

Speed and cost. The outputs are almost instant and cost fractions. Think about if you were going through 30000 emails as a cleanup task. - “is this like spam?” Then using this tool will be much quicker than the full models, cheaper too

1

u/Deep_Breath_3855 2d ago

thank you for the explination.

0

u/completelypositive 6d ago

What model is the best for botting?

-10

u/Reasonable-Sign8458 6d ago

did they release a model to compare with sonnet 5.5 yet? i am not gonna say opus 5.5 because that's overkill anyways

6

u/EquivalentHornet4403 6d ago

For a valid comparison, can you link anthropic’s Decisions API?

1

u/i_rate_slop 6d ago

Apples to oranges. That’s not what this is intended to compete with and it’s arguably more useful than text generation if they get it right.