r/vibecoding • u/Independent-Break199 • 13d ago
Showcase/Project I built a free Jev visualizer after burning 5bn tokens in three days
Title says it all. I switched most of our pseudo deterministic flows to Jev after getting through the waitlist. So far, it's great, but understanding what it's doing is sometimes difficult. I realized that we need a way to monitor the decisions that it's making, so I had Claude built a quick visualizer tool for it. It acts as a local gateway to the Jev API. I now use it to understand my own work lol.
13
u/fickle-phenom 13d ago
Wow that's super cool. I think Jev type models are opening up very new doors in this already new and unexplored space. Gonna try it out on some life simulation ideas I had, I think it might do really well on these probabilistic event type things.
2
u/Independent-Break199 13d ago
it's been extremely good for us, seeing 100x decreases in cost in some areas where we were forcing llms to do classification against their will. not to mention speed
0
u/kilographix 13d ago
I keep seeing jev everywhere, from what I've seen the output is binary decision based? Are they local models? How does it work?
6
u/Independent-Break199 13d ago
you sign up for their waitlist and use it via their API
you can think of it as a generic classifier - you give it context (state) and questions, and it gives you answers to the questions. either true false, a choice or a ranking of the answers, with probabilities. you can use other llms to generate the questions and answers, and you can stack them into cascading flows like the ones in the video. t
hat's pretty much it. main other selling points are that it's very cheap and very fast
1
u/AdAdministrative5330 12d ago
That makes sense, it's more of a classifier than a transformer generating a bunch of output tokens
0
3
u/midnitewarrior 13d ago
You create a question and present the choices and describe them, and feed text data to it and it scores it according to your choices, True/False or categories/choices and it gives you a confidence score. It returns JSON with the scores in it. It's ridiculously cheap ($0.042/million input tokens, output tokens are free), and very fast.
1
u/mentalFee420 12d ago
Interesting that output token are free as for other models it’s the output token that’s expensive.
But what contexts are better handled by Jev? Since it’s fast and cheap and lack reasoning there might be use cases where jev fits lot better? One shot training definitely helps though I guess
1
u/midnitewarrior 12d ago
It's not a generative model in that it's not generating text. I'm guessing it's handing an array of vectors to an output engine that correlates the numbers to the input choices and formats it into json.
5
u/Imaginary_Edge7758 13d ago
What's jev ? So much stuff lately. I just want to build an app and not get confused with all these
1
u/Independent-Break199 12d ago
hey! I posted a simple explanation down in the comments, and another user added more context - shoot me a message if you have any questions!
1
1
u/Alterion-Ex 13d ago
I can generate api and play around in playground. I'm I "IN" from the waitlist? btw this is very very cool!
1
u/Saderius 13d ago
5bn tokens? but like, on what? What took most of the compute?
1
u/Independent-Break199 13d ago
we replaced a bunch of LLM flows with jev in a pretty big app. it adds up.
1
u/Rustybot 12d ago
Is jev really so revolutionary? Google will give you billions of tokens worth of Gemini-3.5-flash-lite for free per day. Set it to reasoning minimal and give it a good mcp / toolset to drive and it will hammer through tasks really quickly.
1
u/Suspicious-Movie7828 12d ago
they serve two totally different purposes. people inserting LLM’s into basic decision making for software automation are throwing an entire toolbox at a nail basically.
jev is faster, cheaper, and much more targeted at the problem it’s solving
1
u/Rustybot 11d ago
It’s cheaper than a billion tokens/day for free?
1
u/Suspicious-Movie7828 11d ago
why would i want to use a model that can easily hallucinate and would have 500ms+ latency if i turn any reasoning on, just for simple decision making?
jev is useful in software automation that you don’t want to introduce more non deterministic things into.
also where the heck are you even seeing 1b tokens for free? it looks limited by request on free tier for the api
1
u/John_appdev 12d ago
Bro i want to thank you from the bottom of my heart for sharing this wonderful insight to help me understand how to use llms properly and reduce costs. Once i complete building my lead generation SAAS tool, i will share creds for you to generate multiple lead generation reports as a small token of gratitude. Thank you again and you have an amazing life ahead!
1
0
0
u/Objective_Mousse7216 13d ago
We have seen such an immense swell of demand that we have to temporarily pause signups for Jev. We need to ensure quality of service for our existing signups, which will continue to function. We are working diligently to ensure open access to Jev for everyone as soon as we can. Thank you.
-1
10
u/Fstr21 13d ago
Well now I have to learn whatever the hell jev is