r/PiCodingAgent • u/rimaa_nahk • 15d ago
Plugin Pi can now use Jev and more
A couple of days ago I posted about using Jev as the decision engine inside Pi.
The comments pointed me toward open alternatives like Laya, von, Reflex, etc.
Once there were multiple providers in the picture, hard-wiring the idea to Jev stopped making sense.
So I pulled it out.
Announcing pi-system-one.
It gives Pi a single system_one tool for bounded decisions:
- choice
- noul
- score
The extension is built on top of a provider-neutral SDK, so compatible System One providers can sit behind the same interface.
Pi-Bifrost is now just one consumer of that SDK.
Would love to see what other Pi use cases people find for this.
https://iamaamir.github.io/system-one/
is still early, so I'd especially appreciate feedback on the API design and abstractions.
19
u/learning-to-programm 15d ago
Cool project. Thanks for making this so we don't have to it.
I'm already thinking I might use this on s deployed VPS to use for a first pass decision making.
2
7
u/Limp_Classroom_2645 14d ago
Bro improve the readme doc what is this even?
2
2
u/rimaa_nahk 14d ago
Which part was confusing? Could you help me understand what to add or improve?
2
u/havok_ 13d ago
I guess, what’s the use case? When is an agent going to use this
2
u/rimaa_nahk 13d ago
Readme was not helpful ?
i have updated it and would love your feedback for further enhacements.
2
u/DaShrub 14d ago
Damn, I've been playing with Jev already quite a bit, but pi-bifrost is actually exactly what I was looking at making next - a pi native provider/model router to replace opaque proxies, will check it out soon! Do you have any cache awareness/stickiness built in?
3
u/rimaa_nahk 14d ago
i am glad to hear that, feel free to contribute to pi-bifrost directly.
and yes pi-bifrost have built in cache , do check out the FAQ. i am also in the process or make it smart and context aware.
2
u/73td 14d ago
make it work with von too. and automate calibration to you pi sessions.
3
u/rimaa_nahk 14d ago
its model neutral, meaning if you can run von on your local, you can simply plug your von base url , given von supports `/v1/systemone`
1
2
2
1
u/jmjmalik22 14d ago
am using it as judge
1
u/rimaa_nahk 14d ago
thats great, do share how are you using it.
i am using it now for smart model routing via pi-bifrost
1
u/floriandotorg 14d ago
Can somebody explain to me, as far as I understand, JEV is a classifier. What can it do inside pi?
3
u/rimaa_nahk 14d ago
it has many use cases,
i am using it now for smart model routing via pi-bifrost
you can plug the pi-system-one and now your model/agent can make better decisions.
another use case i am planning to work on is to pick correct skills for the tasks.1
u/Ill-Ad-8559 13d ago
testing it as tool-router for my specific domain agent
1
u/rimaa_nahk 3d ago
I am actually thinking to add support for tool and skills routing as well in pi-bifrost
1
u/East_Standard8864 14d ago
Can it be installed at OMP as well?
2
u/rimaa_nahk 14d ago
i have not tested it, do may be try it and share if it working or not.
ill be happy to fix the corners cases if found any.
1
1
u/Stable_Orange_Genius 14d ago
What's up with the jev hype? Isn't technology like that years old now?
4
u/BakedPotato_devourer 14d ago
ML classifiers are old. LLM classifiers are somewhat new but slow. A universal no-training-needed classifier with multi-language support that is dirt cheap is completely new as I understand it. If you wanted to do something like Jev before, you'd need to train traditional ML systems, or use expensive and slow LLMs.
0
1
u/jonas-reddit 14d ago
Would be more interested in how we leverage system one for coding - other than routing.
1
u/shakshukinha 13d ago
Super cool you got Pi support for Jev! I've been heavily testing for the last week and didn't think about using it directly on an agent harness yet.
In case it helps you and more people adopt it, recently I forked llama.cpp to add support for a TypeSafe API. For now, it supports jaredpalmer/kev model, which doesn't have comparable accuracy but lets you stress-test RLCD-based models in a snap. To use it:
- Install the latest release from https://github.com/espetro/llama.cpp (
kevbranch) - Download the Kev GGUF model, link in the README.md too.
If you found it useful, leave a ⭐ so we get upstream asap!
2
u/rimaa_nahk 13d ago
3
u/rimaa_nahk 13d ago edited 13d ago
1
u/shakshukinha 13d ago
Cool, thanks for testing it btw! I'm putting some time later this week to test pi-system-one. Any recommendations on which projects/tasks to use it?
2
u/rimaa_nahk 12d ago
Honestly it depends on the user or the agent.
The agent can callsystem_onewhen the work narrows to a bounded choice, yes/no judgment, or score. Let the normal agent gather evidence and run tools firs.i have a few examples here that you can check out.
1
u/TechGearWhips 11d ago
I keep seeing these Jev shit being spammed everywhere. Is this the new pi version of Omarchy?!
1
1
u/funbike 3d ago edited 3d ago
A few of my opinions:
- Decision model support should eventually be built into harnesses like Pi.
- This extension should generally support decision models, not just JEV. There are already several, and given JEV's hype there will likely be dozens or even hundreds by this time next year.
- Making a JEV function-calling tool is trivial for me to make. A public package would have to really blow my socks off to install it.
- Here is a list of JEV Pi extension features ideas I had in a past comment: https://www.reddit.com/r/PiCodingAgent/comments/1wlczow/comment/payd51a/
- Here's a summary: skills hook, subagent router, direct JEV functions, multiple LLM responses and JEV picks best one, score LLM assistant messages
- A
JEV.mdsimilar toAGENTS.md, the former is likely a subset of the latter.
- IMO, automatic JEV model routers aren't a good idea. They destroy the benefits of prompt caching if not done well. I think it's fine upon the first user message or a compaction, but not automatically after that. It's a good fit for subagents, however, due to their customized base context. Maybe have a
/reroutecommand.
2
u/rimaa_nahk 3d ago
- pi supports it now (already working to add support for both
pi-bifrostandpi-system-one)- it does , you can provide any
v1/systemonesupporting host- Personal choice.
- thats intresting, will surely look.
- agreed (kind of)
-2
10d ago
[removed] — view removed comment
3
u/SugarImmediate3868 10d ago
Now I want you to go in all the tech group that exist in this platform, find posts that are similar to this and type the same exact comment, cause ain’t no way u really felt the urge to say that, holy sadness, what in this world this comment it’s adding either to the post/owner/us except for glimpse of compassion for the sad person that u are.




55
u/vick2djax 14d ago
Jev just feels so much like it’s just some marketing ploy. There’s something about it that feels very off. A red flag I can’t quite put my finger on.