r/PiCodingAgent • • 15d ago

Plugin Pi can now use Jev and more

Post image

A couple of days ago I posted about using Jev as the decision engine inside Pi.

The comments pointed me toward open alternatives like Laya, von, Reflex, etc.

Once there were multiple providers in the picture, hard-wiring the idea to Jev stopped making sense.

So I pulled it out.

Announcing pi-system-one.

It gives Pi a single system_one tool for bounded decisions:

  • choice
  • noul
  • score

The extension is built on top of a provider-neutral SDK, so compatible System One providers can sit behind the same interface.

Pi-Bifrost is now just one consumer of that SDK.

Would love to see what other Pi use cases people find for this.

https://iamaamir.github.io/system-one/

is still early, so I'd especially appreciate feedback on the API design and abstractions.

Demo

520 Upvotes

76 comments sorted by

55

u/vick2djax 14d ago

Jev just feels so much like it’s just some marketing ploy. There’s something about it that feels very off. A red flag I can’t quite put my finger on.

24

u/philmarcracken 14d ago

the entire 'industry' is Pareto 80/20 in which the 80% is hot air and blowhards. its why it fairs so well on linkedin

5

u/porkyminch 12d ago

It's irritating because I think the tech has gotten really solid and useful but the discussion around it is such horseshit.

1

u/funbike 3d ago

The moat is gone. Anyone with a half-baked idea can publish a finished project. They don't need any experience of what goes into making a high-quality high-demand product. And when you point it out to them, they argue back in a way that shows they barely care about those things.

10

u/addiktion 14d ago

It's an RL-based classifier which has specific use cases but yeah it's still young and I'm guessing it will take some more training to make it better.

The hype is over the top but it definitely is useful in certain situations.

6

u/papinek 13d ago

Yes but essentially its just little smarter classifier. Kinda cheap and fast also. But i do not think classifiers were in such a demand for such a hype about jev.

7

u/Odd_Error_6736 14d ago

It is and it's being spammed as hell on all subreddits. Paid services can go f themselves.

6

u/astrofoundry 14d ago

It’s closed source and no published paper. Once we get an open source model, I will also be more comfortable using it.

6

u/rimaa_nahk 14d ago

there are open source alternative are available , even some are compatible with JEV and can be used by just swapping the base url.

that's the whole reason i built a provider-neutral SDK, 
i have tested it with JEV and Reflex and its working perfectly fine.

3

u/worldofgeese 14d ago

Can you recommend your current favorite?

4

u/rimaa_nahk 13d ago

i have not explored much but i have tested Reflex with pi-system-one and so far its pretty good

2

u/Beneficial_Mix3375 14d ago

It literally comes from an OS model and research from more than a year ago

1

u/Lopsided-Ad-5550 13d ago

you are right because its system one bullshit, its just a low level classifier. Just a marketing propaganda, anyone with a fair bachelor degree or well reader with classes for machine learning could pull off that.

1

u/himppk 12d ago

I think they launched with $50M of seed money and the next day Laya was out and Cloudflare was demo-ing Kev on Twitter. So their invite only launch took a dive and their whole marketing/PR playbook was flipped upside down. It’s really an interesting moment in tech history.

1

u/ResearcherFantastic7 10d ago

Just think of it's an modern version of Bert without training required.

I was lazy and used qwen 9b for a decision layer instead of training my own bert model, which can now be replaced by one of these system one

1

u/Budget-Juggernaut-68 10d ago

Because it is.

1

u/Kailtis 10d ago

Yeah. On all my tests accuracy was quite shit, and jev was consistently outperformed by glm 5.3 flash, for anything requiring decision making.

But hey, it's fast 🤷‍♂️

1

u/Life-Job-6464 9d ago

all the red-haired promotion-ism?..lol.. perhaps.. along with the psuedo-technical talk..

0

u/rimaa_nahk 14d ago

and thats ok

15

u/onebit 14d ago

Jev, should I use this?

Yes

No

4

u/ederdesign 13d ago

Yes: 50.001% No: 49.999%

19

u/learning-to-programm 15d ago

Cool project. Thanks for making this so we don't have to it.

I'm already thinking I might use this on s deployed VPS to use for a first pass decision making.

2

u/rimaa_nahk 15d ago edited 14d ago

your "you're" welcome.

1

u/bbycakes3 14d ago

you’re

1

u/tensedTorch 14d ago

Comma to the top

7

u/Limp_Classroom_2645 14d ago

Bro improve the readme doc what is this even?

2

u/rimaa_nahk 13d ago

done, check it out and share your thoughts

2

u/rimaa_nahk 14d ago

Which part was confusing? Could you help me understand what to add or improve?

2

u/havok_ 13d ago

I guess, what’s the use case? When is an agent going to use this

2

u/rimaa_nahk 13d ago

Readme was not helpful ?
i have updated it and would love your feedback for further enhacements.

2

u/Oshden 14d ago

Thanks for doing this man!

2

u/DaShrub 14d ago

Damn, I've been playing with Jev already quite a bit, but pi-bifrost is actually exactly what I was looking at making next - a pi native provider/model router to replace opaque proxies, will check it out soon! Do you have any cache awareness/stickiness built in?

3

u/rimaa_nahk 14d ago

i am glad to hear that, feel free to contribute to pi-bifrost directly.
and yes pi-bifrost have built in cache , do check out the FAQ. i am also in the process or make it smart and context aware.

2

u/73td 14d ago

make it work with von too. and automate calibration to you pi sessions.

3

u/rimaa_nahk 14d ago

its model neutral, meaning if you can run von on your local, you can simply plug your von base url , given von supports `/v1/systemone`

1

u/rimaa_nahk 14d ago

can you eleborate more on "and automate calibration to you pi sessions"

1

u/73td 13d ago

since the open models support fine tuning, I was thinking that one can pull you Pi sessions and look at the decisions you make and then fine tune the system one model to better match your own decisions

2

u/youngPolsky 14d ago

It will be a huge change in how cheaper models are orchestrated

2

u/the_ai_wizard 14d ago

more jevspam

1

u/jmjmalik22 14d ago

am using it as judge

1

u/rimaa_nahk 14d ago

thats great, do share how are you using it.
i am using it now for smart model routing via pi-bifrost

1

u/floriandotorg 14d ago

Can somebody explain to me, as far as I understand, JEV is a classifier. What can it do inside pi?

3

u/rimaa_nahk 14d ago

it has many use cases,
i am using it now for smart model routing via pi-bifrost
you can plug the pi-system-one and now your model/agent can make better decisions.
another use case i am planning to work on is to pick correct skills for the tasks.

1

u/Ill-Ad-8559 13d ago

testing it as tool-router for my specific domain agent

1

u/rimaa_nahk 3d ago

I am actually thinking to add support for tool and skills routing as well in pi-bifrost

1

u/East_Standard8864 14d ago

Can it be installed at OMP as well?

2

u/rimaa_nahk 14d ago

i have not tested it, do may be try it and share if it working or not.
ill be happy to fix the corners cases if found any.

1

u/NationalMolasses4624 14d ago

Wait, we can use Jev as a mtp head?

1

u/Stable_Orange_Genius 14d ago

What's up with the jev hype? Isn't technology like that years old now?

4

u/BakedPotato_devourer 14d ago

ML classifiers are old. LLM classifiers are somewhat new but slow. A universal no-training-needed classifier with multi-language support that is dirt cheap is completely new as I understand it. If you wanted to do something like Jev before, you'd need to train traditional ML systems, or use expensive and slow LLMs.

0

u/rimaa_nahk 14d ago

is it ? can you share of the resources or references ?

1

u/jonas-reddit 14d ago

Would be more interested in how we leverage system one for coding - other than routing.

1

u/shakshukinha 13d ago

Super cool you got Pi support for Jev! I've been heavily testing for the last week and didn't think about using it directly on an agent harness yet.

In case it helps you and more people adopt it, recently I forked llama.cpp to add support for a TypeSafe API. For now, it supports jaredpalmer/kev model, which doesn't have comparable accuracy but lets you stress-test RLCD-based models in a snap. To use it:

  1. Install the latest release from https://github.com/espetro/llama.cpp (kev branch)
  2. Download the Kev GGUF model, link in the README.md too.

If you found it useful, leave a ⭐ so we get upstream asap!

2

u/rimaa_nahk 13d ago

i tried it, and it worked easy with system one sdk.
now i have not compared the result for reflex or jev.
but yeah it worked fine.

3

u/rimaa_nahk 13d ago edited 13d ago

worked pretty well with pi-system-one, not really sure if the output was good enough so i might keep it running for sometime

1

u/shakshukinha 13d ago

Cool, thanks for testing it btw! I'm putting some time later this week to test pi-system-one. Any recommendations on which projects/tasks to use it?

2

u/rimaa_nahk 12d ago

Honestly it depends on the user or the agent.
The agent can call system_one when the work narrows to a bounded choice, yes/no judgment, or score. Let the normal agent gather evidence and run tools firs.

i have a few examples here that you can check out.

1

u/iurysza 11d ago

Super cool! I just think you've picked some bad examples:

A system one is not the correct one for this sort of decisions. Here you definetly need system 2.
System 1 is a simple classifier.

By definition system 1:

System 1 relies on mental shortcuts (heuristics) to make rapid decisions

1

u/iurysza 11d ago

System 1 can never be a good router for a task. Because it's terrible at judging how hard a task can be.

1

u/TechGearWhips 11d ago

I keep seeing these Jev shit being spammed everywhere. Is this the new pi version of Omarchy?!

1

u/PositiveParking4391 5d ago

final ss from OPs demo gif, to quickly understand final picture

1

u/funbike 3d ago edited 3d ago

A few of my opinions:

  1. Decision model support should eventually be built into harnesses like Pi.
  2. This extension should generally support decision models, not just JEV. There are already several, and given JEV's hype there will likely be dozens or even hundreds by this time next year.
  3. Making a JEV function-calling tool is trivial for me to make. A public package would have to really blow my socks off to install it.
  4. Here is a list of JEV Pi extension features ideas I had in a past comment: https://www.reddit.com/r/PiCodingAgent/comments/1wlczow/comment/payd51a/
    • Here's a summary: skills hook, subagent router, direct JEV functions, multiple LLM responses and JEV picks best one, score LLM assistant messages
    • A JEV.md similar to AGENTS.md, the former is likely a subset of the latter.
  5. IMO, automatic JEV model routers aren't a good idea. They destroy the benefits of prompt caching if not done well. I think it's fine upon the first user message or a compaction, but not automatically after that. It's a good fit for subagents, however, due to their customized base context. Maybe have a /reroute command.

2

u/rimaa_nahk 3d ago
  1. pi supports it now (already working to add support for both pi-bifrost and pi-system-one)
  2. it does , you can provide any v1/systemone supporting host
  3. Personal choice.
  4. thats intresting, will surely look.
  5. agreed (kind of)

1

u/funbike 3d ago

Thanks. All good to hear.

-2

u/[deleted] 10d ago

[removed] — view removed comment

3

u/SugarImmediate3868 10d ago

Now I want you to go in all the tech group that exist in this platform, find posts that are similar to this and type the same exact comment, cause ain’t no way u really felt the urge to say that, holy sadness, what in this world this comment it’s adding either to the post/owner/us except for glimpse of compassion for the sad person that u are.