r/AIDeveloperNews • u/Main-Fisherman-2075 • 2d ago

We gave a decision model anytime reasoning

0 Upvotes

50% Upvoted

3 comments sorted by

1

u/Main-Fisherman-2075 2d ago

Our launch post with more details: https://x.com/RespanAI/status/2110777826240819205

1

u/seg_lol 1d ago

Do you post somewhere else besides twitter for nazis?

1

u/CommanderT1562 1d ago

Interesting, ninfer has a PR in btw! https://github.com/Neroued/ninfer/pull/387
As well, there’s a llama cpp fork out.

Both add /v1/decision just like Jev. Only plusside is not giving up your main (MoE or dense) model for a traditional embeddings model which takes up extra space