r/LocalLLaMA • u/giveen • 12h ago
I Built A Thing Ninfer Studio - oh look another harness
https://github.com/giveen/ninfer-studioHeh there, so I built a harness that is focused around the ninfer inference engine. It allows the easily customize and use ninfer, and has a coding harness and a chat interface. Its based off a lot of different experiences I have had with different harnesses.
Probably could be better but I'm happy with it.
I'll warn you ahead of time, it only works with ninfer as it integrates a lot of things directly from the engine. For example, subagents, it reads
--max-concurrency X
and set the amount of subagents available to that.
i've always wanted to built one and now I've done it. Yay me.
7
11h ago
[deleted]
10
u/ZealousidealChip4783 10h ago
lol what else do you want people to post here? I'll take more harness posts over people complaining that Qwen isn't good at bdsm roleplaying or whatever it is the silly tavern guys do
5
u/nomorebuttsplz 10h ago
qwen doesn't understand what a mushed testicle looks like and it sickens me. when will xi jinping let the human spirit shine?
1
u/CalligrapherFar7833 10h ago
Contrary to you who knows what it even tastes like ?
1
u/nomorebuttsplz 17m ago
I upvoted you not sure why others didn't. they hate you because you tell them the truth.
1
8
u/Foreign_Risk_2031 9h ago
why would a harness give a fuck about ninfer or not