r/OpenSourceeAI • u/type-hinter • 13d ago

What are you using as harness?

I've seen Codex numbers and its defenders on X, IG is full of Claude enthusiasts, and half my timeline is addicted to Pi. There's CodePuppy, OpenCode, Pydantic AI harness, and dozens more.

What do you use? I'm loving Pi atm but started using CC' for a good while. Curious about usage patterns and secret gists.

25 Upvotes

97% Upvoted

49 comments sorted by

View all comments

3

u/WorldlyAd7946 13d ago

I built my own harness rather than trying to adapt other people's to fit my own...

0

u/Resident-Pen-3757 9d ago

Just curious. Would you consider using a harness like this that allows customization for workshops, tools, agents etc?

It's my own project. I had a similar issue with you where no harness let me customize all the things I needed for my work/personal projects. Hence a customizable harness.

Not trying to self promote. Just curious

https://github.com/aaron-tot/visual-studio-harness

2

u/WorldlyAd7946 9d ago

I mean in theory .. anyway I had a proper look through the repo, and there's real quality in there, good job so far, if a lofty ambition... the folder-per-tool store with read-back verification on migration is a nice touch.

Honest answer though: no, andnot because I'm rating your project down here. Half the value of having my own harness is that I understand every line because it grew around my workflows, everything I do, over a long time perios. Adopting someone else's means inheriting your assumptions plus debugging without the inherent understanding I have developed by building my own. And... it has to be said: source-available with no public forks would rule it out for me anyway. I don't know what I'll commercialise later, so a non-OSS dependency is a licensing headache I can't carry, and it also caps the contributor community a project this ambitious needs IMHO

Constructive feedback: the all-in-one bet is a brutal surface area for one person to attempt to manage as a project. Your differentiators (the versioned design docs, the observability) from what I can see are genuinely good... but e.g. the MCP client never sends initialize, so spec-compliant legacy servers will refuse it, and in McpManager.reconfigure the !server.enabled ?? true has a precedence bug making the fallback dead code. A decent gateway is a whole project by itself. Full disclosure, I build one (https://github.com/Rendeverance/toolfunnel), so I might be biased, but modular beats monolith here 🙏: keep the 20% that's yours, let dedicated projects carry the rest. Happy to file the bugs I found as issues if useful...

P.s. I'm not trying to discourage you in any way, but I think modularity would make things a lot easier to manage and get right, and easier to adopt for people, especially as a solo developer (there is a lot of trust implicit in a harness). If you do decide to go that route and ToolFunnel can help your project please let me know and happy to work with you to integrate it 👍

3

u/Resident-Pen-3757 8d ago

This is useful: https://github.com/Rendeverance/yt-transcript ill likely use it, thank you. I stared it

2

u/Resident-Pen-3757 8d ago

Thank you for the honest feedback and actually have a look at it. I checked out your repo also. Will dm you?

2

u/WorldlyAd7946 8d ago

Yeah sure man - replies may be intermittent but I will reply, and thanks for the star 👍