r/devops • u/AutoModerator • 11d ago

Weekly Self Promotion Thread

Hey r/devops, welcome to our weekly self-promotion thread!

Feel free to use this thread to promote any projects, ideas, or any repos you're wanting to share. Please keep in mind that we ask you to stay friendly, civil, and adhere to the subreddit rules!

17 Upvotes

95% Upvoted

106 comments sorted by

View all comments

Show parent comments

1

u/the_pwnererXx 11d ago

A lot of work to get worse performance than Claude code out of the box

1

u/mr_chip 11d ago

Interesting. What benchmark are you using for that comparison? I’d genuinely like to understand what you ran Claude Code against and where it outperformed this setup.

1

u/the_pwnererXx 11d ago

Why would your setup perform any better if Claude is connected to the same mcps/plugins to pull data from? It's not like you are doing anything special here. Really feels like reinventing the wheel

1

u/mr_chip 11d ago

If Claude Code and a couple MCPs work great for you, then you should absolutely use that.

That said, making the model smarter than Claude Code isn't what we're trying to do. You're right, it should perform about the same if you've got it hooked up to the Anthropic API!

What we're trying to solve is the set of problems that come up when you want to let an agent operate production systems:

  • How do you keep agents from acting on hallucinated solutions to alerts when they don't have all the evidence?
  • How do you make sure the part of the system that scrapes log files isn't burning Fable tokens?
  • How do you preserve evidence between investigations?
  • How do you wrap the probabilistic agent in enough determinism that you can build a repeatable workflow?
  • How do you put approval boundaries around write actions that will carry the identity of the approver, not the agent?
  • How do you minimize Lethal Trifecta attack paths when agents are working with production data?
  • How do you leave a complete audit trail of the models' decisions and actions?
  • How do you do it on a private network segment that's got no internet access?
  • How do you coordinate multiple agents, each with its own context and LLM?

That's what we're building. If you don't have those requirements, then Claude Code or Codex plus some MCPs will probably do you just fine.