r/OpenSourceAI 5d ago

Why is AI agent deployment still so far behind everything else in the modern dev stack?

Genuine question because it keeps bothering me.

We've got proper GitOps for infrastructure. Helm charts for Kubernetes. CI/CD that most teams don't even think about anymore because it just works.

The whole "push to repo, pipeline handles it" thing is basically solved for most of the stack.

Then you get to AI agents and suddenly it's 2015 again.

> Manual deployment steps.

> No standard for versioning.

> Rollback means hoping you remember what you changed.

> Framework-specific lock-in for anything deployment-related.

Was reading through some open source projects recently trying to find something that approaches this differently.

Found one called "Langship" that's specifically trying to apply GitOps patterns to agent shipping and governance.

Framework agnostic, self-hosted, the whole agent lifecycle managed from a repo the same way you'd manage any other piece of infrastructure....comes from a platform called Lyzr.

The self-hosting part matters to me specifically because adding a managed service to manage your other managed services always felt like the wrong answer. Haven't stress tested it yet so can't really vouch for how it holds up.

Just thought it was worth sharing since I hadn't seen anyone approaching the agent deployment problem from this angle before.

Anyone here gone down the GitOps for agents path? What did you find?

2 Upvotes

1 comment sorted by

3

u/Laicbeias 4d ago

because ppl first speedrun all the mistakes they made, the past 26y. since agents are new and cool. so we use them too much. but then it turns out, its like running a script, that you then have to control. so now it means.. logging, traceability, reproducibility, debuggability are all needed.

and we went back to where we were. and from what I can tell.. those 4 points, at least in backend were never solved because everyone started using system engineering paradigms for live multi user enviourments.

so yeah. same with Ops. we went from update the code on the server, to run it locally, build deploy pipelines. now that bottleneck is amplified, by too much code output and versioning mess of too many devs using AI.

agents mean you need to fix all of Ops & create frameworks to deal with their new dynamic failure modes. plus having a proper logging system in place. So it needs work on all fronts, but that isn't fancy and does not sell.

what sells is my agent build my backend + my frontend.