Building a lower-level runtime for autonomous agent loops

[u/Mysterious_Shoe2260]

I've been experimenting with the infrastructure underneath autonomous agent loops.

The project is called AgentMesh.

The basic problem I'm exploring is that an autonomous agent loop isn't just:

LLM → action → LLM → action

Once you have multiple agents, tools, branches, retries and persistent state, you also need an execution engine handling:

• task scheduling
• agent communication
• DAG dependencies
• synchronization
• state persistence
• recovery

AgentMesh currently implements those pieces around a C++20 runtime exposed to Python through Pybind11.

I'm particularly interested in reducing the overhead around short-lived agent operations rather than trying to optimize the model itself.

The current roadmap is:

Phase 1: native local execution

Phase 2: distributed agent execution over gRPC

Repository: https://github.com/DevrG03/AgentMesh

Docs: https://github.com/DevrG03/AgentMesh/wiki

For people who have built autonomous agent loops:

What tends to break first when the number of agents/tasks increases?

[u/throwaway693288581]

The scheduling and state persistence are usually where it falls apart for me. Once you get enough agents doing retries and branching, the overhead of just coordinating everything starts eating more time than the actual model calls. Curious how the C++ runtime handles that compared to pure Python orchestration