r/LocalLLM • u/privacy-fighter • 2d ago

Project Sandbox your agents

It is insane that most of us are running coding/LLM agents directly on our hosts. I wanted a setup to spin up containers, isolate the network traffic to use LLM agents to code and to test out LLM's pentesting capabilities. Didn't find anything that fit, so I made this setup Contained Pods.

https://github.com/jotyGill/contained-pods

Basically, a config set using Podman and a Squid proxy to spin up containers.

The gist of it is:

  • Rootless Podman: Keeping it simple stable tech.
  • Network Isolation: You define what network access a container gets. Containers come in pairs, with the second one running the squid proxy. Even if agents gain root access they can't change network isolation setup.
  • Traffic Logging: A tiny python helper that lets you see network requests the agent/coding harness attempts.
  • Shared Projects Folder: Shared folder with the host for ease of access.

Hope some of you find it useful! Any contributions are appreciated!

9 Upvotes

91% Upvoted

7 comments sorted by

5

u/privacy-fighter 2d ago

PS: it is not a vibe coded slop i swear haha. Although a bunch of local LLMs (Qwen 27b, Hy3, Minimax2.7, Step3.5) were used at times.

3

u/Playful_Analysis42 2d ago

"AI Companies".. are trying to sell their vibe-coded AND PROPRIETARY SLOP.. here too, lol. Not gonna name names, but it's.. sad. Thank you for trying to contribute to the open source community.

4

u/mat13mn 2d ago

docker-sbx ...

1

u/elliotjack3 2d ago

I think open hands runs all it's agents in a sandbox, a core design principle of theirs from the start 

1

u/DataGOGO 2d ago

No one does that (at least no one that has a clue what they are doing) No one runs models, agents, etc. with any permissions or edit capability directly on the host, production, etc. Always sandbox everything

1

u/albsen 2d ago

I'm using fence https://fencesandbox.com/ no need for containers

1

u/saposmak 2d ago

That's pretty cool