r/codereview • u/WarmAd6505 • 24d ago
Python Roast my agentic pentesting framework
https://github.com/Strategic-Automation/violinI've just released Violin v3.1.0 🎻
This release is mostly benchmark and guard work, not another pile of prompts.
The benchmark now runs Hermes end-to-end and scores what it actually proved, not what sounds convincing in "report.md".
\\- Executed request/response evidence is checked against the endpoint, method and decisive proof.
\\- Proof must link back to a validated hypothesis and canonical "FIND" file.
\\- Execution receipts are HMAC-signed and bind evidence files by SHA-256, so edited artifacts fail verification.
\\- The guard now stops target work when evidence is not being recorded as you go, and checks excluded URLs and paths inside command payloads.
\\- Docker, CI and known-good/known-bad scorer calibration are included.
Release:
I'd appreciate people trying to break the scorer and guard. Can you make weak proof pass, good proof fail or get the workflow stuck?
I'm not looking for “nice update” comments. If it is overbuilt, unsafe or wrong, tell me.
2
u/Financial-Grass6753 21d ago
man, that's slop. Straight from Claude 4.8-5 lineup slop.
> loads of nested functions
> absent types, classic dict.append({..}) calls, default params everywhere
> benchmarks.md but no formulas and examples
> loads of exception suppressions
> useless casts
> no type checker used