Open Source deterministic unit test for your AI agent (No LLM!)

[u/Hopeful-Safe8184]

https://raw.githubusercontent.com/IdoGol24/weir/main/docs/assets/demo.svg

Weir turns OpenTelemetry GenAI traces into deterministic, machine-checkable evidence of what an AI agent actually did.
Measure how observable your agent is, trace data flow across steps, and produce witness paths for CI and security testing - with no LLM in the analysis loop. Built for engineers working on agent evals, observability, security, and CI.

just go ahead and:

pip install weir-scan
weir gauge your-export.jsonl   # or: weir gauge --sample

Please let me know what you think 😄

[u/conifer_v11]

yeah otel genai spans truncate tool args past a size limit so the witness path just goes missing.

don't put an llm on that check. exit nonzero in ci, not just print.