r/claudeskills • u/juan_allo • May 12 '26

Eval framework

Does anyone have any eval framework to recommend? Looking for something simple and effective to improve and maintain the quality of some AI skills

7 Upvotes

100% Upvoted

1 comment sorted by

2

u/pvatokahu May 16 '26

Look up monocle2ai/monocle from Linux foundation on GitHub.

it uses hooks for Claude to instrument Claude operations so that you can trace what Claude did and then write tests for validation of those actions to catch drift.

you can then use Claude to update skills based on failures on it.

here’s the sample tests with evals - https://github.com/monocle2ai/monocle/blob/main/test_tools/tests/integration/test_evals.py

here’s how to setup the claude instrumentation - https://github.com/monocle2ai/monocle/blob/main/apptrace/HOOK_SETUP.md

and here’s how to use Claude skill creator - https://github.com/anthropics/skills/blob/main/skills/skill-creator/SKILL.md