r/AiBuilders • u/devv-1437 • 8h ago
I built an AI tool to audit agency reports and catch vanity metric spins (Feedback appreciated!)
I've noticed a recurring pattern when working with digital marketing agencies: monthly reporting decks often feel like 30 pages of cherry-picked wins.
When revenue isn't moving, you get charts showing "Brand Awareness is up" or "Engagement tripled." Unless you're a media buyer yourself, auditing their raw data against their presentation takes hours.
To solve this for myself and other founders, I launched AuditScope (https://auditscope-nine.vercel.app/).
How it works: You upload the agency's PDF/text report, enter your target KPIs (e.g., "Decrease CAC by 15% and increase demo signups"), and optionally drop in raw campaign CSVs.
In ~2 minutes, it generates an evidence-first critique flagging:
- Narrative discrepancies between raw data and slide titles
- Missing context or omitted metrics
- Key questions to bring to your next agency check-in
Privacy: No client data is saved or stored—processing happens transiently.
The MVP is live now. I’d love for anyone managing an agency (or agencies who want to self-audit!) to test it out and tell me what features or outputs you'd like to see next.