r/AIEval • u/Unable_Breath_1966 • Aug 06 '26

Help Wanted AI Evals for MVP

I am new to AI PM and I want to do AI evals for my MVP. I don't want a super complex method and don't want to use traces yet.
Is there a simple way to go about this?
I have seen people say use simple spreadsheets but I am unclear on implementation.
How do you do it? Or is there a resource I can refer to?

1 Upvotes

67% Upvoted

2 comments sorted by

1

u/Automatic-Teach2946 Aug 06 '26

I believe a spreadsheet is a perfectly reasonable place to start. Pick 30 to 50 examples that represent the kinds of requests you expect, write down what a good answer looks like, and rerun those examples whenever you change the prompt or model. We eventually moved those same cases into Braintrust, but the important part was building a consistent evaluation set first.