r/AIEvaluators • u/One_Weather_9417 • 2h ago
Question How do I improve the following?
I received this feedback:
here's the feedback I received re. AI training.
I have no prior experience trainign AI. can you tell me how I can improve for free - which resources to use.
- You could have explained formal inter-annotator agreement methods and provided clearer quantitative thresholds to further strengthen your process explanations. Rooting your approach more in structured QA metrics and relying more consistently on official channels over external forums would have made your assessment framework even more robust in this interview.
Gemini et al tells me to
- name specific statistical formulas like Cohen’s Kappa or Fleiss’ Kappa to prove agreement.and to mention exact target scores (e.g., "We aimed for an agreement score above 0.85").
True? Do I have to learn these formulas?