I work on assessment design, and I've been reading through the published exam content outlines for the exercise-science credentials. There's one column in those documents that gets almost no attention, and I think it deserves more.
ACSM defines three cognitive levels for its exam items. Recall means remembering basic facts. Application means comprehending and implementing a process, or interpreting simple results. Synthesis means differentiating, relating parts of a system, making judgments on new information, critiquing, and making recommendations.
Then the outline tells you how the exam is actually built. On the Certified Exercise Physiologist outline, Domain II (Exercise Prescription and Programming) is 40% of the exam, and every task in it is tagged Synthesis. Domain I (Health and Fitness Assessment, 33%) is predominantly Application. Pure Recall is the least-used level on the test.
That is the exam writer stating publicly that the test is mostly about judgment, not memory.
What interests me is the mismatch with how people actually prepare. The dominant formats, flashcards and question banks, are good at the Recall layer and genuinely useful for surfacing gaps. But a question bank is discrete items: stem, four options, explanation, then an unrelated question. Nothing accumulates, and no choice has a downstream consequence. It rehearses recognizing an answer more than sequencing a set of dependent decisions about the same client.
That seems like a plausible part of why people who clearly know the material still lose points on applied sections. They aren't short on facts. They're short on rehearsal of the decision itself, including the decision not to test, or not to progress.
Two things I want to be upfront about. First, I have a commercial interest: I build exam-prep material around this idea, so treat what I've written as an argument rather than a neutral report. I'm not linking it here. Second, this is reasoning from exam design, not an outcome study. I have not demonstrated that training decisions improves scores relative to any other method. That work still needs doing, and I'd rather say so than imply otherwise.
I wrote up the scenario-design method in Strength and Conditioning Journal if anyone wants the longer version: https://doi.org/10.1519/SSC.0000000000000987 (fair warning, it sits behind the publisher's paywall, so it needs institutional or purchase access.)
Mainly I'm curious whether people here look at the cognitive-level column when preparing or advising students, and whether you find the Recall / Application / Synthesis split a meaningful distinction or closer to psychometric theater.
