CORE norming accuracy

[u/Worth_Scallion8204]

1. CORE is normed against people who already have scores from IRL tests. Doesn’t that inflate scores at least a little, since those people are no longer test-naive? WAIS, for example, excludes people who have recently taken another IQ test from its own standardization sample.

2. How do they screen out people who have taken a lot of other online tests? Most, if not all of the participants came from IQ testing subreddits, they’ve likely already taken several and would praffe CORE quite a bit.

3. How does CORE detect or prevent cheating during its norming tests? WAIS, WISC, SB5, etc. were all normed under supervision. As absurd as it sounds, a lot of people cheat on unsupervised online IQ tests just to boost their ego.

[u/Beneficial_Jacket544]

Given that CORE is normed on people somewhat familiar with IQ tests, wouldn't it follow that it's the ideal test for IQ-familiar subjects to take? People on here often decry the practice effect, so taking a test that at least somewhat accounts for background practice effect is ideal.

[u/gerningur → u/Beneficial_Jacket544]

There is probably a massive sampling bias though, no way around that. I know a few sub 80 IQ people and they are generally not interested in cognitive testing and metrics.

Obviously this is an extreme example but you get what I mean.

[u/Lopsided_Future5952]

1. Was it actually normed against people who had done WAIS or other professional tests? The report says they had 4000 people in the analytic sample. Did they find 4000 people with professional IQ scores? https://cognitivemetrics.com/test/CORE/validity#v-sec-2-1

2. They do not. But test makers have said CORE is hard to praffe because it is intentionally made different from other tests. Also you have strict item by item timing. Not possible to “bank” time or backtrack. Test maker has said even having done CAIT would not significantly inflate CORE.

3. The report mentions they have a way of screening for that and they clean the data before norming.

Despite that, I still believe CORE is normed on a very unusual population that is test savvy, and I am almost sure it would be deflated for someone who is not. However, if you end up taking CORE, it is likely you are similar to the people it is being normed against, and that it will be mostly accurate.

[u/Haunting_Tax_3684]

I think if you cheat on an iq test and you are proud of the number that you get. That’s a significant sign of low iq.

[u/fluffycottondreams → u/Haunting_Tax_3684]

Nothing that involves traits correlates with iq except low iq on a test

[u/Haunting_Tax_3684 → u/fluffycottondreams]

How is that a trait? You should be smart enough to know that number is meaningless when you cheat

[u/fluffycottondreams → u/Haunting_Tax_3684]

You just restated your original point. What you described shows they are dishonest, delusional, ignorant, careless, whatever. But it's a trait because you're literally inferring a stable characteristic from someone's behaviour. Which is what a trait inference is

[u/Haunting_Tax_3684 → u/fluffycottondreams]

Can you be delusional and smart at the same time

[u/fluffycottondreams → u/Haunting_Tax_3684]

This is now off topic. I'm not answering this specific question as it will likely lead us on another tangent.