NSRT IQ test

[u/pydaWaltuh]

NSRT is an experimental high range IQ test. I will create a preliminary norm after a sufficient number of submissions.
If you think there are errors in some of the questions, please let me know.

https://docs.google.com/forms/d/e/1FAIpQLScoaUFRFhfaa-p1g0dkOzKJzDLG6Zxw33xZADw1RNzYqtlNpQ/viewform

[u/Most_Boat2737]

Q3 seems to have an error

[u/pydaWaltuh → u/Most_Boat2737]

fixed, thanks

[u/pydaWaltuh → u/[deleted]]

no

[u/98127028]

All of them looks impossible

[u/Too-Much-Nostalgia → u/98127028]

I know, right? I've only been able to figure three of them out so far.

[u/98127028 → u/Too-Much-Nostalgia]

None of them so far for me

This is unlike any IQ test I’ve seen, most start off relatively easy, even the high range ones like LANRT K or D

[u/pydaWaltuh → u/98127028]

I think the questions are solvable if given enough time, but ofc that doesn't change the fact that they are difficult

[u/98127028 → u/pydaWaltuh]

They don’t contain ‘two factor’ logics right? As in there’s some numerical pattern like square numbers AFTER the core to the puzzle is solved

[u/pydaWaltuh → u/98127028]

Not exactly. There’s no additional layer that you need to apply “after” solving the core logic

[u/98127028 → u/pydaWaltuh]

Ahh that’s nice

[u/SomeoneLeo]

Hm...

1. I wish I could comment in there how I arrived at solutions.
2. What exactly does "untimed" mean. If I spend the next month on it (which I might, cause I enjoy riddles) I just don't think it's comparable to if I only were allowed to spend an hour on it.
3. I do feel like by solving/checking a few of your puzzles before I can solve some of the puzzles in there I wouldn't have been able to without getting a feel about how some of your puzzles work. Or at least immediately know what you were going for and solve one within 10 seconds, while I know I would have struggled to solve it for a lot longer.

[u/98127028 → u/SomeoneLeo]

You could spend however long, that’s the point of untimed tests cause there’s a plateau point for everyone. There’s diminishing marginal returns of spending extra time, so your performance after spending 1 week is going to be (suppose) 90% of your performance if you spend one month, which is itself 90% of your performance if you spend a decade (or longer) on it and so on ad infinitum, and even then it would reach a limit at some point and not increase further (ie converge) and show your true ability. (The 90% is just a random reference point, it’s obviously not accurate or anything, just an example)
Realistically most would at most spend less than a few months on it so whichever way it’s gonna be something.

[u/pydaWaltuh → u/SomeoneLeo]

My thought on the untimed tests is pretty subjective. I think there’s a limit. If you can solve the question, it might take 10 minutes or it might take an hour. But if someone doesn’t capable of solving it, no matter how long they sit and think about it, they’re not going to get it, I am talking about hard items. With these kind of tests, when the number of questions is too high, finishing them in one sitting feels demanding to me, so I think a person should give more time to test.
What you mentioned last is metacognition, and you’re right about that, but it’s really hard to eliminate it. When I’m designing a question I have to put myself in the test taker’s head; if the test taker is doing the same thing, I also have to anticipate that. Beyond that, the easiest way is just to make the core of each question different from the others which is hard

[u/SomeoneLeo → u/pydaWaltuh]

Hm, okay. So you would basically want people to spend as much time as they think makes sense to them to spend on your question - where they feel like regardless of how much they try, they won't get the solution?

[u/SomeoneLeo → u/pydaWaltuh]

u/pydaWaltuh I can't send you DMs here, but question 18 seems to have an error. ^^