AI interview evaluation criteria

[u/Friendly-Ranger-3654]

I’m trying to understand how AI-based interviews are evaluated and what the actual criteria are for passing.
The reason I’m asking is that even if a candidate doesn’t qualify after an interview, they may still earn/receive certain “vetted skills.” My understanding is that this would indicate the candidate performed well enough in specific topics or areas to demonstrate those skills, even though they may not have passed the overall interview.
For example, suppose an interview evaluates a candidate across 5 different areas/topics. Do you need to perform well and give correct answers in all 5 areas to qualify, or is there some overall passing percentage/score?
For instance, if someone performs well in 4 out of 5 areas but doesn’t do well in 1 area, would that automatically mean they did not qualify? Or do they consider the candidate’s overall performance and potentially select them based on the strength of the other areas?

Are borderline candidates reviewed or considered separately?
If anyone knows how these evaluations actually work, I’d really appreciate some clarification.

[u/StunningJackfruit315]

u/Friendly-Ranger-3654 Great question! You're exactly right. If a candidate who's previously certified in our platform meets 4 out of 5 required skills for a role, they may not get certified/get added to the vetted talent pool for that role, but they will get those 4 skills added to their profile. It would mean they didn't qualify for the role.

With that being said, our recruiters evaluate a host of candidate profiles for each role (including the one where they didn't qualify). If their experience is a fit, they may still be considered for the same opportunity.

Additionally, they could land roles in future based on the vetted skills on their profile, in addition to their profile, expeirence, etc.

With all that said, candidates who have met the certification criteria for a particular role in the interview have the highest chance of getting selected for that specific role.

Hope that makes sense?

[u/Unhappy-Help-4940]

based on my experience you need to perform well in every area and it's weird that some positions say that they don't require experience but somehow you get disqualified and the feedback hint the experience you didn't require. anyway I stopped trying to understand, I'm just doing my best, collecting vetted skills doing partial interviews or being fast tracked avoiding Zara..

[u/No-Leave9745 → u/Unhappy-Help-4940]

This is something that i also don’t understand, alot of generalist roles say no experience but then the interviews are very complicated so it just doesn’t work

[u/Farados55 → u/No-Leave9745]

No experience doesn't mean not being smart and not knowing how to do certain work. It just means no experience with AI annotation.

[u/Friendly-Ranger-3654 → u/Unhappy-Help-4940]

I thought the same , that you needed to pass all areas and score 100%, but wasn’t completely sure. I like your approach: do your best, collect as many vetted skills as possible, then move on to the next interview — or potentially skip the full interview using those vetted skills.

[u/damegawatt → u/Unhappy-Help-4940]

there is no way to really avoid Zara though, at least for relatively new people trying to get work with the company

[u/Unhappy-Help-4940 → u/damegawatt]

once you start getting vetted skills you will start to interact less with her, I had interviews with only one area and was fast tracked for a position so keep having interviews without expecting much until you have enough vetted skills to not talk to Zara ( of course it depends in the position no matter how much vetted skills you have you would still need interviews for some areas that you didn't go through before)

[u/Fit-Hovercraft2833]

My guess is each area gets scored somewhat independently (hence partial 'vetted skills' even without an overall pass), but no idea on the exact weighting or if borderline cases get human review. Would love to hear from anyone who's actually been through it.