Common Interview Scoring Mistakes

Most scoring problems are predictable

After enough cycles, the same mistakes show up: someone falls in love with polish (halo), someone avoids extremes (central tendency), someone scores harder after a star candidate (contrast), and someone writes notes that do not match the number they circled. This article is a field guide to those failure modes—not another sermon on “be fair.”

Use it in calibration sessions: pick one mistake, watch a sample clip or transcript, score independently, then talk about the mismatch. Pair with calibration methods and scoring practices.

Cognitive Biases in Scoring

Halo effect occurs when a single positive trait or impression influences overall assessment. An evaluator impressed by a candidate's articulate response may rate all other dimensions more favorably, even if evidence doesn't support those high ratings. The halo effect causes evaluators to see candidates as uniformly good or bad based on limited information.

Confirmation bias leads evaluators to seek information that confirms their initial impressions while discounting contradictory evidence. Once an evaluator forms a positive or negative first impression, they unconsciously look for evidence that supports that view and overlook or reinterpret evidence that contradicts it.

Recency bias gives disproportionate weight to the most recent information. In interviews, the final questions or comments may loom larger in evaluators' minds than earlier responses, even when earlier information is equally or more relevant. This bias can distort overall assessment.

Similarity bias causes evaluators to favor candidates who resemble themselves in background, interests, or communication style. We naturally feel more positive toward people like us, but this bias undermines fairness and reduces diversity in selection outcomes.

Procedural Errors

Inconsistent criteria application occurs when evaluators apply different standards to different candidates. One evaluator might be lenient while another is strict, or the same evaluator might apply different standards at different times. Inconsistency undermines fairness and makes decisions difficult to defend.

Insufficient documentation happens when evaluators fail to record the rationale for their scores. Without documentation, it's impossible to understand why decisions were made, to identify patterns of bias, or to defend decisions if challenged. Good evaluation requires clear justification.

Rushed evaluation leads to superficial assessment. When evaluators feel time pressure or have too many candidates to evaluate thoroughly, they may skim materials, make quick judgments, and miss important information. Rushed evaluation increases error rates and reduces decision quality.

Failure to use rubrics or structured criteria results in subjective, inconsistent evaluation. Even when rubrics exist, evaluators may ignore them or apply them loosely. Without structured guidance, evaluation becomes impressionistic and vulnerable to bias.

Contextual Mistakes

Ignoring candidate context leads to unfair assessment of achievements and challenges. A candidate who achieved excellent grades at a well-resourced school with extensive support is evaluated differently from one who achieved the same grades at an under-resourced school with significant obstacles. Context matters for fair evaluation.

Overweighting credentials rather than demonstrated capabilities is a common error. Evaluators may be impressed by prestigious school names, high test scores, or impressive titles while overlooking whether candidates have actually demonstrated the qualities that matter for success.

Cultural misunderstanding can lead evaluators to misinterpret communication styles, behaviors, or experiences. What seems like lack of confidence in one cultural context may be appropriate respect in another. Evaluators must be aware of cultural differences and avoid judging candidates against cultural norms they don't share.

Disability-related misunderstandings occur when evaluators misinterpret behaviors related to disabilities. A candidate who speaks slowly due to a speech impairment might be judged as lacking communication ability, or someone who avoids eye contact due to autism might be seen as dishonest. Evaluators must understand and accommodate disabilities.

Prevention Strategies

Structured evaluation with clear rubrics is the most effective prevention strategy. When evaluators must assess specific criteria against defined standards, cognitive biases have less influence. Rubrics provide guardrails that keep evaluation focused on relevant factors.

Evaluator training on bias and common mistakes raises awareness and provides strategies for avoidance. Training should cover specific biases, their impacts, and techniques for mitigating them. Regular training reinforces awareness and helps evaluators recognize their own tendencies.

Calibration exercises where multiple evaluators score the same or similar candidates and discuss differences help identify bias and inconsistency. When evaluators see how their scores differ from colleagues' and discuss the reasons, they become more aware of their own patterns and can adjust accordingly.

Documentation requirements force evaluators to justify their scores. When evaluators must provide specific evidence for ratings, they're less likely to rely on vague impressions or biases. Documentation also creates records that can be reviewed for patterns.

Score-sheet habits that prevent mistakes

• Score independently before panel discussion—talk after numbers, not before.
• Use behavioral anchors (“names a concrete tradeoff”) instead of vibe words (“strong”).
• Require one evidence note per dimension; empty notes are a red flag.
• If two raters differ by more than one point, reconcile before the total is locked.

For building the sheet itself, see building evaluation rubrics. For calibration drills, see evaluator calibration.

Common questions