Why the same interview for every candidate beats improvisation

One plan, one rubric, every candidate. Scores with quotes and timecodes instead of memory. A consistency index shows where a panel drifted.

A structured interview asks every candidate for a role about the same things, in the same order, and scores the answers against the same rubric. Research in industrial and organizational psychology puts it among the most reliable predictors of job performance, and a 2022 re-analysis of the meta-analytic evidence ranks it first among selection procedures. Improvisation feels more natural and produces decisions that are harder to compare and harder to defend.

What is a structured interview?

Three things make an interview structured. A plan: the competencies to assess, the questions for each, the follow-ups and the time for each part. A rubric: a scale with behavioral anchors, so that a "3" on ownership means the same thing to every interviewer on the panel. And consistency: the same plan and rubric for every candidate for the role, from the first interview to the last.

None of this prevents a conversation. It decides what the conversation is for. The interviewer still listens, still follows a thread, still asks the question that only made sense after the last answer. The difference is that at the end, every candidate has been asked about the same things and scored on the same scale.

Why does improvisation feel better and work worse?

Improvised interviews feel better because they reward the interviewer. A good conversation is pleasant, and a candidate who is easy to talk to leaves a good impression. The impression is real. It just isn't the thing being hired for.

They work worse for two reasons. First, different candidates get different interviews, so the comparison afterwards is between one candidate's answers and whatever the second interviewer happened to ask about. Second, the evidence evaporates. A scorecard filled in from memory three hours later records the impression, not the answers. In a debrief, the person with the strongest memory or the strongest opinion wins, and nobody can check.

What does "the same interview" mean in practice?

In Vettasy, a role has one plan. It comes from competency templates for engineering, product, sales, support and leadership, or from the company's own question bank, and it is shared by everyone who interviews for the role. Each competency has questions, follow-ups and a time budget. The rubric is a scale with behavioral anchors, the same for the whole panel.

During the interview, the interviewer's screen shows the plan with a coverage tracker: which competencies are covered, which remain, and how much time is left for each. Follow-up prompts appear as suggestions, not as a script. If the plan changes after the first interview for the role, the change is recorded, so a later comparison knows that not everyone got the same version.

Afterwards, AI drafts the scorecard from the transcript, with a quote and a timecode for every score. The interviewer confirms or corrects each line. Nothing unconfirmed counts, and nothing unconfirmed is shown to the rest of the panel. The result is a scorecard where every number points to a moment in the recording.

Doesn't it make interviews robotic?

A plan is not a script. Reading the same questions in the same tone to every candidate would be robotic, and it isn't required. What is required is that the same competencies are assessed with the same rubric. The interviewer chooses the words, follows up on what the candidate said, and skips a follow-up when the answer already covered it.

Interviewer coaching helps here, and it stays private. Only the interviewer sees their talk share, their leading questions, their interruptions, and a note if a question strays toward a protected characteristic. None of it reaches the candidate's report. Aggregated across a workspace, it shows an administrator where interviewers need help, not who to blame.

How do you know the panel stayed consistent?

The consistency index answers that question for a role: which candidates were not asked about a competency, where an interview left the plan, where the rubric was applied differently across the panel. It doesn't grade the interviewers. It shows where a comparison between candidates is solid and where it rests on different interviews.

The decision log records who decided, when and on which evidence, and exports for audit. When a decision is questioned later, by a candidate, a regulator or a colleague, the answer is a list of quotes and timecodes, not a recollection.

What does the candidate get out of it?

The candidate gets the rules in advance. The agenda in the app shows the competencies, the format, the duration and the names of the interviewers before the interview starts, and a prep pack arrives with the invitation. The exact questions stay unknown, so that the interview remains comparable between candidates, but nothing about what is assessed is a surprise.

They also get feedback that means something. Because the scorecard is confirmed and tied to quotes, the written feedback drafted from it, and sent within five business days, describes what the candidate said rather than how the interviewer felt. If the employer misses the deadline, the candidate automatically receives the list of assessed competencies and the session report.

The same interview for every candidate is not a constraint on good interviewers. It is what lets a good interview count for the candidate who gave it.

Sources

• Sackett, P. R., Zhang, C., Berry, C. M. and Lievens, F. (2022). Revisiting meta-analytic estimates of validity in personnel selection: addressing systematic overcorrection for restriction of range. Journal of Applied Psychology, 107(11), 2040 to 2068. doi.org/10.1037/apl0000994. "Structured interviews emerged as the top-ranked selection procedure."
• Schmidt, F. L. and Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology. Psychological Bulletin, 124(2), 262 to 274. doi.org/10.1037/0033-2909.124.2.262.
• Vettasy, For employers: plans, scorecards and the decision log.

Written by the Vettasy team

Vettasy is a desktop application for job interviews. Employers run structured, recorded interviews in it with verified participants. It is free for candidates. Windows and macOS.