An adaptive interview is an instrument, not a script
Most "AI interviews" are a fixed list of questions read out by a language model. The candidate answers, the model scores, and the whole thing is really a chatbot wrapped around a static form. It feels modern, but statistically it behaves like a paper test: everyone gets the same items, easy questions waste a strong candidate's time, and hard ones tell you nothing about a weaker one except that they struggled.
An adaptive interview works differently. It treats the conversation as a measurement problem: at every turn it holds a current estimate of the candidate's ability, and it chooses the next question to reduce its uncertainty about that estimate as fast as possible. The result is a shorter interview that reaches a more confident, more defensible conclusion. Here is how the pieces fit together.
Computerized adaptive testing: choosing the next question
Computerized adaptive testing (CAT) is the well-established idea behind this. Rather than fixing the questions in advance, the system picks each next item based on how the candidate has answered so far. Answer well, and the next question gets harder; struggle, and it eases off — always steering toward the difficulty where the candidate's answers are most informative.
"Informative" is the operative word. A question a candidate is almost certain to get right, or almost certain to get wrong, tells you very little — you already knew the answer. The questions that move your estimate are the ones near the edge of their ability, where the outcome is genuinely uncertain. CAT selects for exactly those, which is why an adaptive interview can reach a reliable read in far fewer questions than a fixed one.
The goal of each question is not to be hard or easy. It is to be informative — to be the question whose answer you can least predict, because that is the one that teaches you the most.
Item-response theory: turning answers into an ability estimate
CAT needs a way to convert answers into an ability estimate, and to know how difficult each question is. That is item-response theory (IRT). In a two-parameter (2PL) model, every question carries two numbers: its difficulty (the ability level at which a candidate has a 50% chance of answering well) and its discrimination (how sharply it separates stronger candidates from weaker ones).
The candidate's ability is a single value — conventionally called theta. Zero is roughly average; positive is above the bar, negative below it. As each answer comes in, the model updates theta and, just as importantly, the standard error around it — how confident it is in that estimate. Early in the interview the standard error is wide; each informative answer narrows it.
Knowing when to stop
Because the interview tracks its own uncertainty, it does not need a fixed length. It can stop when the standard error drops below a target — meaning it has enough evidence to be confident — or when it hits a time or question ceiling. A candidate who is clearly strong or clearly below the bar is resolved quickly; a candidate near the decision boundary gets more questions, because that is where the extra evidence actually changes the outcome.
This is the opposite of a fixed test, which spends the same number of questions on everyone regardless of how much uncertainty remains. Adaptive stopping concentrates effort where it is needed and returns time everywhere else.
Evidence-anchored scoring: where the number comes from
Ability estimation tells you how much. Evidence anchoring tells you why. Every dimension the interview scores is tied back to the specific answer that earned it — the excerpt, the reasoning, the moment in the transcript. The score is not a black-box verdict; it is a claim with its receipt attached.
This is what makes the result defensible. A hiring manager can read the evidence behind a score. A candidate who appeals can be shown what their answer demonstrated. A reviewer calibrating the process can audit whether the scoring matches the rubric. Inference platforms cannot do this — there is no single answer behind a predicted fit. An uncalibrated test half-does it — there is a score, but no confidence and often no trace to the evidence.
The part the psychometrics cannot do alone: integrity
All of this measures ability precisely — but a precise measurement of the wrong person, or of someone working with hidden help, is precisely wrong. Adaptive rigor has to run alongside integrity monitoring: confirming presence, attention and liveness, and watching for the signals that a session is not what it appears to be. The measurement and the integrity check are two halves of the same claim; neither is worth much without the other.
Why the mechanics are worth understanding
It is easy to treat "AI interview" as a single undifferentiated category. It is not. A fixed-script model and an adaptive, IRT-calibrated, evidence-anchored interview produce results that look similar on the page and behave completely differently under scrutiny. One gives you a number; the other gives you a measured ability, a confidence bound, and the evidence behind every score — the raw material of a decision you can actually defend.
Key takeaways
- An adaptive interview is a measurement instrument, not a chatbot with a question list.
- CAT chooses each next question by information gain — the one whose answer is hardest to predict teaches the most.
- IRT (2PL) estimates true ability (theta) with a standard error, so the interview knows how confident it is.
- Adaptive stopping ends the interview at target confidence — fast for clear cases, deeper near the decision boundary.
- Evidence-anchored scoring ties every score to the exact answer that earned it, which is what makes it defensible.
- Psychometric rigor is only half the claim — integrity monitoring confirms it was really that person, unaided.