How to run a panel interview

A panel interview is one interview in which two or more interviewers question the same candidate together. Give each skill one panelist, who asks its questions. Everyone marks the same signals, what a strong answer shows, as they listen, and files feedback before the panel compares notes. The debrief then reads every panelist’s marks side by side, never averaged.

Updated . Written by Hirezen.

What a panel interview is, and what it is not

A panel interview is one conversation: several interviewers, one candidate, one slot on the calendar. Seat the people the decision needs, such as the hiring manager and one or two who know the work or will work beside the hire.

Some companies call a day of back-to-back one-on-one interviews “the panel”. That is a loop, the interview process for one role: every interview a candidate goes through, in order, each with its own questions and skills to check. A loop can include a panel as one of its interviews.

The difference matters when you count evidence. Interviewers on the same panel rate a candidate more consistently than interviewers in separate interviews: a mean interrater reliability of .74 against .44, in a 2013 meta-analysis of 125 reliability estimates by Huffcutt, Culbertson and Weyhrauch. Panelists heard the same answers on the same day, so a panel gives several readings of one conversation. Hirezen counts a skill as read twice when two interviews in the loop check it and each asks a question written for it, however many people sat on either.

Who asks what: one owner per skill, everyone listening

Decide which skills this interview checks before you decide who sits on it. A skill here is what an interview checks, such as system design or leadership; HR frameworks call it a competency. Plan an hour around two skills, with time for follow-ups. A panel of three then has more people than skills, and not everyone needs to ask.

Each skill gets one owner
The owner asks the questions written for that skill and the follow-ups. The others hold their questions until that part ends, so the candidate answers one person at a time.
One panelist runs the room
They open, say who covers what, keep time and leave the last minutes for the candidate’s questions. If the hiring manager is on the panel, give it to them; they can own a skill as well.
The owner asks; everyone marks
Every panelist marks every answer they hear, including the ones to questions they did not ask.
Put a third skill in a second interview
If the role needs another skill checked at this stage, add an interview rather than stretching this one.

In Hirezen an interview can be given two skills, no more, and each question in its plan can be linked to the skill it is written for. Every panelist works from that same plan; the app does not assign questions to people, so agree the split before the call. Anyone in the workspace can be put on a panel. Someone new joins the hiring team as an interviewer, which opens the interviews they sit on and nothing else.

What each panelist marks while listening

Signals are what a strong answer shows, written under each question before anyone is interviewed. Under a question about a cache that showed one customer another account’s quota, the AI Engineer caching plan lists “Turns it off before diagnosing, and can say whether that is a flag or a deploy”. Each panelist marks each signal Yes, Not sure or No as they hear the answer, on what the candidate said.

In Hirezen’s interview room, each panelist has their own screen on the same plan:

Readings
Every signal under each question, marked Yes, Not sure or No, with a note if they add one and the minute it was marked.
Notes
Lines typed under a question or on the interview as a whole, each stamped with its moment. A leading +, − or ? flags a line as a strength, a concern or something to ask later.
Their place in the plan
Each panelist moves through the questions on their own screen. The feedback counts a question as asked once anyone on the panel reached it, and marks the ones nobody did as not asked.

During the interview, each panelist’s room shows only their own marks and notes. Two people can read the same answer differently, and the debrief needs both readings as they were made. When the interview ends, whoever presses Finish interview stops the clock for the whole panel, and the other screens name who finished it.

A panelist who missed an answer leaves its signals blank. The debrief treats a blank as a gap in the record, never as a No.

Why feedback is filed before anyone compares notes

Have every panelist file feedback before the panel discusses the candidate. A reading written down before the meeting is that panelist’s own, whatever is said first in the room, and the debrief has something to compare.

In Hirezen a panelist reads nobody else’s readings, recommendation or feedback until their own is filed. Someone who leads the hire and was not on the panel can read it all as it comes in. Filing takes two things:

A recommendation
One of four with no middle: Strong No (clear gaps on what this round is for), No (below the bar for this round), Yes (meets the bar; I would work with them) and Strong Yes (I would argue for them in the debrief).
Written feedback
AI drafts it from that panelist’s own readings and notes, never from anyone else’s and never from the recommendation. The panelist edits the draft or writes their own.

The interview is complete once every panelist has filed, and whoever leads the hire can remind anyone who has not. Feedback can be revised after filing, and the debrief shows that it was.

How the debrief reads the panel and records the call

Start where the panel disagreed, with everyone’s feedback already in.

Hirezen’s debrief is one grid for the round: a column for each panelist’s feedback, headed by their recommendation, and a row per signal in the order the questions were asked.

Splits first
A signal two panelists marked differently is lifted to the top, under “Split — start here”. That is the agenda: the panelist who asked the question says what the candidate said, and the others say what they heard.
Nothing is averaged
The grid shows each panelist’s marks and recommendation, with no combined score. Two Yes recommendations and a Strong No stay three views to talk through.
Gaps are named
Signals nobody marked fold into one line, and a question none of whose signals anyone marked is named, so it can go to the next interview instead of being read as a No.
One person decides
Only someone who leads the hire, a workspace admin or recruiter or the role’s hiring manager or recruiter, can record Advance, Hold or Reject, with a reason if they give one. The record keeps who made the call, when, and on which round. Panelists who do not lead the hire read the call once they have filed, and cannot make it.

What one interviewer’s feedback holds, and how it reaches an ATS, is on the after-the-interview page. What Yes, Not sure and No sound like for six skills is on the interview rubric.

Questions

What is a panel interview?
A panel interview is one interview in which two or more interviewers question the same candidate at the same time. A loop is the whole interview process for a role, and can include a panel as one of its interviews. On a panel, each skill has one panelist who asks about it, every panelist marks what they hear, and each files feedback before the panel compares notes.
How many interviewers should be on a panel?
Two or three, for an interview that checks two skills: one owner for each skill, and someone to run the room, who can be one of the owners. Each extra person adds another reading of the same answers, and spends the length of the interview to give it.
How do you split questions on an interview panel?
By skill. Each skill the interview checks gets one panelist, who asks the questions written for it and the follow-ups while the others listen. The candidate answers one person at a time, and every panelist still marks every answer, so the debrief has more than one reading of each.
How do you avoid bias in a panel interview?
Keep each panelist’s view their own until it is written down. Ask every candidate the same questions, each written for a named skill. Have each panelist mark the signals as they hear them and file feedback before reading anyone else’s. Start the debrief from the signals the panel marked differently, and have one person who leads the hire make the call and record why.
What is the difference between a panel interview and an interview loop?
A panel interview is one interview with several interviewers. A loop is the whole interview process for one role: every interview a candidate goes through, in order, each with its own questions and skills to check. A loop can hold a panel as one of its interviews. Hirezen counts a skill as read twice when two interviews check it, however many people sat on each.

Plan the loop, then seat each panel

In Hirezen, Plan your interviews lays out the loop for a role: each interview and the skills it checks, two at most. Then put the panel on each interview from anyone in your workspace. Each panelist marks in their own room and files before reading the others, and the debrief reads them side by side. No bot joins the call, and no audio, video or transcript is recorded. The free plan covers one open role and up to ten people.