How to Weight Interview Feedback When Your Panel Disagrees

As Global Head of Research & Leadership Advisory at JRG Partners, I spend much of my time on exactly this question, and the conventional wisdom around it is only half right. When an interview panel disagrees about a candidate, employers tend to average the opinions or defer to the loudest voice, and both are mistakes. Disagreement in a panel is information to be understood, not noise to be averaged away, and how you weight and reconcile conflicting feedback often determines whether you make a good decision or a muddled one.

Key Takeaways

  • Panel disagreement is information about the candidate, not noise to average away.
  • Averaging opinions or deferring to the loudest voice both produce poor decisions.
  • Understand why interviewers disagree, they may have seen different, real things.
  • Weight feedback by relevance, rigor, and the interviewer’s insight, not seniority or volume.
  • Structured evaluation against defined criteria makes disagreement productive.

Why Averaging Fails

The instinct to average panel opinions, treating a split as a middling verdict, discards the information the disagreement contains. A candidate who deeply impressed some interviewers and worried others is not a mediocre candidate; they are a candidate whose profile some read as strength and others as risk, and understanding why is far more useful than splitting the difference. Averaging turns a signal into mush, and it is a common way panels reach worse decisions than any single thoughtful member would.

Disagreement Is Often Real Signal

When capable interviewers disagree, they have often genuinely seen different things, one probed a strength, another surfaced a concern, and both may be right. The disagreement, properly understood, reveals more about the candidate than consensus would: it maps the candidate’s real strengths and risks. Rather than resolving disagreement by suppressing it, the productive move is to understand what each interviewer saw and why, treating the disagreement as a richer picture of the candidate to be integrated.

Weight by Insight, Not Authority

A common error is weighting feedback by the interviewer’s seniority or the volume of their opinion, deferring to the most senior or loudest voice. This is a poor basis. Feedback should be weighted by its relevance (did the interviewer assess something central to the role?), its rigor (was the assessment structured and evidence-based, or impressionistic?), and the interviewer’s genuine insight into what matters. A junior interviewer’s rigorous, relevant assessment can outweigh a senior interviewer’s impressionistic one.

Interrogate the Basis of Each View

To weight feedback well, interrogate its basis: what specifically did each interviewer observe, and how does it connect to the role’s requirements? Feedback grounded in specific, relevant evidence deserves more weight than feedback based on vague impressions or irrelevant reactions. This interrogation often reveals that an apparently strong dissent rests on a weak basis, or that a quiet concern rests on a sharp, relevant observation. Understanding the basis is how you weight views by their quality, not their volume.

Structure Makes Disagreement Productive

The deeper fix is structure: when interviewers assess candidates against defined criteria with evidence, disagreements become specific and productive, we differ on this competency, based on these observations, rather than clashing gut feelings. Structured evaluation channels disagreement into a useful mapping of the candidate against what the role requires, and it makes reconciling feedback a matter of weighing evidence rather than negotiating opinions. Unstructured panels produce unproductive disagreement; structured ones make disagreement illuminating.

What This Looks Like in Practice

In practice, when a panel disagrees, the productive move is to convene and interrogate the disagreement: what did each interviewer observe, how relevant and well-grounded is it, and what does the pattern reveal about the candidate’s real strengths and risks. Feedback is weighted by relevance, rigor, and insight rather than seniority or volume, and structured evaluation against defined criteria keeps the discussion on evidence. The disagreement, understood rather than averaged, produces a richer and more accurate picture than false consensus would.

The Mistake Employers Keep Making

The mistake is resolving panel disagreement by averaging the opinions or deferring to the most senior or loudest voice, both of which discard the information the disagreement contains and substitute a poor decision rule for genuine reasoning. Employers who average away real signal, or let authority override insight, make muddled decisions that a careful reading of the disagreement would have improved. The fix is to understand why the panel disagrees and weight feedback by its quality.

The Bottom Line

Panel disagreement is information about the candidate’s real strengths and risks, not noise to average away, and weighting feedback by relevance, rigor, and insight, within a structured evaluation, turns disagreement into a richer and more accurate decision. The difference between employers who get this right and those who don’t is rarely resources; it is discipline, clarity, and the willingness to act on what they already know.

For employers going deeper, see Decision Hygiene for Hiring Committees, The Halo Effect in Executive Hiring, What Is a Hiring Scorecard.

Frequently Asked Questions

Q: How should you handle interview panel disagreement?
A: Understand why interviewers disagree rather than averaging opinions or deferring to the loudest voice, since disagreement often reveals real strengths and risks.
Q: Why is averaging panel feedback a mistake?
A: Because it discards the information the disagreement contains; a candidate who impressed some and worried others is not mediocre but complex.
Q: How should you weight interview feedback?
A: By relevance, rigor, and the interviewer’s genuine insight into what matters for the role, not by seniority or volume of opinion.
Q: What does panel disagreement usually mean?
A: That capable interviewers saw different real things, one a strength, another a risk, which together map the candidate more richly than consensus.
Q: How does structure help with disagreement?
A: Structured evaluation against defined criteria makes disagreements specific and evidence-based, turning clashing opinions into a productive mapping of the candidate.

Tanya Gallardo

Managing Director, Executive Search & AI Talent Strategy

Tanya Gallardo is the Managing Director of Executive Search & AI Talent Strategy at JRG Partners, leading C-suite and Board engagements across key growth sectors including Technology, Financial Services, and Manufacturing.

With over 18 years of experience specializing in disruptive technology leadership, Tanya is recognized as a leading authority on talent architecture for future-focused executive roles, such as the Chief AI Officer (CAIO) and Chief Digital Officer (CDO). Her expertise lies in accurately assessing the cultural fit and technical depth required to ensure a high return on investment (ROI) for critical leadership appointments.

Prior to her role at JRG Partners, Tanya held senior roles directing global talent acquisition strategies at a major publicly-traded technology firm, advising on organizational design and succession planning for emerging executive functions. She is a recognized speaker and contributor to industry events, sharing data-driven insights on executive compensation, leadership development, and the measurable business impact of C-suite talent.

Connect with Tanya to discuss your executive search needs.

Leave a Reply

Your email address will not be published. Required fields are marked *