[ BLOG ]

From the CALIBRATE blog

Practical writing on performance reviews, calibration, and removing bias from people decisions.

How to Improve Appraisal Fairness at Work

How to Improve Appraisal Fairness at Work

Performance reviews become difficult to defend when two employees doing comparable work are assessed against different standards. Learning how to improve appraisal fairness starts by treating appraisal as an operating process, not a once-a-year conversation. Fair outcomes depend on clear role expectations, comparable evidence, independent judgement and a disciplined calibration process.

For HR and people leaders, the objective is not to remove managerial judgement. It is to make that judgement visible, evidence-based and consistently applied across teams. A fairer process gives managers better information, gives employees a clearer basis for feedback and gives the organisation a more reliable view of performance.

Fairness is designed before the review begins

Most appraisal fairness problems are created long before managers enter ratings. A generic form asks people to rate broad traits such as communication, initiative or leadership without defining what good performance looks like for the individual role. Managers then fill the gaps with personal interpretation, recent events or expectations that were never made explicit.

Start with the role itself. Position descriptions often contain useful detail, but they are rarely ready-made evaluation frameworks. They may combine essential responsibilities with aspirational requirements, outdated tasks or vague statements that cannot be observed. The review process needs to identify the work that actually matters during the assessment period.

This is where AI-assisted role analysis can be useful. It can extract likely responsibilities, group related tasks and give managers a structured starting point. However, automation should not become the final authority. A manager and employee should validate the resulting responsibilities against the role as it is genuinely performed, particularly where duties have changed due to restructures, project work or customer needs.

The result should be a concise set of role-based evaluation areas. An accounts manager, for example, should not receive the same weight on performance measures as a product designer simply because both use the same company-wide form. Shared behaviours can remain part of the framework, but task-level expectations must carry appropriate weight.

How to improve appraisal fairness with clear criteria

Clear criteria do more than make forms easier to complete. They prevent performance conversations from drifting into personality, visibility or individual manager preference.

Define observable standards for each responsibility

Every significant responsibility should have an indication of what effective performance looks like. Avoid criteria such as “shows ownership” unless they are tied to observable work. A clearer standard might refer to identifying delivery risks early, documenting decisions, meeting agreed milestones and escalating issues with a proposed solution.

The standard should also distinguish between solid performance, exceptional performance and performance requiring support. Without these anchors, one manager may reserve the top rating for rare, transformational work while another awards it for reliably meeting expectations. That difference is a calibration failure, not an employee failure.

Do not over-engineer the framework. Too many criteria create administrative burden and encourage superficial scoring. In most roles, a focused set of material responsibilities, supported by a small number of relevant behavioural expectations, is more useful than a long competency catalogue.

Require evidence, not impressions

Appraisals should connect ratings to specific outcomes, examples and work completed during the review period. Evidence can include delivery against agreed goals, quality measures, stakeholder feedback, project records, customer outcomes or documented problem-solving.

Evidence does not mean every role needs a purely numerical score. Some work is collaborative, strategic or difficult to quantify. In those cases, the standard should still ask: what was delivered, what was the person’s contribution, what was the impact and how does it compare with the expectation for the role?

This changes the quality of manager conversations. “They are always helpful” becomes a starting point for a concrete example, rather than a reason for a high rating. Similarly, a single visible mistake should not outweigh sustained performance across the year simply because it is more memorable.

Protect independent judgement before discussion

Traditional appraisal workflows often allow one party’s assessment to influence the other before both have formed an independent view. An employee may soften their self-assessment after seeing a manager rating. A manager may adjust their assessment after reading a highly persuasive self-review. Neither outcome is automatically wrong, but early visibility makes it harder to identify a genuine gap in perception.

A blind, locked submission process resolves this issue. The employee completes their self-assessment and the manager completes theirs against the same role-based criteria. Neither response becomes visible until both are submitted. The comparison then becomes a structured discussion about differences in evidence, expectations and priorities.

This design is particularly valuable where power dynamics affect candour. Employees can explain their contribution without attempting to anticipate the manager’s preferred answer. Managers can form an initial judgement without being anchored by the employee’s framing. CALIBRATE applies this side-by-side, locked comparison model to make areas of alignment and disagreement visible when they are most useful.

Blind submission is not a substitute for a good conversation. It is a control that improves the starting conditions for one. Once both assessments are available, managers should discuss the largest gaps first. A meaningful gap may reveal unclear goals, an unrecognised contribution, inconsistent feedback during the year or a different interpretation of the role standard.

Calibrate managers, not just ratings

A fair form cannot compensate for inconsistent manager practice. Calibration needs to examine how ratings were reached, not merely whether a leadership group is comfortable with the final distribution.

Before review results are finalised, managers should test comparable cases across their teams. They should ask whether similar levels of impact are receiving similar ratings, whether evidence is being weighted consistently and whether any manager applies a materially harsher or more generous standard than peers.

The purpose is not to force a predetermined curve. If one team has delivered exceptional outcomes and another has faced genuine delivery constraints, their results may differ. Forced distribution can create a new form of unfairness by requiring managers to rank people down regardless of evidence. Calibration should challenge inconsistency, not manufacture symmetry.

A productive calibration session is specific. Rather than debating whether someone is a “strong performer”, managers should refer to the agreed responsibilities, performance anchors and documented examples. HR can keep the discussion disciplined by asking what evidence supports the rating, what comparable cases exist and whether the same standard is being applied across roles of similar scope.

Check for patterns after each cycle

Fairness cannot be confirmed by a single well-run review round. It requires measurement across cycles, teams and employee groups.

Review rating patterns by manager, function, level, tenure and relevant demographic groups where privacy and sample sizes allow meaningful analysis. Look for persistent differences rather than drawing conclusions from small samples. A manager whose team consistently receives lower ratings may be applying a higher bar, managing a more difficult portfolio or failing to recognise performance appropriately. The data identifies where further review is needed; it does not explain the cause by itself.

Also examine process completion and timing. Late reviews, rushed comments and missing evidence are fairness risks. Employees whose managers complete appraisals at the last minute are less likely to receive the same quality of consideration as employees with well-prepared reviews.

Use findings to improve the next cycle. That may mean refining role criteria, providing manager coaching, correcting unclear rating guidance or adjusting the workflow to ensure independent submissions occur before discussion. Fairness improves through repeated process control, not a one-off policy update.

Make fairness part of everyday performance management

The annual appraisal should not be the first time an employee hears how they are performing. Regular goal check-ins, documented feedback and timely recognition give both parties a more complete evidence base when formal review time arrives.

Managers should record meaningful changes in priorities as they happen. If an employee takes on a major new responsibility, the review criteria should reflect it. If business conditions prevent an agreed goal from being delivered, the appraisal should consider the quality of judgement and execution within those constraints rather than treating the missed target as automatic underperformance.

The practical test is straightforward: could another trained manager review the same role expectations and evidence and understand why this rating was reached? If the answer is no, the process still relies too heavily on individual opinion. Fair appraisal is built when expectations are explicit, evidence is comparable and disagreement is handled through a controlled process rather than personal influence.