[ BLOG ]

From the CALIBRATE blog

Practical writing on performance reviews, calibration, and removing bias from people decisions.

How to Structure Role Based Reviews Fairly

How to Structure Role Based Reviews Fairly

A review becomes difficult to defend when two people in comparable roles are assessed against different, unstated standards. One manager rewards visibility. Another rewards speed. A third focuses on a single recent outcome. Knowing how to structure role based reviews gives HR and managers a common evidence base, so performance conversations are tied to the work the role actually requires.

The goal is not to make every review identical. Different roles need different measures. The objective is to make the assessment logic consistent: define the responsibilities, identify observable evidence, collect independent perspectives, and calibrate decisions against agreed criteria.

Start with the role, not the employee

Most review processes begin with a generic competency form. Employees are rated on broad labels such as communication, ownership or leadership, regardless of whether those labels are central to the position. This creates two problems. The employee may be judged on work outside their remit, and managers must interpret vague criteria in their own way.

A role based review starts with a current position description and turns it into an assessment framework. Break the role into its material responsibilities, recurring tasks, decision rights and expected outcomes. For a payroll specialist, that might include accurate pay runs, exception management, legislative compliance and stakeholder response times. For a sales manager, it may include pipeline discipline, coaching quality, forecast accuracy and team attainment.

Do not treat the position description as settled fact. Many descriptions are outdated or written at too high a level to support assessment. Validate the responsibilities with the role holder and manager before the cycle begins. If the role has changed materially, update the framework first. Reviewing somebody against an obsolete job description is not calibration.

Separate responsibilities from behaviours

Responsibilities describe what the person is accountable for. Behaviours describe how they carry out that work. Both matter, but they should not be blended into one ambiguous rating.

For example, a customer success manager may be accountable for renewal execution and account risk management. Their behaviours may include clear communication, sound judgement and productive collaboration. Assessing these separately prevents a positive impression of someone’s style from masking missed deliverables, or a difficult period of delivery from obscuring consistently strong professional conduct.

How to structure role based reviews around evidence

Once responsibilities are defined, convert each one into reviewable criteria. Each criterion should answer three questions: what outcome is expected, what evidence can demonstrate it, and what does effective performance look like at this level?

Avoid criteria such as “drives results” unless the role framework explains what results mean. A stronger criterion is: “Maintains an accurate project delivery plan, identifies delivery risks early, and escalates blockers with a proposed response.” It gives both the employee and manager a specific basis for assessment.

Use a manageable number of criteria. Too few creates a vague, impression-led review. Too many turns the process into an administrative exercise and encourages superficial scoring. For most roles, five to eight responsibility areas is enough, with supporting prompts where complexity requires it.

Ratings should have defined anchors. If a five-point scale is used, managers need shared language for what distinguishes dependable performance from exceptional performance or performance requiring support. The scale should describe contribution against role expectations, not personality or tenure. A long-serving employee is not automatically operating above expectations, and a newer employee should not be penalised for being less familiar if they are meeting the agreed standard for their stage in the role.

Evidence should be proportionate to the role. Quantitative roles may rely on quality, volume, timeliness and commercial outcomes. Knowledge work may require examples of decisions, stakeholder feedback, delivery records or documented improvements. Do not force every role into the same metric model. The discipline lies in defining credible evidence before ratings are discussed.

Collect self and manager assessments independently

Employees often have context their manager does not see: process failures prevented, complex stakeholder issues resolved, work that was deprioritised for valid reasons, or development activity that improved future capability. A structured self-assessment captures that context, but it should not become an open-ended case for promotion.

Ask employees to assess each responsibility against the same criteria their manager will use. Require a concise evidence statement for ratings that are materially above or below expectations. This creates a comparable record and makes the discussion more useful than a retrospective debate over isolated examples.

Manager assessments should follow the same structure. The manager’s role is to assess contribution against the position requirements, explain the evidence behind their judgement, and identify priorities for the next period. They should not see the employee’s completed responses before submitting their own assessment.

Blind submission controls matter because early visibility changes judgement. A manager who reads a confident self-rating may unconsciously anchor their own assessment around it. An employee who knows a manager’s view before responding may soften, mirror or contest it rather than provide an independent account. Locking both assessments until submission preserves the value of comparison.

CALIBRATE applies this logic through blind, side-by-side assessments, allowing managers to identify gaps in judgement without allowing either party’s initial view to steer the other.

Use differences as discussion points, not automatic disputes

A gap between self and manager ratings is useful information. It can indicate unclear expectations, incomplete visibility, inconsistent standards or a genuine difference in performance interpretation. It should trigger a focused conversation, not a contest over who selected the correct number.

Review the largest gaps first. Ask what evidence each person used, whether the responsibility was understood consistently, and whether the rating anchors were applied correctly. In some cases, the manager will gain information that changes the assessment. In others, the employee will see that their effort did not produce the expected role outcome. Both are more productive than a generic statement that the two parties “need to align”.

Keep the conversation anchored to the review period. Recent events carry disproportionate weight when managers rely on memory, particularly in busy teams. A structured record of evidence across the cycle reduces recency bias and helps distinguish a one-off issue from a sustained pattern.

Calibrate across managers before finalising outcomes

Role based structure improves individual reviews, but fairness also depends on consistency between managers. Two leaders may use the same form and still rate differently. One may reserve high ratings for rare cases, while another treats them as a motivational tool. Without calibration, comparable contribution can lead to different outcomes.

Calibration sessions should examine rating distributions, supporting evidence and interpretations of role expectations. The aim is not to force a predetermined distribution. Forced ranking can create its own distortions, especially in small or high-performing teams. Instead, test whether similar evidence is producing similar judgements.

Focus the discussion on outliers: unusually high or low ratings, significant self-manager gaps, and roles where managers have applied criteria differently. HR can identify patterns across departments, while leaders provide the operational context needed to assess them. Record changes and the rationale for them. A calibration decision that cannot be explained later is difficult to defend.

Build development actions into the role framework

A review is incomplete if it only labels past performance. Each assessment should result in a small number of forward actions tied to role requirements. These might include improving a core task, taking ownership of a broader responsibility, building capability for the next level, or addressing a specific performance risk.

Be precise about what changes next. “Improve stakeholder management” is too broad to manage. “Provide a fortnightly risk update to project sponsors and document agreed decisions within two business days” is observable and reviewable. The action should name the expected behaviour or output, the support available, and the point at which progress will be checked.

Not every gap calls for training. A performance issue may be caused by unclear priorities, missing authority, unrealistic workload or weak process design. Role based reviews help expose these system issues because they distinguish between expectations and the conditions required to meet them.

Keep the process operational between review cycles

Annual reviews alone are too infrequent for many roles. Expectations shift, projects change and evidence fades. The formal assessment may remain annual or half-yearly, but managers should use the same role framework in regular check-ins to discuss progress, changing priorities and emerging barriers.

This does not require a full review every month. It requires a stable reference point. When role responsibilities, evidence expectations and rating definitions remain visible throughout the year, the formal review is a considered assessment rather than a reconstruction exercise.

The strongest role based review processes make fairness practical. They define the work, collect independent evidence, expose differences in judgement and turn calibrated decisions into clear next actions. That gives employees a review they can understand and gives leaders a performance record they can stand behind.