Check comparison completeness and recalculate scores

A comparison is only decision-ready when the team knows which evidence exists, which evidence is missing and whether the displayed scores reflect the latest submitted responses and configuration. Completeness checks prevent an unanswered area from being mistaken for poor performance.

Before you start

• Confirm the intended questionnaires were published and assigned to the right evaluators or vendors.

• Agree which streams, must-pass questions and response thresholds are required before the shortlist can move forward.

Step by step

1. Identify ranked and unscored vendors

Open Compare. A vendor needs at least one real score to enter the ranked comparison. Anyone listed under Awaiting evaluation is unscored, not a zero-score vendor and not automatically worse than the ranked field.

2. Open each stream detail

Compare scored questions with the total scorable questions for every vendor and stream. Trace gaps back to the form, respondent or workflow state rather than estimating an answer in the comparison.

3. Review must-pass and agreement

Check which must-pass conditions were met and open the respondent score range or agreement context. A complete average can still conceal a failed gate or material disagreement that needs facilitation.

4. Correct the source first

Return to the relevant questionnaire to obtain a missing submission, resolve an invalid answer or correct permitted scoring configuration. Do not use Recalculate as a way to turn an incomplete draft into submitted evidence.

5. Recalculate the submitted evidence

Choose Recalculate scores after configuration changes or when displayed results appear stale. The action recomputes from submitted questionnaires, can be run repeatedly and leaves genuinely missing evidence missing.

6. Record readiness before deciding

Refresh Compare and document any remaining gaps, failed must-pass items or reviewer disagreement. If the team proceeds with limitations, carry them into the finalist discussion and Decision Record instead of allowing them to disappear from the narrative.

What happens next

• Use Compare vendors to review capability, Business Voice, commercial, credit and AI-assisted lenses together.

• Open a vote or finalist review only after the accountable team accepts the stated evidence coverage.

Troubleshooting

Recalculate completes but a vendor remains unscored

Confirm a scorable response was actually submitted. Recalculation cannot score a draft, unanswered form or question type that has no score.

Scored-question totals differ between vendors

Open the underlying forms and assignments. Check conditional questions, not-applicable handling, missing responses and whether each vendor received the same released version.

Scores changed after recalculation

Review recent form scoring, project weights and submissions. Preserve the reason for a material change in the project history before using the refreshed comparison in governance.

Related guides