Supplier Scorecards and KPIs: A Field Checklist for Building a Measurement System That Works

Supplier scorecards measure supplier performance against agreed criteria and communicate the measurement back to the supplier in a structured way. Done well, they drive performance improvement, provide early warning of supply risk, and create the documented performance record that supports contract renewal, re-tendering, and dispute resolution decisions. Done poorly, they produce data nobody acts on and meetings nobody prepares for.

In 2022, with supply chain disruptions making supplier performance more variable and more consequential than in recent years, the quality of supplier measurement matters. Here is a checklist for building a scorecard that actually works.

Before Building the Scorecard

• Define what you want the scorecard to do. Scorecards serve different purposes: tracking compliance with contract requirements, identifying suppliers for development vs. exit decisions, managing risk on critical supply categories, or providing a basis for performance-based payment adjustments. A scorecard that tries to do all of these at once often does none of them well. Start by deciding which purpose is primary.

• Involve the supplier in scorecard design. Suppliers who had no input into the metrics they are measured by are less likely to accept the measurements as valid and less likely to use the scorecard as a tool for improvement. A bilateral design process produces better metrics and better buy-in.

• Limit the number of KPIs. A scorecard with 20 KPIs measures everything and manages nothing. Four to six KPIs covering the dimensions that most affect your supply risk and service level is a practical target.

The Scorecard Checklist

1. Include the four core dimensions: delivery, quality, responsiveness, and cost. Delivery: on-time and in-full performance. Quality: defect rate, return rate, or non-conformance rate. Responsiveness: response time to queries, issue resolution speed. Cost: price variance against contract or benchmark. These four cover the most common supply risk drivers.

2. Define each KPI with a measurement method, a data source, and a frequency. An on-time delivery KPI that different people calculate differently is not a KPI -- it is a source of argument. Write the formula, the data source, and the reporting frequency explicitly. If measurement requires data from the supplier, agree the data format and submission timeline before the scorecard goes live.

3. Set targets based on your actual requirements, not industry averages. A 95 percent on-time delivery target may be too low for a supplier providing critical surgical equipment and too high for a supplier providing office stationery. Set targets that reflect what your operation actually requires.

4. Include a red-amber-green (RAG) rating and a threshold for escalation. A numeric scorecard without a RAG rating requires the reviewer to interpret whether 94.2 percent is acceptable. Make the interpretation explicit: green means at or above target, amber means within X percentage points below target, red means below amber threshold. Define the response required at each level.

5. Review the scorecard with the supplier at a scheduled cadence. Monthly for critical or at-risk suppliers; quarterly for standard suppliers. The review should include the supplier's own explanation of performance trends and their proposed actions on any amber or red items.

6. Use the scorecard to drive action, not just to record history. Every red or amber item should have a corrective action and a target date. If your scorecard review meetings consistently end without agreed actions, the scorecard is not performing its function.

XNM helps public-sector and capital-project clients build supplier performance management frameworks. Reach out to XNM's procurement, sourcing & contract management team to discuss supplier scorecard design for your supply base.