Vendors run quarterly business reviews because an unstructured review is one they control: roadmap demos, relationship talk, and a polished story that routes attention away from missed SLAs, shelfware and above-market unit cost. Your own scorecard does the opposite. It fixes the agenda on evidence you collected, scores it against the contract and the benchmark, and produces a number you can carry into the renewal. This article sits under our ITSM procurement playbook from requirements to signature.
What should an ITSM vendor scorecard measure?
Five categories cover what actually decides whether a vendor earns the next renewal. Each is scored against evidence, not impression, and weighted to your priorities so the total reflects what matters to your organisation rather than what the vendor wants emphasised.
| Category | What to measure | Suggested weight |
|---|---|---|
| SLA & support | Uptime, response and resolution against contract; credits owed | 25% |
| Cost & unit price | Per-seat and per-module cost versus benchmark; uplift applied | 25% |
| Adoption & shelfware | Active vs licensed seats; modules live vs paid for | 20% |
| Roadmap delivery | Features promised at last renewal versus shipped | 15% |
| Commercial conduct | Uplift discipline, audit behaviour, billing accuracy | 15% |
Adjust the weights to your situation, but keep cost and shelfware heavy, because those are the categories the vendor most wants you to overlook and the ones that fund your renewal ask.
Book a contract negotiation review →Why do vendors prefer reviews without a scorecard?
Because a scorecard removes their two best tools: reframing and selective memory. Without one, a vendor review opens with a roadmap they intend to ship and closes with a partnership message, and the SLA misses and the shelfware never make the slide deck. With a weighted scorecard, the missed credits, the above-benchmark unit cost and the modules nobody turned on are on the table as scored line items the vendor has to answer. The shelfware measurement in particular is the one buyers most often skip; the method is in our guide to running an ITSM license audit.
How do you score cost without guessing?
Score cost against an external benchmark, not against last year's invoice, because last year's invoice may already be above market. Compare your per-seat and per-module pricing to deals of the same shape and size, and score the gap. This is also where you catch the quiet uplift: a renewal that rose with a contractual escalator still scores poorly if the resulting unit price sits above benchmark. The discipline of scoring on total cost rather than headline list price is covered in how to score ITSM vendor proposals on total cost, not list price.
How to build the scorecard in six steps
- Set the categories and weights. Use the five above; tune the weights to your priorities.
- Pull the evidence. SLA logs, credit history, active-seat data, module usage, invoices.
- Benchmark the cost. Compare unit price to same-size deals; score the gap.
- Score each line one to five. Against evidence and contract, never impression.
- Weight and total. Produce a single score and a short written rationale per category.
- Trend and act. Compare to prior years; feed the gaps straight into the renewal ask.
Run this every year and the scorecard becomes a time series, which is far harder for a vendor to dismiss than a single bad quarter. This mirrors the Map · Benchmark · Leverage · Close method we apply across every engagement; across 500-plus ITSM negotiations and more than $420M in contract value, the firm averages a 30% reduction, and a maintained scorecard is one of the cleanest sources of the evidence that gets there.
How does the scorecard feed the renewal?
A trended scorecard converts the renewal from opinion into record. Documented SLA misses justify service credits or a tighter SLA, measured shelfware justifies seat reductions, and above-benchmark unit cost justifies a price reset. The score is not a courtesy to the vendor; it is the evidence file that makes your renewal asks defensible before the quote even arrives.
Our gated 2026 ITSM negotiation benchmark report gives the unit-cost reference points you need to score the cost category against the market.
What to do next
Build the scorecard now, not the month before renewal, so you have a year of evidence rather than a snapshot. Set the categories, pull the data quarterly, benchmark the cost, and trend the total. When the renewal comes, the scorecard is your case. We run this end to end on fixed fee or gainshare through our contract negotiation service.
Frequently asked questions
- What should an ITSM vendor scorecard measure?
- Five categories: SLA and support, cost versus benchmark, adoption and shelfware, roadmap delivered versus promised, and commercial conduct. Weight them, score against evidence, and total a single number.
- Why do vendors prefer reviews without a scorecard?
- An unstructured review lets them steer to roadmap and relationship and away from missed SLAs, shelfware and above-market cost. A weighted scorecard fixes the agenda on evidence.
- How does a scorecard help at renewal?
- Trended over the term it turns the renewal into record: SLA misses justify credits, shelfware justifies seat cuts, and above-benchmark cost justifies a reset.
Book a contract negotiation review.
We turn a year of scorecard evidence into a renewal case the vendor cannot reframe. Fixed fee or gainshare.
Book a contract negotiation review →