Supplier Scoring Model: Quality, Lead Time, Price, and Risk Rating

What is Supplier Evaluation?

Calling a supplier “good” or “bad” is easy; measuring them is the hard part

In most companies, the opinion of a supplier forms on the shop floor: “that firm delivers,” “that warehouse always ships late.” These impressions are sometimes right, but they are a weak foundation for a decision. Then one day a critical shipment slips, production stops, and everyone realizes a problem no one ever put into numbers had actually been growing for months.

Supplier evaluation closes exactly that gap. In short, it means scoring the firms in your supply chain against defined criteria, regularly and consistently. It does two jobs at once: tracking the performance of the suppliers you already have, and grounding new-supplier decisions in data rather than gut feeling.

A well-built evaluation system pays you back in clear ways:

• You see risk early: Supply disruptions and quality problems send a signal before they blow up.
• You manage the real cost: You look at total cost of ownership (TCO), not the sticker price.
• You grow performance together: You and the supplier read the same scorecard and turn improvement into a shared goal.
• You decide with data: The numbers tell you where to put resources and how to balance the portfolio.

Supplier Evaluation vs. Supplier Audit

These two get confused constantly, yet they do different jobs:

• Evaluation: Continuous performance tracking — scorecards, KPIs, data flowing every month.
• Audit: Periodic on-site inspection — a deeper look at quality systems and processes.

One gives you the film, the other the photograph. Evaluation collects the data day to day; the audit opens up what sits beneath that data, on site. In a healthy system, the two feed each other.

The QCD Triangle: Quality-Cost-Delivery

Quality, cost, delivery: supplier performance is read along these three axes

The most widely used framework in supplier evaluation is the QCD triangle: Quality, Cost, Delivery. It looks like three words, but almost every problem you will ever have with a supplier lands on one of these three axes. That is why the skeleton of your scoring starts here too.

1. Quality

The quality dimension measures how well the product or service you receive meets the expectation. The indicators that actually earn their keep in the field:

• Defect rate (PPM): How many defective units per million parts.
• Return rate: What percentage of delivered batches comes back.
• First Pass Yield: How many units clear inspection on the first pass.
• Contribution to customer complaints: How much of what your own customer complains about traces back to this supplier.
• Certifications: Quality systems such as ISO 9001, IATF 16949, AS9100.

2. Cost

Reducing cost to unit price is one of the most expensive mistakes you can make. The right lens is total cost of ownership (TCO): the sum of everything the product costs you as it comes through the door and while it sits on the shelf:

• Unit price: The direct product cost.
• Freight and customs: The logistics cost of getting it to you.
• Quality costs: Inspection, testing, returns, and rework.
• Inventory cost: The safety stock you are forced to hold because of long lead times.
• Price stability: How exposed you are to sudden hikes and currency swings.

3. Delivery

Delivery performance is the ground production planning stands on; when the supplier slips, your whole schedule slips with it. What to track:

• On-Time Delivery (OTD): The share of shipments that arrive on the promised date.
• On-Time In-Full (OTIF): Right date and full quantity together.
• Lead time: The order-to-delivery duration.
• Lead time consistency: The gap between the promised and the actual duration. A short but erratic lead time is often worse than a long but predictable one.
• Flexibility: How fast they respond to an urgent order or a quantity change.

Risk Dimension and Strategic Importance

A supplier that runs well today is not the same as one that carries no risk for tomorrow

QCD tells you how a supplier performs today. But the lesson of recent years is blunt: a supplier that runs flawlessly today can leave you stranded tomorrow for an entirely different reason. The pandemic and geopolitical turmoil turned supply chain risk from a footnote into a headline. That is why modern evaluation models add a risk dimension to the score.

Risk Categories

1. Financial Risk

• The supplier’s financial health: liquidity, debt ratio.
• Probability of bankruptcy or a change of hands.
• Payment history and credit rating.

2. Operational Risk

• Production capacity and capacity utilization.
• Dependency on a single facility.
• Equipment age and maintenance status.
• Workforce stability and competence.

3. Geographic and Geopolitical Risk

• Natural disaster exposure: earthquake, flood, fire.
• Political instability.
• Trade restrictions and customs policy.
• The quality of logistics infrastructure.

4. Dependency Risk

• Reliance on a single source.
• The supplier’s dependency on you: how large your share of their revenue is.
• Difficulty of substitution and switching cost.

The Strategic Importance Matrix

You need to classify a supplier not only by performance but by how critical it is to you. Two suppliers with the same score can sit in very different places — one your strategic partner, the other a name you could swap out tomorrow:

• Strategic supplier: High volume, critical product, hard to replace. You build a long-term partnership.
• Leverage supplier: High volume, easy to replace. Price negotiation takes the lead.
• Bottleneck supplier: Low volume but hard to replace. Reducing risk comes first.
• Routine supplier: Low volume, easy to replace. Managed with the least effort.

How to Build a Scoring Model?

This is where theory ends and building begins. You can stand up an effective supplier scoring model in five steps:

Step 1: Define the Criteria

Criteria shift with the industry and the company’s priorities; defense manufacturing leans on quality weight, fast-moving goods lean on delivery. A balanced starting frame:

• Quality: 25-35% weight
• Delivery: 20-30% weight
• Cost: 15-25% weight
• Risk: 10-20% weight
• Innovation / collaboration: 5-15% weight

Step 2: Define the Scoring Scale

Commonly used scales:

• 1-5: For simple, quick evaluation.
• 1-10: When you need finer differentiation.
• 1-100: For detailed analysis.

Step 3: Identify Data Sources

For each criterion, settle one question: where will this data come from, how often, and who owns it?

• ERP: order, delivery, invoice data.
• Quality module: incoming inspection, defect reports.
• Supplier portal: self-service data entry.
• Field audits: audit reports.
• Market data: financial health reports.

Step 4: Create the Calculation Formula

An example calculation (out of 100):

Total Score = (Quality × 0.30) + (Delivery × 0.25) + (Cost × 0.20) + (Risk × 0.15) + (Collaboration × 0.10)

Step 5: Define Classification Thresholds

• Class A (85-100): Preferred, strategic partner.
• Class B (70-84): Acceptable, under monitoring.
• Class C (50-69): Improvement required, action plan.
• Class D (0-49): Risky; look for alternatives or end the relationship.

Field Example: Manufacturing Firm Case

Real Case (Brand-Neutral)

Situation

An automotive sub-industry firm with 180 employees. 65 active suppliers, high annual supply volume. Tracking runs in Excel, evaluation happens once a year and by eye. The result: supplier-caused production stoppages have become routine within the month, and no one can say exactly which supplier is costing how much.

Steps Taken

1. Month 1: Suppliers were sorted with ABC: 12 as Class A (critical), 23 as Class B, 30 as Class C.
2. Month 2: A detailed scorecard was built for Class A: 5 main criteria, 15 sub-criteria, weighting.
3. Month 3: Automatic data extraction from the ERP was set up; reports became monthly and automatic.
4. Month 4-6: Pilot run; improvement plans launched for the 3 most problematic critical suppliers.
5. Month 7-12: Full rollout, quarterly supplier meetings, categorization by performance.

Result (Representative)

• Supplier-caused production stoppages: down 45%.
• Average OTD (on-time delivery): up from 82% to 91%.
• Incoming inspection rejection rate: down from 3.2% to 1.8%.
• Relationships ended with 2 low-performing suppliers, alternatives brought in.
• Long-term framework agreements signed with 3 high-performing suppliers.

The 7 Most Common Supplier Evaluation Mistakes

1. Focusing Only on Price

Picking the cheapest supplier tends to push the total cost up through quality problems, delays, and hidden expenses. Make the decision on total cost of ownership (TCO).

2. Evaluating by Eye

Instead of impression lines like “they work well” or “they cause problems,” use scoring built on measurable metrics. A grade given without data measures who has the louder voice, not who is right.

3. Evaluating Only Once

A supplier looked at once a year will not warn you of its decline in time. Set monthly tracking for critical suppliers and at least quarterly for the rest.

4. Not Sharing Results with the Supplier

Scoring a supplier and filing it away files the chance to improve away with it. Transparent communication and shared goals move performance up.

5. Staying Tied to a Single Source

A single supplier for a critical product is a large risk. At the very least, identify a backup and finish the approval process in advance; starting the search during a crisis is already too late.

6. Ignoring the Risk Dimension

Even if performance is good today, financial health, geographic risk, or a capacity constraint can put tomorrow at risk. Fold risk into the score as well.

7. Measuring Without Acting

Scoring on its own changes nothing. Build an improvement plan for the low performer, follow up, and move to an alternative if you must. Measurement is a tool, not the goal.

A systematic approach protects you from most of these from the start

Success Metrics Table

You also need to measure whether the system you built is actually working. The metrics below give you a practical dashboard for that (values are representative):

Supplier Evaluation Checklist

Frequently Asked Questions