Supplier Scoring Model: Quality, Lead Time, Price, and Risk Rating

What is Supplier Evaluation?

Supplier evaluation systematically measures every link in the supply chain

Supplier evaluation (or Vendor Assessment) is a management process where firms systematically score vendors in their supply chain based on specific criteria. This process encompasses both monitoring the performance of existing suppliers and the selection of new ones.

The primary objectives of the evaluation process are:

• Risk mitigation: Proactively identifying supply disruptions and quality issues
• Cost optimization: Minimizing the total cost of ownership (TCO)
• Performance improvement: Ensuring continuous development through collaboration with suppliers
• Strategic decision-making: Data-driven resource allocation and supplier portfolio management

Supplier Evaluation vs. Supplier Audit

These two concepts are frequently confused:

• Supplier evaluation: Continuous performance tracking, scorecards, and KPIs
• Supplier audit: Periodic on-site inspections and quality system checks

Both processes complement each other. While evaluation collects continuous data, audits provide in-depth analysis.

The QCD Triangle: Quality-Cost-Delivery

The QCD triangle forms the fundamental framework for supplier performance

The most widely used framework in supplier evaluation is the QCD triangle: Quality, Cost, and Delivery. These three dimensions form the foundation of supplier performance.

1. Quality Metrics

The quality dimension measures the degree to which the supplied product or service meets expectations:

• Defect rate (PPM – Parts Per Million): Number of defective products per million parts
• Return rate: Percentage of delivered batches returned
• First Pass Yield: Ratio of products passing inspection on the first attempt
• Contribution to customer complaints: Customer complaints originating from the supplier
• Certifications: Quality systems such as ISO 9001, IATF 16949, or AS9100

2. Cost Metrics

Cost is not just the unit price. A total cost of ownership (TCO) approach should be used:

• Unit price: Direct product cost
• Freight and customs: Logistics costs
• Quality costs: Inspection, testing, and return processing
• Inventory cost: Safety stock held due to long lead times
• Price stability: Sensitivity to sudden price hikes or currency fluctuations

3. Delivery Metrics

Delivery performance is the basis of production planning:

• On-Time Delivery (OTD) rate: Percentage of deliveries made on the promised date
• On-Time In-Full (OTIF) rate: Both on time and in the full quantity
• Lead time: Order-to-delivery duration
• Lead time consistency: Deviation between the promised and actual duration
• Flexibility: Speed of response to urgent orders or quantity changes

Risk Dimension and Strategic Importance

Risk assessment is the key to supply chain resilience

In addition to QCD metrics, modern supplier evaluation models include the risk dimension. The pandemic and geopolitical developments have demonstrated how critical supply chain risks are.

Risk Categories

1. Financial Risk

• Supplier’s financial health (liquidity, debt ratio)
• Probability of bankruptcy or acquisition
• Payment history and credit rating

2. Operational Risk

• Production capacity and capacity utilization rate
• Single-facility dependency
• Equipment age and maintenance status
• Workforce stability and competence

3. Geographic and Geopolitical Risk

• Natural disaster risk (earthquake, flood, fire)
• Political instability
• Trade restrictions and customs policies
• Quality of logistics infrastructure

4. Dependency Risk

• Single-source dependency
• Supplier’s dependency on you (your share in their revenue)
• Difficulty of substitution and switching costs

Strategic Importance Matrix

Suppliers should be classified in terms of both performance and strategic importance:

• Strategic supplier: High volume, critical product, difficult to substitute. Long-term partnership.
• Leverage supplier: High volume, easy to substitute. Focused on price negotiation.
• Bottleneck supplier: Low volume, difficult to substitute. Priority on risk mitigation.
• Routine supplier: Low volume, easy to substitute. Minimum management effort.

How to Build a Scoring Model?

Follow these steps to build an effective supplier scoring model:

Step 1: Define the Criteria

Criteria may vary based on the industry and company priorities. The basic framework:

• Quality: 25-35% weight
• Delivery: 20-30% weight
• Cost: 15-25% weight
• Risk: 10-20% weight
• Innovation/Collaboration: 5-15% weight

Step 2: Define the Scoring Scale

Commonly used scales:

• 1-5 scale: For simple, quick evaluation
• 1-10 scale: For more precise differentiation
• 1-100 scale: For detailed analysis

Step 3: Identify Data Sources

Where will the data for each criterion come from?

• ERP system: Order, delivery, and invoice data
• Quality module: Incoming inspection, defect reports
• Supplier portal: Self-service data entry
• Field audits: Audit reports
• Market data: Financial health reports

Step 4: Create the Calculation Formula

Example calculation (out of 100):

Total Score = (Quality Score x 0.30) + (Delivery Score x 0.25) + (Cost Score x 0.20) + (Risk Score x 0.15) + (Collaboration Score x 0.10)

Step 5: Define Classification Thresholds

• Class A (85-100): Preferred, strategic partner
• Class B (70-84): Acceptable, under monitoring
• Class C (50-69): Improvement required, action plan
• Class D (0-49): Risky, search for alternatives or termination

Field Example: Manufacturing Firm Case

Real Case (Brand-Neutral)

Situation

An automotive sub-industry firm with 180 employees. 65 active suppliers, high annual supply volume. Current situation: Excel-based tracking, one general evaluation per year, numerous production stoppages caused by suppliers.

Steps Taken

1. Month 1: ABC classification of suppliers was performed. 12 suppliers were identified as Class A (critical), 23 as Class B, and 30 as Class C.
2. Month 2: A detailed scorecard was created for Class A suppliers. 5 main criteria, 15 sub-criteria, and weighting.
3. Month 3: Infrastructure for automatic data extraction from the ERP system was established. Monthly automatic report generation.
4. Month 4-6: Pilot implementation, improvement plans initiated for 3 critical suppliers.
5. Month 7-12: Full rollout, quarterly supplier meetings, performance-based categorization.

Result (Representative)

• Production stoppages caused by suppliers: 45% reduction
• Average OTD (on-time delivery): Increased from 82% to 91%
• Incoming inspection rejection rate: Dropped from 3.2% to 1.8%
• Business relationship terminated with 2 low-performing suppliers, alternatives activated
• Long-term framework agreements signed with 3 high-performing suppliers

7 Most Common Supplier Evaluation Mistakes

1. Focusing Only on Price

Choosing the lowest-priced supplier can increase the total cost due to quality issues, delays, and hidden costs. Adopt the TCO (total cost of ownership) approach.

2. Subjective Evaluation

Use scoring based on measurable metrics instead of emotional comments like “they work well” or “they cause problems.” Evaluating without collecting data is misleading.

3. Evaluating Only Once

An evaluation done once a year will not catch performance drops in time. Provide monthly tracking for critical suppliers and at least quarterly tracking for others.

4. Not Sharing Results with the Supplier

Not sharing the scorecard with the supplier misses the opportunity for improvement. Transparent communication and shared goals support performance growth.

5. Depending on a Single Source

Using a single supplier for critical products carries significant risk. At least identify a backup supplier and complete the approval process.

6. Ignoring the Risk Dimension

Even if performance is good, financial health, geographic risk, or capacity constraints may cause problems in the future. Include risk assessment in your scoring.

7. Measuring Without Taking Action

Scoring is not enough. Create improvement plans for low-performing suppliers, follow up, and seek alternatives if necessary. Measurement is a tool, not the goal.

A systematic approach is the key to avoiding mistakes

Success Metrics Table

Track the following metrics to measure the effectiveness of your supplier evaluation system (representative values):

Supplier Evaluation Checklist

Frequently Asked Questions (FAQ)