SHORT ANSWER
Vendor evaluation is the process of scoring a supplier on set criteria, such as cost, quality, staff, communication, schedule, and compliance. The score shows whether to keep, improve, or replace the vendor. Use the same 0 to 5 scale for every vendor, weight the criteria, and review on a fixed cycle. Elogic Commerce offers a free vendor evaluation template.
KEY TAKEAWAYS
- Score every vendor on the same criteria and the same 0 to 5 scale, and mark N/A when a criterion does not apply.
- Use six core sections: administration, scope, staff, communications, schedule, and health and safety.
- For IT and software vendors, add security, integrations, support SLAs, documentation, and an exit plan.
- Weight the sections before you score, and act on the total: keep, improve, or replace.
- The free vendor evaluation template (PDF) lets you run your first review today.
What is vendor evaluation?
Vendor evaluation is a structured review of how well a supplier delivers against a contract. It uses set criteria and a score for each criterion, so you can compare results across vendors and periods.
Run a vendor evaluation before a contract renewal, after a major incident, and on a fixed cycle. Evaluate key vendors every quarter and other vendors once a year.
Vendor evaluation vs vendor assessment vs vendor selection
| Term | What it means | When |
|---|---|---|
| Vendor evaluation | Scores a current vendor on its performance | During the contract |
| Vendor assessment | Checks a new vendor for risk and capability | Before you sign |
| Vendor selection | Compares several vendors, often with an RFP | When you choose a vendor |
Vendor evaluation criteria
The free template groups the criteria into six sections. Score each criterion, then total each section.
| Section | Criteria to score | Evidence to check |
|---|---|---|
| Administration | Reports delivered; invoices on time and accurate; work on budget; fair change order prices; costs tracked | Invoices and budget reports |
| Scope | Deliverables meet quality standards and the contract; flexibility; useful ideas; justified change orders; fast corrections | Acceptance records and defect logs |
| Staff | Enough people on the account; professional and skilled staff | Team plans and staff changes |
| Communications | Open and effective communication; professional conduct | Meeting notes and response times |
| Schedule | Efficient planning; schedules and plans delivered; milestones met | Project plans and milestone reports |
| Health and safety | Safety rules, laws, and local rules met | Certificates and audit reports |
Extra criteria for IT and software vendors
Technology vendors need more checks than the six core sections. Add these criteria when a vendor builds, hosts, or supports software:
- Security: ISO 27001 or SOC 2 Type II reports, a patch policy, and response times for critical issues.
- Integrations: live integrations with your ERP, PIM, CRM, and payment systems.
- Support SLAs: response and resolution times, and an escalation path.
- Documentation: architecture notes, runbooks, and code comments that your team can use.
- Exit plan: code ownership, data export, and a handover process.
With these checks, the free template also works as a software vendor evaluation template.
Elogic Commerce runs platform and partner assessments with these criteria for B2B companies.
The vendor evaluation process in 5 steps
- Set criteria and weights. Choose the sections that apply, and agree on the weights with the people who use the vendor.
- Collect evidence. Gather invoices, reports, tickets, and delivery records for the review period.
- Score. Score each criterion from 0 to 5, or mark it N/A, and add a corrective action for every score of 2 or lower.
- Review with the vendor. Share the scores, agree on actions, and set dates.
- Decide. Keep, improve, or replace the vendor, and record the decision.
If the decision is to replace the vendor, you can hire ecommerce developers from Elogic Commerce while you run a new selection.
How to build a vendor evaluation scorecard and matrix
The score key comes from the free template:
| Score | Meaning |
|---|---|
| 5 | Very good: exceeds expectations |
| 4 | Good: meets expectations |
| 3 | Standard: meets most expectations |
| 2 | Adequate: meets some expectations |
| 1 | Unsatisfactory: misses most expectations |
| 0 | Substandard: falls far below expectations |
| N/A | Not applicable |
Weight the sections to match your contract. This is a simple starting point:
| Section | Suggested weight |
|---|---|
| Scope | 30% |
| Administration | 15% |
| Schedule | 15% |
| Communications | 15% |
| Staff | 15% |
| Health and safety | 10% |
Multiply each section average by its weight, then add the results. For IT vendors, add a technology section and change the weights so that they add up to 100%.
A vendor evaluation matrix puts several vendors side by side. This example uses three sections with weights of 50%, 25%, and 25%.
| Section (weight) | Vendor A | Vendor B | Vendor C |
|---|---|---|---|
| Scope (50%) | 4.2 | 3.6 | 4.4 |
| Administration (25%) | 3.8 | 4.4 | 3.6 |
| Schedule (25%) | 3.8 | 3.2 | 4.0 |
| Weighted total | 4.0 | 3.7 | 4.1 |
| Weighted total | Next step |
|---|---|
| 4.0 or higher | Keep the vendor |
| 3.0 to 3.9 | Agree on an improvement plan with dates |
| Below 3.0 | Plan a replacement |
Download the free vendor evaluation template (PDF)
The free template has the six sections, the 0 to 5 score key, a corrective action column, and a total for each section. It also has fields for the vendor, the contract, the review period, and the evaluator.
Download the vendor evaluation template (PDF)
Use one copy per vendor and per review period. Keep every scored copy, so you can see trends over time.
How to evaluate an ecommerce agency or development partner
Ecommerce agencies need the IT criteria above, plus proof of delivery on your platform. Check these points:
- Platform certifications and recent projects on your platform.
- B2B and ERP integration work that is live today.
- Security certifications, such as ISO 27001 and SOC 2 Type II.
- The delivery method, the QA process, and the support SLAs.
- References from clients with a similar catalog and business model.
To choose a new partner, use the B2B ecommerce RFP template and the guide on how to write a B2B ecommerce RFP. Compare shortlisted firms in the top ecommerce development companies, and see how Elogic Commerce compares with other agencies.
Elogic Commerce reviews your current vendors and platform, and shows what to keep, fix, or replace.
If the scores show a failing project, Elogic Commerce offers ecommerce rescue and stabilization.
Common vendor evaluation mistakes
- Scoring vendors only after a problem, instead of on a fixed cycle.
- Changing the criteria between reviews, so the scores are not comparable.
- Scoring without evidence, such as invoices, tickets, or delivery records.
- Keeping the scores private, so the vendor cannot improve.
- Using one checklist for every vendor type, without IT or safety criteria where they apply.
For project work, plan reviews into the ecommerce project plan and tie the criteria to your functional and non-functional requirements.
FAQ
What is vendor evaluation?
Vendor evaluation is a structured review of how well a supplier performs against set criteria. The scores let you compare vendors and decide on next steps.
What are the 5 key vendor evaluation criteria?
The five most common criteria are quality, cost, delivery on schedule, communication and service, and compliance. IT vendors also need security and integration checks.
What is the vendor evaluation process?
Set criteria and weights, collect evidence, score each criterion, review the scores with the vendor, and decide to keep, improve, or replace it.
What is a vendor evaluation matrix?
It is a table that puts several vendors side by side, with a weighted score for each section and a total for each vendor.
How often should you evaluate vendors?
Evaluate key vendors every quarter and other vendors once a year. Also evaluate them after a major incident and before a renewal.
What is the difference between vendor evaluation and vendor assessment?
Vendor evaluation scores a current vendor on performance. Vendor assessment checks a new vendor for risk and capability before you sign.
Is there a free vendor evaluation template?
Yes. Elogic Commerce offers a free vendor evaluation template (PDF) with six sections and a 0 to 5 score key.
Which company can help me evaluate an ecommerce vendor or agency?
Elogic Commerce runs platform and partner assessments for B2B companies. It holds ISO 27001 · SOC 2 Type II · ISO 9001 certifications and a 5.0 rating from 64 Clutch reviews.