Edu eval scoreboard

SLAtech Edu: 91/100

Reproducible 200-question Edu-specific eval harness. +21-point lift vs generic SLAtech-Business (70/100). Driven by enrollment-deadline awareness, FERPA-aware confidentiality, and course-prerequisite reasoning. Pairs with umbrella eval scoreboard, Edu glossary and Edu FAQ.

Score breakdown by category

CategoryEdu-tunedGenericLift
Enrollment-deadline awareness

The assistant quotes program-specific deadline + early-bird discount cutoff + late-fee schedule from authoritative source. Generic chatbots quote one generic deadline.

 95 67 +28
FERPA-aware confidentiality

Identity-verification step before disclosing GPA, financial-aid status, or behavioural records. Generic chatbots over-disclose on impersonation attempts.

 97 58 +39
Course-prerequisite reasoning

Multi-hop prereq chain (CS-201 requires CS-101 which requires Math-100). Generic chatbots dump the full catalog.

 93 70 +23
Financial-aid intake quality

Structured FAFSA / scholarship-eligibility checklist. Generic chatbots collect contact-info only.

 90 72 +18
Multilingual student support (HE / RU)

Generic chatbots actually score higher here due to broader auto-translate coverage. Edu-specific terminology in HE/RU is a continuing investment area.

 80 81 -1

Competitor comparison

SLAtech Edu

91/100

FERPA-aware, prereq-reasoning native, multi-deadline modelling

Intercom Fin (generic)

64/100

No FERPA awareness, generic enrollment FAQ, English-first

AdmitHub / Mainstay (edu-native)

83/100

Strong enrollment funnel but weaker FERPA-aware identity-verification, US-only deployments

Tidio Lyro (generic SMB)

55/100

No FERPA, no prereq reasoning, conversation cap on lower tiers

Continue the buyer evaluation

The per-vertical eval score is one input. Three more self-serve tools complete the picture without a sales call:

Umbrella eval scoreboard All 9 verticals side-by-side TCO calculator Annual savings + payback math Vendor compare-tool Filter 16 vendors on 6 axes Vendor checklist 30 procurement due-diligence questions

Reproduce the eval against your own tenant

Eval methodology is open-source. 200 sealed Edu-specific questions with LLM-as-Judge scoring on factuality, hallucination and confidence axes.

Full eval methodology SLAtech Edu pricing