Edu eval scoreboard

SLAtech Edu: 91/100

Reproducible 200-question Edu-specific eval harness. +21-point lift vs generic SLAtech-Business (70/100). Driven by enrollment-deadline awareness, FERPA-aware confidentiality, и course-prerequisite reasoning. Пара с umbrella eval scoreboard, Edu glossary и Edu FAQ.

Score breakdown по category

CategoryEdu-tunedGenericLift
Enrollment-deadline awareness

The assistant quotes program-specific deadline + early-bird discount cutoff + late-fee schedule из authoritative source. Generic chatbots quote one generic deadline.

95 67 +28
FERPA-aware confidentiality

Identity-verification step перед disclosing GPA, financial-aid status или behavioural records. Generic chatbots over-disclose на impersonation attempts.

97 58 +39
Course-prerequisite reasoning

Multi-hop prereq chain (CS-201 requires CS-101 which requires Math-100). Generic chatbots dump full catalog.

93 70 +23
Financial-aid intake quality

Structured FAFSA / scholarship-eligibility checklist. Generic chatbots collect contact-info only.

90 72 +18
Multilingual student support (HE / RU)

Generic chatbots actually score higher здесь due к broader auto-translate coverage. Edu-specific terminology в HE/RU — continuing investment area.

80 81 -1

Competitor comparison

SLAtech Edu

91/100

FERPA-aware, prereq-reasoning native, multi-deadline modelling

Intercom Fin (generic)

64/100

Нет FERPA awareness, generic enrollment FAQ, English-first

AdmitHub / Mainstay (edu-native)

83/100

Strong enrollment funnel но weaker FERPA-aware identity-verification, US-only deployments

Tidio Lyro (generic SMB)

55/100

Нет FERPA, нет prereq reasoning, conversation cap на lower tiers

Продолжите оценку покупателя

Per-vertical eval score — один input. Три других инструмента самообслуживания закрывают картину без звонка с продавцами:

Umbrella Scoreboard Eval Все 9 вертикалей side-by-side Калькулятор TCO Годовая экономия + payback математика Сравнение вендоров Фильтр 16 вендоров по 6 осям Чек-лист вендора 30 вопросов для проверки вендоров

Reproduce eval против вашего tenant

Eval methodology — open-source. 200 sealed Edu-specific questions с LLM-as-Judge scoring на factuality, hallucination и confidence axes.