TutorBench: A Benchmark To Assess Tutoring Capabilities Of Large Language Models Article Swipe

MAKE IMPACT

Rakshith Sharma Srinivasa , Zora Che , Chuck Zhang , Diego Mares , Ernesto Hernández , J. Park , Deokjung Lee , Guillermo Mangialardi , Charmaine Ng , Ed-Yeremai Hernandez Cardona , Anisha Gunjal , Yunzhong He , Liwen Liu , Chen Xing · YOU? · · 2025 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2510.02663

As students increasingly adopt large language models (LLMs) as learning aids, it is crucial to build models that are adept at handling the nuances of tutoring: they need to identify the core needs of students, be adaptive, provide personalized guidance, and be accurate. To this end, we introduce TutorBench, a dataset and evaluation benchmark designed to rigorously evaluate the core tutoring skills of LLMs. The dataset comprises 1,490 samples curated by human experts, focused on high-school and AP-level curricula. The samples are drawn from three common tutoring tasks: (i) generating adaptive explanations tailored to a student's confusion, (ii) providing actionable feedback on a student's work, and (iii) promoting active learning through effective hint generation. To account for the inherent complexity of tutoring, samples are accompanied by sample-specific rubrics which are used to judge model responses during evaluation. TutorBench uses a reliable and fine-grained automatic evaluation method that uses an LLM-judge and the sample-specific rubrics. We evaluate 16 frontier LLMs on TutorBench and present a detailed analysis of their performance and behavior. Our results show that none of the frontier LLMs achieve a score of greater than $56\%$, showing a large room for improvement. We find that LLMs fall short in exhibiting the full range of tutoring skills needed to guide, diagnose, and support students effectively, with all the frontier models achieving less than a $60\%$ pass rate on rubric criteria related to these skills. We also find that different model families exhibit varied strengths and limitations: the Claude models outperform others in supporting active learning, while they lag behind in the other two use cases. By releasing TutorBench, we provide a comprehensive and unsaturated benchmark to guide the development of the next-generation of AI tutors.

Type

preprint

Language

en

Landing Page

http://arxiv.org/abs/2510.02663

PDF

https://arxiv.org/pdf/2510.02663

OA Status

green

OpenAlex ID

https://openalex.org/W4415981784

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4415981784

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.2510.02663

Digital Object Identifier

Title

TutorBench: A Benchmark To Assess Tutoring Capabilities Of Large Language Models

Work title

Type

preprint

OpenAlex work type

Language

en

Primary language

Publication year

2025

Year of publication

Publication date

2025-10-03

Full publication date if available

Authors

Rakshith Sharma Srinivasa, Zora Che, Chuck Zhang, Diego Mares, Ernesto Hernández, J. Park, Deokjung Lee, Guillermo Mangialardi, Charmaine Ng, Ed-Yeremai Hernandez Cardona, Anisha Gunjal, Yunzhong He, Liwen Liu, Chen Xing

List of authors in order

Landing page

https://arxiv.org/abs/2510.02663

Publisher landing page

PDF URL

https://arxiv.org/pdf/2510.02663

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/2510.02663

Direct OA link when available

Cited by

0

Total citation count in OpenAlex

Full payload