MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems? Article Swipe
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2403.14624
The remarkable progress of Multi-modal Large Language Models (MLLMs) has garnered unparalleled attention, due to their superior performance in visual contexts. However, their capabilities in visual math problem-solving remain insufficiently evaluated and understood. We investigate current benchmarks to incorporate excessive visual content within textual questions, which potentially assist MLLMs in deducing answers without truly interpreting the input diagrams. To this end, we introduce MathVerse, an all-around visual math benchmark designed for an equitable and in-depth evaluation of MLLMs. We meticulously collect 2,612 high-quality, multi-subject math problems with diagrams from publicly available sources. Each problem is then transformed by human annotators into six distinct versions, each offering varying degrees of information content in multi-modality, contributing to 15K test samples in total. This approach allows MathVerse to comprehensively assess whether and how much MLLMs can truly understand the visual diagrams for mathematical reasoning. In addition, we propose a Chain-of-Thought (CoT) evaluation strategy for a fine-grained assessment of the output answers. Rather than naively judging True or False, we employ GPT-4(V) to adaptively extract crucial reasoning steps, and then score each step with detailed error analysis, which can reveal the intermediate CoT reasoning quality by MLLMs. We hope the MathVerse benchmark may provide unique insights to guide the future development of MLLMs. Project page: https://mathverse-cuhk.github.io
Related Topics
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2403.14624
- https://arxiv.org/pdf/2403.14624
- OA Status
- green
- Cited By
- 5
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4393119387
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4393119387Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2403.14624Digital Object Identifier
- Title
-
MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?Work title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-03-21Full publication date if available
- Authors
-
Renrui Zhang, Dongzhi Jiang, Yichi Zhang, Haokun Lin, Z. J. Guo, Pengshuo Qiu, Aojun Zhou, Pan Lu, Kai‐Wei Chang, Peng Gao, Hongsheng LiList of authors in order
- Landing page
-
https://arxiv.org/abs/2403.14624Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2403.14624Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2403.14624Direct OA link when available
- Concepts
-
Modal, Diagram, Mathematics, Computer science, Calculus (dental), Mathematics education, Medicine, Statistics, Materials science, Orthodontics, Polymer chemistryTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
5Total citation count in OpenAlex
- Citations by year (recent)
-
2025: 4, 2024: 1Per-year citation counts (last 5 years)
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4393119387 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2403.14624 |
| ids.doi | https://doi.org/10.48550/arxiv.2403.14624 |
| ids.openalex | https://openalex.org/W4393119387 |
| fwci | |
| type | preprint |
| title | MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems? |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T13523 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.9473000168800354 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1703 |
| topics[0].subfield.display_name | Computational Theory and Mathematics |
| topics[0].display_name | Mathematics, Computing, and Information Processing |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C71139939 |
| concepts[0].level | 2 |
| concepts[0].score | 0.7240976095199585 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q910194 |
| concepts[0].display_name | Modal |
| concepts[1].id | https://openalex.org/C186399060 |
| concepts[1].level | 2 |
| concepts[1].score | 0.4700058102607727 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q959962 |
| concepts[1].display_name | Diagram |
| concepts[2].id | https://openalex.org/C33923547 |
| concepts[2].level | 0 |
| concepts[2].score | 0.4603201746940613 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q395 |
| concepts[2].display_name | Mathematics |
| concepts[3].id | https://openalex.org/C41008148 |
| concepts[3].level | 0 |
| concepts[3].score | 0.4344463050365448 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[3].display_name | Computer science |
| concepts[4].id | https://openalex.org/C2777686260 |
| concepts[4].level | 2 |
| concepts[4].score | 0.40369611978530884 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q144037 |
| concepts[4].display_name | Calculus (dental) |
| concepts[5].id | https://openalex.org/C145420912 |
| concepts[5].level | 1 |
| concepts[5].score | 0.3569263517856598 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q853077 |
| concepts[5].display_name | Mathematics education |
| concepts[6].id | https://openalex.org/C71924100 |
| concepts[6].level | 0 |
| concepts[6].score | 0.07862481474876404 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q11190 |
| concepts[6].display_name | Medicine |
| concepts[7].id | https://openalex.org/C105795698 |
| concepts[7].level | 1 |
| concepts[7].score | 0.06901362538337708 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q12483 |
| concepts[7].display_name | Statistics |
| concepts[8].id | https://openalex.org/C192562407 |
| concepts[8].level | 0 |
| concepts[8].score | 0.058680564165115356 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q228736 |
| concepts[8].display_name | Materials science |
| concepts[9].id | https://openalex.org/C29694066 |
| concepts[9].level | 1 |
| concepts[9].score | 0.031177133321762085 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q118301 |
| concepts[9].display_name | Orthodontics |
| concepts[10].id | https://openalex.org/C188027245 |
| concepts[10].level | 1 |
| concepts[10].score | 0.0 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q750446 |
| concepts[10].display_name | Polymer chemistry |
| keywords[0].id | https://openalex.org/keywords/modal |
| keywords[0].score | 0.7240976095199585 |
| keywords[0].display_name | Modal |
| keywords[1].id | https://openalex.org/keywords/diagram |
| keywords[1].score | 0.4700058102607727 |
| keywords[1].display_name | Diagram |
| keywords[2].id | https://openalex.org/keywords/mathematics |
| keywords[2].score | 0.4603201746940613 |
| keywords[2].display_name | Mathematics |
| keywords[3].id | https://openalex.org/keywords/computer-science |
| keywords[3].score | 0.4344463050365448 |
| keywords[3].display_name | Computer science |
| keywords[4].id | https://openalex.org/keywords/calculus |
| keywords[4].score | 0.40369611978530884 |
| keywords[4].display_name | Calculus (dental) |
| keywords[5].id | https://openalex.org/keywords/mathematics-education |
| keywords[5].score | 0.3569263517856598 |
| keywords[5].display_name | Mathematics education |
| keywords[6].id | https://openalex.org/keywords/medicine |
| keywords[6].score | 0.07862481474876404 |
| keywords[6].display_name | Medicine |
| keywords[7].id | https://openalex.org/keywords/statistics |
| keywords[7].score | 0.06901362538337708 |
| keywords[7].display_name | Statistics |
| keywords[8].id | https://openalex.org/keywords/materials-science |
| keywords[8].score | 0.058680564165115356 |
| keywords[8].display_name | Materials science |
| keywords[9].id | https://openalex.org/keywords/orthodontics |
| keywords[9].score | 0.031177133321762085 |
| keywords[9].display_name | Orthodontics |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2403.14624 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2403.14624 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2403.14624 |
| locations[1].id | doi:10.48550/arxiv.2403.14624 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2403.14624 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5086183847 |
| authorships[0].author.orcid | |
| authorships[0].author.display_name | Renrui Zhang |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Zhang, Renrui |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5102634569 |
| authorships[1].author.orcid | |
| authorships[1].author.display_name | Dongzhi Jiang |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Jiang, Dongzhi |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5100444205 |
| authorships[2].author.orcid | https://orcid.org/0009-0005-1156-5538 |
| authorships[2].author.display_name | Yichi Zhang |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Zhang, Yichi |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5025724191 |
| authorships[3].author.orcid | https://orcid.org/0009-0004-8395-392X |
| authorships[3].author.display_name | Haokun Lin |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Lin, Haokun |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5105517691 |
| authorships[4].author.orcid | https://orcid.org/0000-0001-8645-1635 |
| authorships[4].author.display_name | Z. J. Guo |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Guo, Ziyu |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5104263666 |
| authorships[5].author.orcid | |
| authorships[5].author.display_name | Pengshuo Qiu |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Qiu, Pengshuo |
| authorships[5].is_corresponding | False |
| authorships[6].author.id | https://openalex.org/A5041431476 |
| authorships[6].author.orcid | https://orcid.org/0000-0002-4742-8624 |
| authorships[6].author.display_name | Aojun Zhou |
| authorships[6].author_position | middle |
| authorships[6].raw_author_name | Zhou, Aojun |
| authorships[6].is_corresponding | False |
| authorships[7].author.id | https://openalex.org/A5008156638 |
| authorships[7].author.orcid | https://orcid.org/0000-0002-1640-3598 |
| authorships[7].author.display_name | Pan Lu |
| authorships[7].author_position | middle |
| authorships[7].raw_author_name | Lu, Pan |
| authorships[7].is_corresponding | False |
| authorships[8].author.id | https://openalex.org/A5073201681 |
| authorships[8].author.orcid | https://orcid.org/0000-0002-4991-5274 |
| authorships[8].author.display_name | Kai‐Wei Chang |
| authorships[8].author_position | middle |
| authorships[8].raw_author_name | Chang, Kai-Wei |
| authorships[8].is_corresponding | False |
| authorships[9].author.id | https://openalex.org/A5101596659 |
| authorships[9].author.orcid | https://orcid.org/0000-0001-5669-9007 |
| authorships[9].author.display_name | Peng Gao |
| authorships[9].author_position | middle |
| authorships[9].raw_author_name | Gao, Peng |
| authorships[9].is_corresponding | False |
| authorships[10].author.id | https://openalex.org/A5100732450 |
| authorships[10].author.orcid | https://orcid.org/0000-0002-2664-7975 |
| authorships[10].author.display_name | Hongsheng Li |
| authorships[10].author_position | last |
| authorships[10].raw_author_name | Li, Hongsheng |
| authorships[10].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2403.14624 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2024-03-24T00:00:00 |
| display_name | MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems? |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T13523 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.9473000168800354 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1703 |
| primary_topic.subfield.display_name | Computational Theory and Mathematics |
| primary_topic.display_name | Mathematics, Computing, and Information Processing |
| related_works | https://openalex.org/W1979597421, https://openalex.org/W2007980826, https://openalex.org/W2061531152, https://openalex.org/W3002753104, https://openalex.org/W2077600819, https://openalex.org/W2142036596, https://openalex.org/W2072657027, https://openalex.org/W2600246793, https://openalex.org/W4238204885, https://openalex.org/W2963966623 |
| cited_by_count | 5 |
| counts_by_year[0].year | 2025 |
| counts_by_year[0].cited_by_count | 4 |
| counts_by_year[1].year | 2024 |
| counts_by_year[1].cited_by_count | 1 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2403.14624 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2403.14624 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2403.14624 |
| primary_location.id | pmh:oai:arXiv.org:2403.14624 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2403.14624 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2403.14624 |
| publication_date | 2024-03-21 |
| publication_year | 2024 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 145, 151 |
| abstract_inverted_index.In | 141 |
| abstract_inverted_index.To | 58 |
| abstract_inverted_index.We | 33, 78, 193 |
| abstract_inverted_index.an | 64, 71 |
| abstract_inverted_index.by | 97, 191 |
| abstract_inverted_index.in | 18, 24, 49, 111, 118 |
| abstract_inverted_index.is | 94 |
| abstract_inverted_index.of | 3, 76, 108, 154, 207 |
| abstract_inverted_index.or | 163 |
| abstract_inverted_index.to | 14, 37, 114, 124, 168, 202 |
| abstract_inverted_index.we | 61, 143, 165 |
| abstract_inverted_index.15K | 115 |
| abstract_inverted_index.CoT | 188 |
| abstract_inverted_index.The | 0 |
| abstract_inverted_index.and | 31, 73, 128, 174 |
| abstract_inverted_index.can | 132, 184 |
| abstract_inverted_index.due | 13 |
| abstract_inverted_index.for | 70, 138, 150 |
| abstract_inverted_index.has | 9 |
| abstract_inverted_index.how | 129 |
| abstract_inverted_index.may | 198 |
| abstract_inverted_index.six | 101 |
| abstract_inverted_index.the | 55, 135, 155, 186, 195, 204 |
| abstract_inverted_index.Each | 92 |
| abstract_inverted_index.This | 120 |
| abstract_inverted_index.True | 162 |
| abstract_inverted_index.each | 104, 177 |
| abstract_inverted_index.end, | 60 |
| abstract_inverted_index.from | 88 |
| abstract_inverted_index.hope | 194 |
| abstract_inverted_index.into | 100 |
| abstract_inverted_index.math | 26, 67, 84 |
| abstract_inverted_index.much | 130 |
| abstract_inverted_index.step | 178 |
| abstract_inverted_index.test | 116 |
| abstract_inverted_index.than | 159 |
| abstract_inverted_index.then | 95, 175 |
| abstract_inverted_index.this | 59 |
| abstract_inverted_index.with | 86, 179 |
| abstract_inverted_index.(CoT) | 147 |
| abstract_inverted_index.2,612 | 81 |
| abstract_inverted_index.Large | 5 |
| abstract_inverted_index.MLLMs | 48, 131 |
| abstract_inverted_index.error | 181 |
| abstract_inverted_index.guide | 203 |
| abstract_inverted_index.human | 98 |
| abstract_inverted_index.input | 56 |
| abstract_inverted_index.page: | 210 |
| abstract_inverted_index.score | 176 |
| abstract_inverted_index.their | 15, 22 |
| abstract_inverted_index.truly | 53, 133 |
| abstract_inverted_index.which | 45, 183 |
| abstract_inverted_index.False, | 164 |
| abstract_inverted_index.MLLMs. | 77, 192, 208 |
| abstract_inverted_index.Models | 7 |
| abstract_inverted_index.Rather | 158 |
| abstract_inverted_index.allows | 122 |
| abstract_inverted_index.assess | 126 |
| abstract_inverted_index.assist | 47 |
| abstract_inverted_index.employ | 166 |
| abstract_inverted_index.future | 205 |
| abstract_inverted_index.output | 156 |
| abstract_inverted_index.remain | 28 |
| abstract_inverted_index.reveal | 185 |
| abstract_inverted_index.steps, | 173 |
| abstract_inverted_index.total. | 119 |
| abstract_inverted_index.unique | 200 |
| abstract_inverted_index.visual | 19, 25, 40, 66, 136 |
| abstract_inverted_index.within | 42 |
| abstract_inverted_index.(MLLMs) | 8 |
| abstract_inverted_index.Project | 209 |
| abstract_inverted_index.answers | 51 |
| abstract_inverted_index.collect | 80 |
| abstract_inverted_index.content | 41, 110 |
| abstract_inverted_index.crucial | 171 |
| abstract_inverted_index.current | 35 |
| abstract_inverted_index.degrees | 107 |
| abstract_inverted_index.extract | 170 |
| abstract_inverted_index.judging | 161 |
| abstract_inverted_index.naively | 160 |
| abstract_inverted_index.problem | 93 |
| abstract_inverted_index.propose | 144 |
| abstract_inverted_index.provide | 199 |
| abstract_inverted_index.quality | 190 |
| abstract_inverted_index.samples | 117 |
| abstract_inverted_index.textual | 43 |
| abstract_inverted_index.varying | 106 |
| abstract_inverted_index.whether | 127 |
| abstract_inverted_index.without | 52 |
| abstract_inverted_index.GPT-4(V) | 167 |
| abstract_inverted_index.However, | 21 |
| abstract_inverted_index.Language | 6 |
| abstract_inverted_index.answers. | 157 |
| abstract_inverted_index.approach | 121 |
| abstract_inverted_index.deducing | 50 |
| abstract_inverted_index.designed | 69 |
| abstract_inverted_index.detailed | 180 |
| abstract_inverted_index.diagrams | 87, 137 |
| abstract_inverted_index.distinct | 102 |
| abstract_inverted_index.garnered | 10 |
| abstract_inverted_index.in-depth | 74 |
| abstract_inverted_index.insights | 201 |
| abstract_inverted_index.offering | 105 |
| abstract_inverted_index.problems | 85 |
| abstract_inverted_index.progress | 2 |
| abstract_inverted_index.publicly | 89 |
| abstract_inverted_index.sources. | 91 |
| abstract_inverted_index.strategy | 149 |
| abstract_inverted_index.superior | 16 |
| abstract_inverted_index.MathVerse | 123, 196 |
| abstract_inverted_index.addition, | 142 |
| abstract_inverted_index.analysis, | 182 |
| abstract_inverted_index.available | 90 |
| abstract_inverted_index.benchmark | 68, 197 |
| abstract_inverted_index.contexts. | 20 |
| abstract_inverted_index.diagrams. | 57 |
| abstract_inverted_index.equitable | 72 |
| abstract_inverted_index.evaluated | 30 |
| abstract_inverted_index.excessive | 39 |
| abstract_inverted_index.introduce | 62 |
| abstract_inverted_index.reasoning | 172, 189 |
| abstract_inverted_index.versions, | 103 |
| abstract_inverted_index.MathVerse, | 63 |
| abstract_inverted_index.adaptively | 169 |
| abstract_inverted_index.all-around | 65 |
| abstract_inverted_index.annotators | 99 |
| abstract_inverted_index.assessment | 153 |
| abstract_inverted_index.attention, | 12 |
| abstract_inverted_index.benchmarks | 36 |
| abstract_inverted_index.evaluation | 75, 148 |
| abstract_inverted_index.questions, | 44 |
| abstract_inverted_index.reasoning. | 140 |
| abstract_inverted_index.remarkable | 1 |
| abstract_inverted_index.understand | 134 |
| abstract_inverted_index.Multi-modal | 4 |
| abstract_inverted_index.development | 206 |
| abstract_inverted_index.incorporate | 38 |
| abstract_inverted_index.information | 109 |
| abstract_inverted_index.investigate | 34 |
| abstract_inverted_index.performance | 17 |
| abstract_inverted_index.potentially | 46 |
| abstract_inverted_index.transformed | 96 |
| abstract_inverted_index.understood. | 32 |
| abstract_inverted_index.capabilities | 23 |
| abstract_inverted_index.contributing | 113 |
| abstract_inverted_index.fine-grained | 152 |
| abstract_inverted_index.intermediate | 187 |
| abstract_inverted_index.interpreting | 54 |
| abstract_inverted_index.mathematical | 139 |
| abstract_inverted_index.meticulously | 79 |
| abstract_inverted_index.unparalleled | 11 |
| abstract_inverted_index.high-quality, | 82 |
| abstract_inverted_index.multi-subject | 83 |
| abstract_inverted_index.insufficiently | 29 |
| abstract_inverted_index.comprehensively | 125 |
| abstract_inverted_index.multi-modality, | 112 |
| abstract_inverted_index.problem-solving | 27 |
| abstract_inverted_index.Chain-of-Thought | 146 |
| abstract_inverted_index.https://mathverse-cuhk.github.io | 211 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 11 |
| citation_normalized_percentile |