Label-Free Model Evaluation with Out-of-Distribution Detection Article Swipe
Fangzhe Zhu
,
Ye Zhao
,
Zhengqiong Liu
,
Xueliang Liu
·
YOU?
·
· 2023
· Open Access
·
· DOI: https://doi.org/10.3390/app13085056
YOU?
·
· 2023
· Open Access
·
· DOI: https://doi.org/10.3390/app13085056
In recent years, label-free model evaluation has been developed to estimate the performance of models on unlabeled test sets. However, we find that existing methods perform poorly in environments with out-of-distribution (OOD) data. To address this issue, we propose a novel automatic model evaluation method using OOD detection to reduce the impact of OOD data on model evaluation. Specifically, we use the representation of datasets to train a neural network for accuracy prediction and employ energy-based OOD detection to exclude OOD data during testing. We conducted experiments on several benchmark datasets with varying amounts of OOD data (SVHN, ISUN, ImageNet, and LSUN) and demonstrated that our method reduces the RMSE compared to existing methods by at least 1.27%. Additionally, we tested our method on transformed datasets and datasets with a high proportion of OOD data, and the results show its robustness.
Related Topics
Concepts
Metadata
- Type
- article
- Language
- en
- Landing Page
- https://doi.org/10.3390/app13085056
- https://www.mdpi.com/2076-3417/13/8/5056/pdf?version=1681813673
- OA Status
- gold
- Cited By
- 1
- References
- 30
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4366415313
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4366415313Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.3390/app13085056Digital Object Identifier
- Title
-
Label-Free Model Evaluation with Out-of-Distribution DetectionWork title
- Type
-
articleOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2023Year of publication
- Publication date
-
2023-04-18Full publication date if available
- Authors
-
Fangzhe Zhu, Ye Zhao, Zhengqiong Liu, Xueliang LiuList of authors in order
- Landing page
-
https://doi.org/10.3390/app13085056Publisher landing page
- PDF URL
-
https://www.mdpi.com/2076-3417/13/8/5056/pdf?version=1681813673Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
goldOpen access status per OpenAlex
- OA URL
-
https://www.mdpi.com/2076-3417/13/8/5056/pdf?version=1681813673Direct OA link when available
- Concepts
-
Computer science, Robustness (evolution), Benchmark (surveying), Data mining, Machine learning, Test data, Artificial intelligence, Artificial neural network, Geography, Gene, Geodesy, Biochemistry, Programming language, ChemistryTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
1Total citation count in OpenAlex
- Citations by year (recent)
-
2024: 1Per-year citation counts (last 5 years)
- References (count)
-
30Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4366415313 |
|---|---|
| doi | https://doi.org/10.3390/app13085056 |
| ids.doi | https://doi.org/10.3390/app13085056 |
| ids.openalex | https://openalex.org/W4366415313 |
| fwci | 0.25544289 |
| type | article |
| title | Label-Free Model Evaluation with Out-of-Distribution Detection |
| awards[0].id | https://openalex.org/G8584835706 |
| awards[0].funder_id | https://openalex.org/F4320322666 |
| awards[0].display_name | |
| awards[0].funder_award_id | 202203021211116 |
| awards[0].funder_display_name | Natural Science Foundation of Shanxi Province |
| biblio.issue | 8 |
| biblio.volume | 13 |
| biblio.last_page | 5056 |
| biblio.first_page | 5056 |
| topics[0].id | https://openalex.org/T12535 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.9984999895095825 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1702 |
| topics[0].subfield.display_name | Artificial Intelligence |
| topics[0].display_name | Machine Learning and Data Classification |
| topics[1].id | https://openalex.org/T11307 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9979000091552734 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1702 |
| topics[1].subfield.display_name | Artificial Intelligence |
| topics[1].display_name | Domain Adaptation and Few-Shot Learning |
| topics[2].id | https://openalex.org/T10036 |
| topics[2].field.id | https://openalex.org/fields/17 |
| topics[2].field.display_name | Computer Science |
| topics[2].score | 0.9972000122070312 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1707 |
| topics[2].subfield.display_name | Computer Vision and Pattern Recognition |
| topics[2].display_name | Advanced Neural Network Applications |
| funders[0].id | https://openalex.org/F4320322666 |
| funders[0].ror | |
| funders[0].display_name | Natural Science Foundation of Shanxi Province |
| is_xpac | False |
| apc_list.value | 2300 |
| apc_list.currency | CHF |
| apc_list.value_usd | 2490 |
| apc_paid.value | 2300 |
| apc_paid.currency | CHF |
| apc_paid.value_usd | 2490 |
| concepts[0].id | https://openalex.org/C41008148 |
| concepts[0].level | 0 |
| concepts[0].score | 0.7741893529891968 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[0].display_name | Computer science |
| concepts[1].id | https://openalex.org/C63479239 |
| concepts[1].level | 3 |
| concepts[1].score | 0.6849316358566284 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q7353546 |
| concepts[1].display_name | Robustness (evolution) |
| concepts[2].id | https://openalex.org/C185798385 |
| concepts[2].level | 2 |
| concepts[2].score | 0.587842583656311 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q1161707 |
| concepts[2].display_name | Benchmark (surveying) |
| concepts[3].id | https://openalex.org/C124101348 |
| concepts[3].level | 1 |
| concepts[3].score | 0.5638022422790527 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q172491 |
| concepts[3].display_name | Data mining |
| concepts[4].id | https://openalex.org/C119857082 |
| concepts[4].level | 1 |
| concepts[4].score | 0.5354588031768799 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q2539 |
| concepts[4].display_name | Machine learning |
| concepts[5].id | https://openalex.org/C16910744 |
| concepts[5].level | 2 |
| concepts[5].score | 0.45129793882369995 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q7705759 |
| concepts[5].display_name | Test data |
| concepts[6].id | https://openalex.org/C154945302 |
| concepts[6].level | 1 |
| concepts[6].score | 0.4494110345840454 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[6].display_name | Artificial intelligence |
| concepts[7].id | https://openalex.org/C50644808 |
| concepts[7].level | 2 |
| concepts[7].score | 0.4362523555755615 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q192776 |
| concepts[7].display_name | Artificial neural network |
| concepts[8].id | https://openalex.org/C205649164 |
| concepts[8].level | 0 |
| concepts[8].score | 0.0 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q1071 |
| concepts[8].display_name | Geography |
| concepts[9].id | https://openalex.org/C104317684 |
| concepts[9].level | 2 |
| concepts[9].score | 0.0 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q7187 |
| concepts[9].display_name | Gene |
| concepts[10].id | https://openalex.org/C13280743 |
| concepts[10].level | 1 |
| concepts[10].score | 0.0 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q131089 |
| concepts[10].display_name | Geodesy |
| concepts[11].id | https://openalex.org/C55493867 |
| concepts[11].level | 1 |
| concepts[11].score | 0.0 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q7094 |
| concepts[11].display_name | Biochemistry |
| concepts[12].id | https://openalex.org/C199360897 |
| concepts[12].level | 1 |
| concepts[12].score | 0.0 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q9143 |
| concepts[12].display_name | Programming language |
| concepts[13].id | https://openalex.org/C185592680 |
| concepts[13].level | 0 |
| concepts[13].score | 0.0 |
| concepts[13].wikidata | https://www.wikidata.org/wiki/Q2329 |
| concepts[13].display_name | Chemistry |
| keywords[0].id | https://openalex.org/keywords/computer-science |
| keywords[0].score | 0.7741893529891968 |
| keywords[0].display_name | Computer science |
| keywords[1].id | https://openalex.org/keywords/robustness |
| keywords[1].score | 0.6849316358566284 |
| keywords[1].display_name | Robustness (evolution) |
| keywords[2].id | https://openalex.org/keywords/benchmark |
| keywords[2].score | 0.587842583656311 |
| keywords[2].display_name | Benchmark (surveying) |
| keywords[3].id | https://openalex.org/keywords/data-mining |
| keywords[3].score | 0.5638022422790527 |
| keywords[3].display_name | Data mining |
| keywords[4].id | https://openalex.org/keywords/machine-learning |
| keywords[4].score | 0.5354588031768799 |
| keywords[4].display_name | Machine learning |
| keywords[5].id | https://openalex.org/keywords/test-data |
| keywords[5].score | 0.45129793882369995 |
| keywords[5].display_name | Test data |
| keywords[6].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[6].score | 0.4494110345840454 |
| keywords[6].display_name | Artificial intelligence |
| keywords[7].id | https://openalex.org/keywords/artificial-neural-network |
| keywords[7].score | 0.4362523555755615 |
| keywords[7].display_name | Artificial neural network |
| language | en |
| locations[0].id | doi:10.3390/app13085056 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4210205812 |
| locations[0].source.issn | 2076-3417 |
| locations[0].source.type | journal |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | 2076-3417 |
| locations[0].source.is_core | True |
| locations[0].source.is_in_doaj | True |
| locations[0].source.display_name | Applied Sciences |
| locations[0].source.host_organization | https://openalex.org/P4310310987 |
| locations[0].source.host_organization_name | Multidisciplinary Digital Publishing Institute |
| locations[0].source.host_organization_lineage | https://openalex.org/P4310310987 |
| locations[0].source.host_organization_lineage_names | Multidisciplinary Digital Publishing Institute |
| locations[0].license | cc-by |
| locations[0].pdf_url | https://www.mdpi.com/2076-3417/13/8/5056/pdf?version=1681813673 |
| locations[0].version | publishedVersion |
| locations[0].raw_type | journal-article |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | True |
| locations[0].is_published | True |
| locations[0].raw_source_name | Applied Sciences |
| locations[0].landing_page_url | https://doi.org/10.3390/app13085056 |
| locations[1].id | pmh:oai:doaj.org/article:2b5ca04fcea24f5485664131c15c0f85 |
| locations[1].is_oa | False |
| locations[1].source.id | https://openalex.org/S4306401280 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | False |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | DOAJ (DOAJ: Directory of Open Access Journals) |
| locations[1].source.host_organization | |
| locations[1].source.host_organization_name | |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | submittedVersion |
| locations[1].raw_type | article |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | False |
| locations[1].raw_source_name | Applied Sciences, Vol 13, Iss 8, p 5056 (2023) |
| locations[1].landing_page_url | https://doaj.org/article/2b5ca04fcea24f5485664131c15c0f85 |
| locations[2].id | pmh:oai:mdpi.com:/2076-3417/13/8/5056/ |
| locations[2].is_oa | True |
| locations[2].source.id | https://openalex.org/S4306400947 |
| locations[2].source.issn | |
| locations[2].source.type | repository |
| locations[2].source.is_oa | True |
| locations[2].source.issn_l | |
| locations[2].source.is_core | False |
| locations[2].source.is_in_doaj | False |
| locations[2].source.display_name | MDPI (MDPI AG) |
| locations[2].source.host_organization | https://openalex.org/I4210097602 |
| locations[2].source.host_organization_name | Multidisciplinary Digital Publishing Institute (Switzerland) |
| locations[2].source.host_organization_lineage | https://openalex.org/I4210097602 |
| locations[2].license | cc-by |
| locations[2].pdf_url | |
| locations[2].version | submittedVersion |
| locations[2].raw_type | Text |
| locations[2].license_id | https://openalex.org/licenses/cc-by |
| locations[2].is_accepted | False |
| locations[2].is_published | False |
| locations[2].raw_source_name | Applied Sciences; Volume 13; Issue 8; Pages: 5056 |
| locations[2].landing_page_url | https://dx.doi.org/10.3390/app13085056 |
| indexed_in | crossref, doaj |
| authorships[0].author.id | https://openalex.org/A5012758118 |
| authorships[0].author.orcid | |
| authorships[0].author.display_name | Fangzhe Zhu |
| authorships[0].countries | CN |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I16365422 |
| authorships[0].affiliations[0].raw_affiliation_string | School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230601, China |
| authorships[0].institutions[0].id | https://openalex.org/I16365422 |
| authorships[0].institutions[0].ror | https://ror.org/02czkny70 |
| authorships[0].institutions[0].type | education |
| authorships[0].institutions[0].lineage | https://openalex.org/I16365422 |
| authorships[0].institutions[0].country_code | CN |
| authorships[0].institutions[0].display_name | Hefei University of Technology |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Fangzhe Zhu |
| authorships[0].is_corresponding | False |
| authorships[0].raw_affiliation_strings | School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230601, China |
| authorships[1].author.id | https://openalex.org/A5008632512 |
| authorships[1].author.orcid | https://orcid.org/0000-0002-8180-4697 |
| authorships[1].author.display_name | Ye Zhao |
| authorships[1].countries | CN |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I16365422 |
| authorships[1].affiliations[0].raw_affiliation_string | School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230601, China |
| authorships[1].institutions[0].id | https://openalex.org/I16365422 |
| authorships[1].institutions[0].ror | https://ror.org/02czkny70 |
| authorships[1].institutions[0].type | education |
| authorships[1].institutions[0].lineage | https://openalex.org/I16365422 |
| authorships[1].institutions[0].country_code | CN |
| authorships[1].institutions[0].display_name | Hefei University of Technology |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Ye Zhao |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230601, China |
| authorships[2].author.id | https://openalex.org/A5004829836 |
| authorships[2].author.orcid | |
| authorships[2].author.display_name | Zhengqiong Liu |
| authorships[2].countries | CN |
| authorships[2].affiliations[0].institution_ids | https://openalex.org/I16365422 |
| authorships[2].affiliations[0].raw_affiliation_string | School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230601, China |
| authorships[2].institutions[0].id | https://openalex.org/I16365422 |
| authorships[2].institutions[0].ror | https://ror.org/02czkny70 |
| authorships[2].institutions[0].type | education |
| authorships[2].institutions[0].lineage | https://openalex.org/I16365422 |
| authorships[2].institutions[0].country_code | CN |
| authorships[2].institutions[0].display_name | Hefei University of Technology |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Zhengqiong Liu |
| authorships[2].is_corresponding | False |
| authorships[2].raw_affiliation_strings | School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230601, China |
| authorships[3].author.id | https://openalex.org/A5101993173 |
| authorships[3].author.orcid | https://orcid.org/0000-0003-0077-9715 |
| authorships[3].author.display_name | Xueliang Liu |
| authorships[3].countries | CN |
| authorships[3].affiliations[0].institution_ids | https://openalex.org/I16365422 |
| authorships[3].affiliations[0].raw_affiliation_string | School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230601, China |
| authorships[3].institutions[0].id | https://openalex.org/I16365422 |
| authorships[3].institutions[0].ror | https://ror.org/02czkny70 |
| authorships[3].institutions[0].type | education |
| authorships[3].institutions[0].lineage | https://openalex.org/I16365422 |
| authorships[3].institutions[0].country_code | CN |
| authorships[3].institutions[0].display_name | Hefei University of Technology |
| authorships[3].author_position | last |
| authorships[3].raw_author_name | Xueliang Liu |
| authorships[3].is_corresponding | False |
| authorships[3].raw_affiliation_strings | School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230601, China |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://www.mdpi.com/2076-3417/13/8/5056/pdf?version=1681813673 |
| open_access.oa_status | gold |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Label-Free Model Evaluation with Out-of-Distribution Detection |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T12535 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.9984999895095825 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1702 |
| primary_topic.subfield.display_name | Artificial Intelligence |
| primary_topic.display_name | Machine Learning and Data Classification |
| related_works | https://openalex.org/W1485630101, https://openalex.org/W2498017833, https://openalex.org/W2961085424, https://openalex.org/W112744582, https://openalex.org/W4306674287, https://openalex.org/W2055404698, https://openalex.org/W4224009465, https://openalex.org/W4286629047, https://openalex.org/W4306321456, https://openalex.org/W4280641190 |
| cited_by_count | 1 |
| counts_by_year[0].year | 2024 |
| counts_by_year[0].cited_by_count | 1 |
| locations_count | 3 |
| best_oa_location.id | doi:10.3390/app13085056 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4210205812 |
| best_oa_location.source.issn | 2076-3417 |
| best_oa_location.source.type | journal |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | 2076-3417 |
| best_oa_location.source.is_core | True |
| best_oa_location.source.is_in_doaj | True |
| best_oa_location.source.display_name | Applied Sciences |
| best_oa_location.source.host_organization | https://openalex.org/P4310310987 |
| best_oa_location.source.host_organization_name | Multidisciplinary Digital Publishing Institute |
| best_oa_location.source.host_organization_lineage | https://openalex.org/P4310310987 |
| best_oa_location.source.host_organization_lineage_names | Multidisciplinary Digital Publishing Institute |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | https://www.mdpi.com/2076-3417/13/8/5056/pdf?version=1681813673 |
| best_oa_location.version | publishedVersion |
| best_oa_location.raw_type | journal-article |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | True |
| best_oa_location.raw_source_name | Applied Sciences |
| best_oa_location.landing_page_url | https://doi.org/10.3390/app13085056 |
| primary_location.id | doi:10.3390/app13085056 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4210205812 |
| primary_location.source.issn | 2076-3417 |
| primary_location.source.type | journal |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | 2076-3417 |
| primary_location.source.is_core | True |
| primary_location.source.is_in_doaj | True |
| primary_location.source.display_name | Applied Sciences |
| primary_location.source.host_organization | https://openalex.org/P4310310987 |
| primary_location.source.host_organization_name | Multidisciplinary Digital Publishing Institute |
| primary_location.source.host_organization_lineage | https://openalex.org/P4310310987 |
| primary_location.source.host_organization_lineage_names | Multidisciplinary Digital Publishing Institute |
| primary_location.license | cc-by |
| primary_location.pdf_url | https://www.mdpi.com/2076-3417/13/8/5056/pdf?version=1681813673 |
| primary_location.version | publishedVersion |
| primary_location.raw_type | journal-article |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | True |
| primary_location.is_published | True |
| primary_location.raw_source_name | Applied Sciences |
| primary_location.landing_page_url | https://doi.org/10.3390/app13085056 |
| publication_date | 2023-04-18 |
| publication_year | 2023 |
| referenced_works | https://openalex.org/W2471188054, https://openalex.org/W6675170660, https://openalex.org/W3180332766, https://openalex.org/W4214604534, https://openalex.org/W3167497413, https://openalex.org/W4292787455, https://openalex.org/W4214627684, https://openalex.org/W6784323503, https://openalex.org/W3147184966, https://openalex.org/W2566079294, https://openalex.org/W3035004544, https://openalex.org/W2968541250, https://openalex.org/W3109994846, https://openalex.org/W2867167548, https://openalex.org/W4312776478, https://openalex.org/W6839309203, https://openalex.org/W6842675722, https://openalex.org/W4312834814, https://openalex.org/W4319301021, https://openalex.org/W2078179989, https://openalex.org/W3118608800, https://openalex.org/W2108598243, https://openalex.org/W6634343353, https://openalex.org/W2335728318, https://openalex.org/W6687483927, https://openalex.org/W2145607950, https://openalex.org/W3092527263, https://openalex.org/W3005850013, https://openalex.org/W4296548734, https://openalex.org/W4283693135 |
| referenced_works_count | 30 |
| abstract_inverted_index.a | 39, 67, 129 |
| abstract_inverted_index.In | 0 |
| abstract_inverted_index.To | 33 |
| abstract_inverted_index.We | 84 |
| abstract_inverted_index.at | 115 |
| abstract_inverted_index.by | 114 |
| abstract_inverted_index.in | 27 |
| abstract_inverted_index.of | 13, 52, 63, 94, 132 |
| abstract_inverted_index.on | 15, 55, 87, 123 |
| abstract_inverted_index.to | 9, 48, 65, 78, 111 |
| abstract_inverted_index.we | 20, 37, 59, 119 |
| abstract_inverted_index.OOD | 46, 53, 76, 80, 95, 133 |
| abstract_inverted_index.and | 73, 100, 102, 126, 135 |
| abstract_inverted_index.for | 70 |
| abstract_inverted_index.has | 6 |
| abstract_inverted_index.its | 139 |
| abstract_inverted_index.our | 105, 121 |
| abstract_inverted_index.the | 11, 50, 61, 108, 136 |
| abstract_inverted_index.use | 60 |
| abstract_inverted_index.RMSE | 109 |
| abstract_inverted_index.been | 7 |
| abstract_inverted_index.data | 54, 81, 96 |
| abstract_inverted_index.find | 21 |
| abstract_inverted_index.high | 130 |
| abstract_inverted_index.show | 138 |
| abstract_inverted_index.test | 17 |
| abstract_inverted_index.that | 22, 104 |
| abstract_inverted_index.this | 35 |
| abstract_inverted_index.with | 29, 91, 128 |
| abstract_inverted_index.(OOD) | 31 |
| abstract_inverted_index.ISUN, | 98 |
| abstract_inverted_index.LSUN) | 101 |
| abstract_inverted_index.data, | 134 |
| abstract_inverted_index.data. | 32 |
| abstract_inverted_index.least | 116 |
| abstract_inverted_index.model | 4, 42, 56 |
| abstract_inverted_index.novel | 40 |
| abstract_inverted_index.sets. | 18 |
| abstract_inverted_index.train | 66 |
| abstract_inverted_index.using | 45 |
| abstract_inverted_index.(SVHN, | 97 |
| abstract_inverted_index.1.27%. | 117 |
| abstract_inverted_index.during | 82 |
| abstract_inverted_index.employ | 74 |
| abstract_inverted_index.impact | 51 |
| abstract_inverted_index.issue, | 36 |
| abstract_inverted_index.method | 44, 106, 122 |
| abstract_inverted_index.models | 14 |
| abstract_inverted_index.neural | 68 |
| abstract_inverted_index.poorly | 26 |
| abstract_inverted_index.recent | 1 |
| abstract_inverted_index.reduce | 49 |
| abstract_inverted_index.tested | 120 |
| abstract_inverted_index.years, | 2 |
| abstract_inverted_index.address | 34 |
| abstract_inverted_index.amounts | 93 |
| abstract_inverted_index.exclude | 79 |
| abstract_inverted_index.methods | 24, 113 |
| abstract_inverted_index.network | 69 |
| abstract_inverted_index.perform | 25 |
| abstract_inverted_index.propose | 38 |
| abstract_inverted_index.reduces | 107 |
| abstract_inverted_index.results | 137 |
| abstract_inverted_index.several | 88 |
| abstract_inverted_index.varying | 92 |
| abstract_inverted_index.However, | 19 |
| abstract_inverted_index.accuracy | 71 |
| abstract_inverted_index.compared | 110 |
| abstract_inverted_index.datasets | 64, 90, 125, 127 |
| abstract_inverted_index.estimate | 10 |
| abstract_inverted_index.existing | 23, 112 |
| abstract_inverted_index.testing. | 83 |
| abstract_inverted_index.ImageNet, | 99 |
| abstract_inverted_index.automatic | 41 |
| abstract_inverted_index.benchmark | 89 |
| abstract_inverted_index.conducted | 85 |
| abstract_inverted_index.detection | 47, 77 |
| abstract_inverted_index.developed | 8 |
| abstract_inverted_index.unlabeled | 16 |
| abstract_inverted_index.evaluation | 5, 43 |
| abstract_inverted_index.label-free | 3 |
| abstract_inverted_index.prediction | 72 |
| abstract_inverted_index.proportion | 131 |
| abstract_inverted_index.evaluation. | 57 |
| abstract_inverted_index.experiments | 86 |
| abstract_inverted_index.performance | 12 |
| abstract_inverted_index.robustness. | 140 |
| abstract_inverted_index.transformed | 124 |
| abstract_inverted_index.demonstrated | 103 |
| abstract_inverted_index.energy-based | 75 |
| abstract_inverted_index.environments | 28 |
| abstract_inverted_index.Additionally, | 118 |
| abstract_inverted_index.Specifically, | 58 |
| abstract_inverted_index.representation | 62 |
| abstract_inverted_index.out-of-distribution | 30 |
| cited_by_percentile_year.max | 94 |
| cited_by_percentile_year.min | 90 |
| countries_distinct_count | 1 |
| institutions_distinct_count | 4 |
| sustainable_development_goals[0].id | https://metadata.un.org/sdg/7 |
| sustainable_development_goals[0].score | 0.8799999952316284 |
| sustainable_development_goals[0].display_name | Affordable and clean energy |
| citation_normalized_percentile.value | 0.53880924 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |