Enhancing Recommendation Diversity by Re-ranking with Large Language Models Article Swipe
Recommender Systems (RS) should provide diverse recommendations, not just relevant ones. Diversity helps handle uncertainty and offers users meaningful choices. The literature proposes various methods to improve diversity, most notably by re-ranking and selecting from a larger set of candidate recommendations. Driven by promising insights from the literature on how to incorporate versatile Large Language Models (LLMs) into the RS pipeline, in this paper we show how LLMs can be used for diversity re-ranking. We prompt LLMs to generate a diverse ranking from a candidate ranking using various prompt templates with different re-ranking instructions in a zero-shot fashion. We conduct experiments testing state-of-the-art LLMs from the GPT and Llama families. We compare their re-ranking capabilities with random re-ranking and various traditional re-ranking methods from the literature. We open-source the code of our experiments for reproducibility. Our findings suggest that the trade-offs (in terms of performance and costs, among others) of LLM-based re-rankers are superior to those of random re-rankers but, as yet, inferior to the ones of traditional re-rankers. However, because LLMs exhibit improved performance on many natural language processing and recommendation tasks and lower inference costs, we can expect LLM-based re-ranking to become more competitive soon.
Related Topics
- Type
- article
- Language
- en
- Landing Page
- https://doi.org/10.1145/3700604
- https://dl.acm.org/doi/pdf/10.1145/3700604
- OA Status
- bronze
- Cited By
- 22
- References
- 44
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4403431604
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4403431604Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.1145/3700604Digital Object Identifier
- Title
-
Enhancing Recommendation Diversity by Re-ranking with Large Language ModelsWork title
- Type
-
articleOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-10-15Full publication date if available
- Authors
-
Diego Carraro, Derek BridgeList of authors in order
- Landing page
-
https://doi.org/10.1145/3700604Publisher landing page
- PDF URL
-
https://dl.acm.org/doi/pdf/10.1145/3700604Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
bronzeOpen access status per OpenAlex
- OA URL
-
https://dl.acm.org/doi/pdf/10.1145/3700604Direct OA link when available
- Concepts
-
Diversity (politics), Ranking (information retrieval), Natural language processing, Computer science, Information retrieval, Data science, Geography, Linguistics, Sociology, Anthropology, PhilosophyTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
22Total citation count in OpenAlex
- Citations by year (recent)
-
2025: 18, 2024: 4Per-year citation counts (last 5 years)
- References (count)
-
44Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4403431604 |
|---|---|
| doi | https://doi.org/10.1145/3700604 |
| ids.doi | https://doi.org/10.1145/3700604 |
| ids.openalex | https://openalex.org/W4403431604 |
| fwci | 33.6083058 |
| type | article |
| title | Enhancing Recommendation Diversity by Re-ranking with Large Language Models |
| biblio.issue | 2 |
| biblio.volume | 4 |
| biblio.last_page | 40 |
| biblio.first_page | 1 |
| topics[0].id | https://openalex.org/T10203 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.9998999834060669 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1710 |
| topics[0].subfield.display_name | Information Systems |
| topics[0].display_name | Recommender Systems and Techniques |
| topics[1].id | https://openalex.org/T10028 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9980999827384949 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1702 |
| topics[1].subfield.display_name | Artificial Intelligence |
| topics[1].display_name | Topic Modeling |
| topics[2].id | https://openalex.org/T13274 |
| topics[2].field.id | https://openalex.org/fields/17 |
| topics[2].field.display_name | Computer Science |
| topics[2].score | 0.9912999868392944 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1710 |
| topics[2].subfield.display_name | Information Systems |
| topics[2].display_name | Expert finding and Q&A systems |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C2781316041 |
| concepts[0].level | 2 |
| concepts[0].score | 0.6504013538360596 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q1230584 |
| concepts[0].display_name | Diversity (politics) |
| concepts[1].id | https://openalex.org/C189430467 |
| concepts[1].level | 2 |
| concepts[1].score | 0.6409056186676025 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q7293293 |
| concepts[1].display_name | Ranking (information retrieval) |
| concepts[2].id | https://openalex.org/C204321447 |
| concepts[2].level | 1 |
| concepts[2].score | 0.4496873915195465 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q30642 |
| concepts[2].display_name | Natural language processing |
| concepts[3].id | https://openalex.org/C41008148 |
| concepts[3].level | 0 |
| concepts[3].score | 0.44176286458969116 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[3].display_name | Computer science |
| concepts[4].id | https://openalex.org/C23123220 |
| concepts[4].level | 1 |
| concepts[4].score | 0.43827706575393677 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q816826 |
| concepts[4].display_name | Information retrieval |
| concepts[5].id | https://openalex.org/C2522767166 |
| concepts[5].level | 1 |
| concepts[5].score | 0.37596553564071655 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q2374463 |
| concepts[5].display_name | Data science |
| concepts[6].id | https://openalex.org/C205649164 |
| concepts[6].level | 0 |
| concepts[6].score | 0.3256690502166748 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q1071 |
| concepts[6].display_name | Geography |
| concepts[7].id | https://openalex.org/C41895202 |
| concepts[7].level | 1 |
| concepts[7].score | 0.3229164183139801 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q8162 |
| concepts[7].display_name | Linguistics |
| concepts[8].id | https://openalex.org/C144024400 |
| concepts[8].level | 0 |
| concepts[8].score | 0.23445338010787964 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q21201 |
| concepts[8].display_name | Sociology |
| concepts[9].id | https://openalex.org/C19165224 |
| concepts[9].level | 1 |
| concepts[9].score | 0.13606023788452148 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q23404 |
| concepts[9].display_name | Anthropology |
| concepts[10].id | https://openalex.org/C138885662 |
| concepts[10].level | 0 |
| concepts[10].score | 0.1040603518486023 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q5891 |
| concepts[10].display_name | Philosophy |
| keywords[0].id | https://openalex.org/keywords/diversity |
| keywords[0].score | 0.6504013538360596 |
| keywords[0].display_name | Diversity (politics) |
| keywords[1].id | https://openalex.org/keywords/ranking |
| keywords[1].score | 0.6409056186676025 |
| keywords[1].display_name | Ranking (information retrieval) |
| keywords[2].id | https://openalex.org/keywords/natural-language-processing |
| keywords[2].score | 0.4496873915195465 |
| keywords[2].display_name | Natural language processing |
| keywords[3].id | https://openalex.org/keywords/computer-science |
| keywords[3].score | 0.44176286458969116 |
| keywords[3].display_name | Computer science |
| keywords[4].id | https://openalex.org/keywords/information-retrieval |
| keywords[4].score | 0.43827706575393677 |
| keywords[4].display_name | Information retrieval |
| keywords[5].id | https://openalex.org/keywords/data-science |
| keywords[5].score | 0.37596553564071655 |
| keywords[5].display_name | Data science |
| keywords[6].id | https://openalex.org/keywords/geography |
| keywords[6].score | 0.3256690502166748 |
| keywords[6].display_name | Geography |
| keywords[7].id | https://openalex.org/keywords/linguistics |
| keywords[7].score | 0.3229164183139801 |
| keywords[7].display_name | Linguistics |
| keywords[8].id | https://openalex.org/keywords/sociology |
| keywords[8].score | 0.23445338010787964 |
| keywords[8].display_name | Sociology |
| keywords[9].id | https://openalex.org/keywords/anthropology |
| keywords[9].score | 0.13606023788452148 |
| keywords[9].display_name | Anthropology |
| keywords[10].id | https://openalex.org/keywords/philosophy |
| keywords[10].score | 0.1040603518486023 |
| keywords[10].display_name | Philosophy |
| language | en |
| locations[0].id | doi:10.1145/3700604 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4387284325 |
| locations[0].source.issn | 2770-6699 |
| locations[0].source.type | journal |
| locations[0].source.is_oa | False |
| locations[0].source.issn_l | 2770-6699 |
| locations[0].source.is_core | True |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | ACM Transactions on Recommender Systems |
| locations[0].source.host_organization | https://openalex.org/P4310319798 |
| locations[0].source.host_organization_name | Association for Computing Machinery |
| locations[0].source.host_organization_lineage | https://openalex.org/P4310319798 |
| locations[0].source.host_organization_lineage_names | Association for Computing Machinery |
| locations[0].license | |
| locations[0].pdf_url | https://dl.acm.org/doi/pdf/10.1145/3700604 |
| locations[0].version | publishedVersion |
| locations[0].raw_type | journal-article |
| locations[0].license_id | |
| locations[0].is_accepted | True |
| locations[0].is_published | True |
| locations[0].raw_source_name | ACM Transactions on Recommender Systems |
| locations[0].landing_page_url | https://doi.org/10.1145/3700604 |
| indexed_in | crossref |
| authorships[0].author.id | https://openalex.org/A5080871547 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-2857-0473 |
| authorships[0].author.display_name | Diego Carraro |
| authorships[0].countries | IE |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I27577105 |
| authorships[0].affiliations[0].raw_affiliation_string | Insight Centre for Data Analytics, School of Computer Science & IT, University College Cork, Cork, Ireland |
| authorships[0].institutions[0].id | https://openalex.org/I27577105 |
| authorships[0].institutions[0].ror | https://ror.org/03265fv13 |
| authorships[0].institutions[0].type | education |
| authorships[0].institutions[0].lineage | https://openalex.org/I27577105 |
| authorships[0].institutions[0].country_code | IE |
| authorships[0].institutions[0].display_name | University College Cork |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Diego Carraro |
| authorships[0].is_corresponding | False |
| authorships[0].raw_affiliation_strings | Insight Centre for Data Analytics, School of Computer Science & IT, University College Cork, Cork, Ireland |
| authorships[1].author.id | https://openalex.org/A5008002610 |
| authorships[1].author.orcid | https://orcid.org/0000-0002-8720-3876 |
| authorships[1].author.display_name | Derek Bridge |
| authorships[1].countries | IE |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I27577105 |
| authorships[1].affiliations[0].raw_affiliation_string | Insight Centre for Data Analytics, School of Computer Science & IT, University College Cork, Cork, Ireland |
| authorships[1].institutions[0].id | https://openalex.org/I27577105 |
| authorships[1].institutions[0].ror | https://ror.org/03265fv13 |
| authorships[1].institutions[0].type | education |
| authorships[1].institutions[0].lineage | https://openalex.org/I27577105 |
| authorships[1].institutions[0].country_code | IE |
| authorships[1].institutions[0].display_name | University College Cork |
| authorships[1].author_position | last |
| authorships[1].raw_author_name | Derek Bridge |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | Insight Centre for Data Analytics, School of Computer Science & IT, University College Cork, Cork, Ireland |
| has_content.pdf | True |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://dl.acm.org/doi/pdf/10.1145/3700604 |
| open_access.oa_status | bronze |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Enhancing Recommendation Diversity by Re-ranking with Large Language Models |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-23T23:15:26.331081 |
| primary_topic.id | https://openalex.org/T10203 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.9998999834060669 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1710 |
| primary_topic.subfield.display_name | Information Systems |
| primary_topic.display_name | Recommender Systems and Techniques |
| related_works | https://openalex.org/W2118564381, https://openalex.org/W2163901716, https://openalex.org/W2152204162, https://openalex.org/W2739821120, https://openalex.org/W2088097596, https://openalex.org/W2150136235, https://openalex.org/W2026095310, https://openalex.org/W2140661912, https://openalex.org/W2037724912, https://openalex.org/W2056806613 |
| cited_by_count | 22 |
| counts_by_year[0].year | 2025 |
| counts_by_year[0].cited_by_count | 18 |
| counts_by_year[1].year | 2024 |
| counts_by_year[1].cited_by_count | 4 |
| locations_count | 1 |
| best_oa_location.id | doi:10.1145/3700604 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4387284325 |
| best_oa_location.source.issn | 2770-6699 |
| best_oa_location.source.type | journal |
| best_oa_location.source.is_oa | False |
| best_oa_location.source.issn_l | 2770-6699 |
| best_oa_location.source.is_core | True |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | ACM Transactions on Recommender Systems |
| best_oa_location.source.host_organization | https://openalex.org/P4310319798 |
| best_oa_location.source.host_organization_name | Association for Computing Machinery |
| best_oa_location.source.host_organization_lineage | https://openalex.org/P4310319798 |
| best_oa_location.source.host_organization_lineage_names | Association for Computing Machinery |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://dl.acm.org/doi/pdf/10.1145/3700604 |
| best_oa_location.version | publishedVersion |
| best_oa_location.raw_type | journal-article |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | True |
| best_oa_location.raw_source_name | ACM Transactions on Recommender Systems |
| best_oa_location.landing_page_url | https://doi.org/10.1145/3700604 |
| primary_location.id | doi:10.1145/3700604 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4387284325 |
| primary_location.source.issn | 2770-6699 |
| primary_location.source.type | journal |
| primary_location.source.is_oa | False |
| primary_location.source.issn_l | 2770-6699 |
| primary_location.source.is_core | True |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | ACM Transactions on Recommender Systems |
| primary_location.source.host_organization | https://openalex.org/P4310319798 |
| primary_location.source.host_organization_name | Association for Computing Machinery |
| primary_location.source.host_organization_lineage | https://openalex.org/P4310319798 |
| primary_location.source.host_organization_lineage_names | Association for Computing Machinery |
| primary_location.license | |
| primary_location.pdf_url | https://dl.acm.org/doi/pdf/10.1145/3700604 |
| primary_location.version | publishedVersion |
| primary_location.raw_type | journal-article |
| primary_location.license_id | |
| primary_location.is_accepted | True |
| primary_location.is_published | True |
| primary_location.raw_source_name | ACM Transactions on Recommender Systems |
| primary_location.landing_page_url | https://doi.org/10.1145/3700604 |
| publication_date | 2024-10-15 |
| publication_year | 2024 |
| referenced_works | https://openalex.org/W1993320088, https://openalex.org/W4386728933, https://openalex.org/W3138773240, https://openalex.org/W2132314908, https://openalex.org/W2558650634, https://openalex.org/W4386729453, https://openalex.org/W2138216384, https://openalex.org/W4296591867, https://openalex.org/W3153594481, https://openalex.org/W4367047145, https://openalex.org/W4290944002, https://openalex.org/W4392846385, https://openalex.org/W2113885898, https://openalex.org/W2094176536, https://openalex.org/W4309674289, https://openalex.org/W2562236173, https://openalex.org/W4402670880, https://openalex.org/W2939010586, https://openalex.org/W1976757813, https://openalex.org/W4221158409, https://openalex.org/W3185341429, https://openalex.org/W3172750682, https://openalex.org/W4382246105, https://openalex.org/W4386729282, https://openalex.org/W2063468305, https://openalex.org/W2033009633, https://openalex.org/W2148933855, https://openalex.org/W1774663064, https://openalex.org/W2078428190, https://openalex.org/W4389523765, https://openalex.org/W4378499172, https://openalex.org/W2003810236, https://openalex.org/W2144807535, https://openalex.org/W2060796982, https://openalex.org/W1969077952, https://openalex.org/W4372347502, https://openalex.org/W2021581601, https://openalex.org/W2897429051, https://openalex.org/W4382463788, https://openalex.org/W2097951507, https://openalex.org/W4385567868, https://openalex.org/W2155912844, https://openalex.org/W4360612299, https://openalex.org/W2908054697 |
| referenced_works_count | 44 |
| abstract_inverted_index.a | 35, 79, 83, 95 |
| abstract_inverted_index.RS | 59 |
| abstract_inverted_index.We | 74, 98, 110, 126 |
| abstract_inverted_index.as | 160 |
| abstract_inverted_index.be | 69 |
| abstract_inverted_index.by | 30, 42 |
| abstract_inverted_index.in | 61, 94 |
| abstract_inverted_index.of | 38, 130, 143, 149, 156, 166 |
| abstract_inverted_index.on | 48, 175 |
| abstract_inverted_index.to | 25, 50, 77, 154, 163, 192 |
| abstract_inverted_index.we | 64, 187 |
| abstract_inverted_index.(in | 141 |
| abstract_inverted_index.GPT | 106 |
| abstract_inverted_index.Our | 135 |
| abstract_inverted_index.The | 20 |
| abstract_inverted_index.and | 15, 32, 107, 118, 145, 180, 183 |
| abstract_inverted_index.are | 152 |
| abstract_inverted_index.can | 68, 188 |
| abstract_inverted_index.for | 71, 133 |
| abstract_inverted_index.how | 49, 66 |
| abstract_inverted_index.not | 7 |
| abstract_inverted_index.our | 131 |
| abstract_inverted_index.set | 37 |
| abstract_inverted_index.the | 46, 58, 105, 124, 128, 139, 164 |
| abstract_inverted_index.(RS) | 2 |
| abstract_inverted_index.LLMs | 67, 76, 103, 171 |
| abstract_inverted_index.but, | 159 |
| abstract_inverted_index.code | 129 |
| abstract_inverted_index.from | 34, 45, 82, 104, 123 |
| abstract_inverted_index.into | 57 |
| abstract_inverted_index.just | 8 |
| abstract_inverted_index.many | 176 |
| abstract_inverted_index.more | 194 |
| abstract_inverted_index.most | 28 |
| abstract_inverted_index.ones | 165 |
| abstract_inverted_index.show | 65 |
| abstract_inverted_index.that | 138 |
| abstract_inverted_index.this | 62 |
| abstract_inverted_index.used | 70 |
| abstract_inverted_index.with | 90, 115 |
| abstract_inverted_index.yet, | 161 |
| abstract_inverted_index.Large | 53 |
| abstract_inverted_index.Llama | 108 |
| abstract_inverted_index.among | 147 |
| abstract_inverted_index.helps | 12 |
| abstract_inverted_index.lower | 184 |
| abstract_inverted_index.ones. | 10 |
| abstract_inverted_index.paper | 63 |
| abstract_inverted_index.soon. | 196 |
| abstract_inverted_index.tasks | 182 |
| abstract_inverted_index.terms | 142 |
| abstract_inverted_index.their | 112 |
| abstract_inverted_index.those | 155 |
| abstract_inverted_index.users | 17 |
| abstract_inverted_index.using | 86 |
| abstract_inverted_index.(LLMs) | 56 |
| abstract_inverted_index.Driven | 41 |
| abstract_inverted_index.Models | 55 |
| abstract_inverted_index.become | 193 |
| abstract_inverted_index.costs, | 146, 186 |
| abstract_inverted_index.expect | 189 |
| abstract_inverted_index.handle | 13 |
| abstract_inverted_index.larger | 36 |
| abstract_inverted_index.offers | 16 |
| abstract_inverted_index.prompt | 75, 88 |
| abstract_inverted_index.random | 116, 157 |
| abstract_inverted_index.should | 3 |
| abstract_inverted_index.Systems | 1 |
| abstract_inverted_index.because | 170 |
| abstract_inverted_index.compare | 111 |
| abstract_inverted_index.conduct | 99 |
| abstract_inverted_index.diverse | 5, 80 |
| abstract_inverted_index.exhibit | 172 |
| abstract_inverted_index.improve | 26 |
| abstract_inverted_index.methods | 24, 122 |
| abstract_inverted_index.natural | 177 |
| abstract_inverted_index.notably | 29 |
| abstract_inverted_index.others) | 148 |
| abstract_inverted_index.provide | 4 |
| abstract_inverted_index.ranking | 81, 85 |
| abstract_inverted_index.suggest | 137 |
| abstract_inverted_index.testing | 101 |
| abstract_inverted_index.various | 23, 87, 119 |
| abstract_inverted_index.However, | 169 |
| abstract_inverted_index.Language | 54 |
| abstract_inverted_index.choices. | 19 |
| abstract_inverted_index.fashion. | 97 |
| abstract_inverted_index.findings | 136 |
| abstract_inverted_index.generate | 78 |
| abstract_inverted_index.improved | 173 |
| abstract_inverted_index.inferior | 162 |
| abstract_inverted_index.insights | 44 |
| abstract_inverted_index.language | 178 |
| abstract_inverted_index.proposes | 22 |
| abstract_inverted_index.relevant | 9 |
| abstract_inverted_index.superior | 153 |
| abstract_inverted_index.Diversity | 11 |
| abstract_inverted_index.LLM-based | 150, 190 |
| abstract_inverted_index.candidate | 39, 84 |
| abstract_inverted_index.different | 91 |
| abstract_inverted_index.diversity | 72 |
| abstract_inverted_index.families. | 109 |
| abstract_inverted_index.inference | 185 |
| abstract_inverted_index.pipeline, | 60 |
| abstract_inverted_index.promising | 43 |
| abstract_inverted_index.selecting | 33 |
| abstract_inverted_index.templates | 89 |
| abstract_inverted_index.versatile | 52 |
| abstract_inverted_index.zero-shot | 96 |
| abstract_inverted_index.diversity, | 27 |
| abstract_inverted_index.literature | 21, 47 |
| abstract_inverted_index.meaningful | 18 |
| abstract_inverted_index.processing | 179 |
| abstract_inverted_index.re-rankers | 151, 158 |
| abstract_inverted_index.re-ranking | 31, 92, 113, 117, 121, 191 |
| abstract_inverted_index.trade-offs | 140 |
| abstract_inverted_index.Recommender | 0 |
| abstract_inverted_index.competitive | 195 |
| abstract_inverted_index.experiments | 100, 132 |
| abstract_inverted_index.incorporate | 51 |
| abstract_inverted_index.literature. | 125 |
| abstract_inverted_index.open-source | 127 |
| abstract_inverted_index.performance | 144, 174 |
| abstract_inverted_index.re-rankers. | 168 |
| abstract_inverted_index.re-ranking. | 73 |
| abstract_inverted_index.traditional | 120, 167 |
| abstract_inverted_index.uncertainty | 14 |
| abstract_inverted_index.capabilities | 114 |
| abstract_inverted_index.instructions | 93 |
| abstract_inverted_index.recommendation | 181 |
| abstract_inverted_index.recommendations, | 6 |
| abstract_inverted_index.recommendations. | 40 |
| abstract_inverted_index.reproducibility. | 134 |
| abstract_inverted_index.state-of-the-art | 102 |
| cited_by_percentile_year.max | 100 |
| cited_by_percentile_year.min | 97 |
| countries_distinct_count | 1 |
| institutions_distinct_count | 2 |
| citation_normalized_percentile.value | 0.99456644 |
| citation_normalized_percentile.is_in_top_1_percent | True |
| citation_normalized_percentile.is_in_top_10_percent | True |