Think Before Recommend: Unleashing the Latent Reasoning Power for Sequential Recommendation Article Swipe
YOU?
·
· 2025
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2503.22675
Sequential Recommendation (SeqRec) aims to predict the next item by capturing sequential patterns from users' historical interactions, playing a crucial role in many real-world recommender systems. However, existing approaches predominantly adopt a direct forward computation paradigm, where the final hidden state of the sequence encoder serves as the user representation. We argue that this inference paradigm, due to its limited computational depth, struggles to model the complex evolving nature of user preferences and lacks a nuanced understanding of long-tail items, leading to suboptimal performance. To address this issue, we propose \textbf{ReaRec}, the first inference-time computing framework for recommender systems, which enhances user representations through implicit multi-step reasoning. Specifically, ReaRec autoregressively feeds the sequence's last hidden state into the sequential recommender while incorporating special reasoning position embeddings to decouple the original item encoding space from the multi-step reasoning space. Moreover, we introduce two lightweight reasoning-based learning methods, Ensemble Reasoning Learning (ERL) and Progressive Reasoning Learning (PRL), to further effectively exploit ReaRec's reasoning potential. Extensive experiments on five public real-world datasets and different SeqRec architectures demonstrate the generality and effectiveness of our proposed ReaRec. Remarkably, post-hoc analyses reveal that ReaRec significantly elevates the performance ceiling of multiple sequential recommendation backbones by approximately 30\%-50\%. Thus, we believe this work can open a new and promising avenue for future research in inference-time computing for sequential recommendation.
Related Topics
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2503.22675
- https://arxiv.org/pdf/2503.22675
- OA Status
- green
- OpenAlex ID
- https://openalex.org/W4416545260
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4416545260Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2503.22675Digital Object Identifier
- Title
-
Think Before Recommend: Unleashing the Latent Reasoning Power for Sequential RecommendationWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2025Year of publication
- Publication date
-
2025-03-28Full publication date if available
- Authors
-
Jiakai Tang, Sunhao Dai, Xu Chen, Wen Chen, Jian Wu, Yuning JiangList of authors in order
- Landing page
-
https://arxiv.org/abs/2503.22675Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2503.22675Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2503.22675Direct OA link when available
- Cited by
-
0Total citation count in OpenAlex
Full payload
| id | https://openalex.org/W4416545260 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2503.22675 |
| ids.doi | https://doi.org/10.48550/arxiv.2503.22675 |
| ids.openalex | https://openalex.org/W4416545260 |
| fwci | |
| type | preprint |
| title | Think Before Recommend: Unleashing the Latent Reasoning Power for Sequential Recommendation |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2503.22675 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2503.22675 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2503.22675 |
| locations[1].id | doi:10.48550/arxiv.2503.22675 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2503.22675 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5043446092 |
| authorships[0].author.orcid | https://orcid.org/0000-0001-9543-8889 |
| authorships[0].author.display_name | Jiakai Tang |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Tang, Jiakai |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5075518954 |
| authorships[1].author.orcid | https://orcid.org/0009-0002-7549-0860 |
| authorships[1].author.display_name | Sunhao Dai |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Dai, Sunhao |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5100385692 |
| authorships[2].author.orcid | https://orcid.org/0000-0001-9943-6020 |
| authorships[2].author.display_name | Xu Chen |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Chen, Xu |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5108684531 |
| authorships[3].author.orcid | |
| authorships[3].author.display_name | Wen Chen |
| authorships[3].author_position | last |
| authorships[3].raw_author_name | Chen, Wen |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5110701909 |
| authorships[4].author.orcid | |
| authorships[4].author.display_name | Jian Wu |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Wu, Jian |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5074655314 |
| authorships[5].author.orcid | https://orcid.org/0000-0002-7145-0995 |
| authorships[5].author.display_name | Yuning Jiang |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Jiang, Yuning |
| authorships[5].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2503.22675 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Think Before Recommend: Unleashing the Latent Reasoning Power for Sequential Recommendation |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-28T17:01:56.486321 |
| primary_topic | |
| cited_by_count | 0 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2503.22675 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2503.22675 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2503.22675 |
| primary_location.id | pmh:oai:arXiv.org:2503.22675 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2503.22675 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2503.22675 |
| publication_date | 2025-03-28 |
| publication_year | 2025 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 18, 31, 74, 208 |
| abstract_inverted_index.To | 84 |
| abstract_inverted_index.We | 50 |
| abstract_inverted_index.as | 46 |
| abstract_inverted_index.by | 9, 198 |
| abstract_inverted_index.in | 21, 216 |
| abstract_inverted_index.of | 41, 69, 77, 178, 193 |
| abstract_inverted_index.on | 164 |
| abstract_inverted_index.to | 4, 57, 63, 81, 126, 155 |
| abstract_inverted_index.we | 88, 139, 202 |
| abstract_inverted_index.and | 72, 150, 169, 176, 210 |
| abstract_inverted_index.can | 206 |
| abstract_inverted_index.due | 56 |
| abstract_inverted_index.for | 96, 213, 219 |
| abstract_inverted_index.its | 58 |
| abstract_inverted_index.new | 209 |
| abstract_inverted_index.our | 179 |
| abstract_inverted_index.the | 6, 37, 42, 47, 65, 91, 111, 117, 128, 134, 174, 190 |
| abstract_inverted_index.two | 141 |
| abstract_inverted_index.aims | 3 |
| abstract_inverted_index.five | 165 |
| abstract_inverted_index.from | 13, 133 |
| abstract_inverted_index.into | 116 |
| abstract_inverted_index.item | 8, 130 |
| abstract_inverted_index.last | 113 |
| abstract_inverted_index.many | 22 |
| abstract_inverted_index.next | 7 |
| abstract_inverted_index.open | 207 |
| abstract_inverted_index.role | 20 |
| abstract_inverted_index.that | 52, 186 |
| abstract_inverted_index.this | 53, 86, 204 |
| abstract_inverted_index.user | 48, 70, 101 |
| abstract_inverted_index.work | 205 |
| abstract_inverted_index.(ERL) | 149 |
| abstract_inverted_index.Thus, | 201 |
| abstract_inverted_index.adopt | 30 |
| abstract_inverted_index.argue | 51 |
| abstract_inverted_index.feeds | 110 |
| abstract_inverted_index.final | 38 |
| abstract_inverted_index.first | 92 |
| abstract_inverted_index.lacks | 73 |
| abstract_inverted_index.model | 64 |
| abstract_inverted_index.space | 132 |
| abstract_inverted_index.state | 40, 115 |
| abstract_inverted_index.where | 36 |
| abstract_inverted_index.which | 99 |
| abstract_inverted_index.while | 120 |
| abstract_inverted_index.(PRL), | 154 |
| abstract_inverted_index.ReaRec | 108, 187 |
| abstract_inverted_index.SeqRec | 171 |
| abstract_inverted_index.avenue | 212 |
| abstract_inverted_index.depth, | 61 |
| abstract_inverted_index.direct | 32 |
| abstract_inverted_index.future | 214 |
| abstract_inverted_index.hidden | 39, 114 |
| abstract_inverted_index.issue, | 87 |
| abstract_inverted_index.items, | 79 |
| abstract_inverted_index.nature | 68 |
| abstract_inverted_index.public | 166 |
| abstract_inverted_index.reveal | 185 |
| abstract_inverted_index.serves | 45 |
| abstract_inverted_index.space. | 137 |
| abstract_inverted_index.users' | 14 |
| abstract_inverted_index.ReaRec. | 181 |
| abstract_inverted_index.address | 85 |
| abstract_inverted_index.believe | 203 |
| abstract_inverted_index.ceiling | 192 |
| abstract_inverted_index.complex | 66 |
| abstract_inverted_index.crucial | 19 |
| abstract_inverted_index.encoder | 44 |
| abstract_inverted_index.exploit | 158 |
| abstract_inverted_index.forward | 33 |
| abstract_inverted_index.further | 156 |
| abstract_inverted_index.leading | 80 |
| abstract_inverted_index.limited | 59 |
| abstract_inverted_index.nuanced | 75 |
| abstract_inverted_index.playing | 17 |
| abstract_inverted_index.predict | 5 |
| abstract_inverted_index.propose | 89 |
| abstract_inverted_index.special | 122 |
| abstract_inverted_index.through | 103 |
| abstract_inverted_index.(SeqRec) | 2 |
| abstract_inverted_index.Ensemble | 146 |
| abstract_inverted_index.However, | 26 |
| abstract_inverted_index.Learning | 148, 153 |
| abstract_inverted_index.ReaRec's | 159 |
| abstract_inverted_index.analyses | 184 |
| abstract_inverted_index.datasets | 168 |
| abstract_inverted_index.decouple | 127 |
| abstract_inverted_index.elevates | 189 |
| abstract_inverted_index.encoding | 131 |
| abstract_inverted_index.enhances | 100 |
| abstract_inverted_index.evolving | 67 |
| abstract_inverted_index.existing | 27 |
| abstract_inverted_index.implicit | 104 |
| abstract_inverted_index.learning | 144 |
| abstract_inverted_index.methods, | 145 |
| abstract_inverted_index.multiple | 194 |
| abstract_inverted_index.original | 129 |
| abstract_inverted_index.patterns | 12 |
| abstract_inverted_index.position | 124 |
| abstract_inverted_index.post-hoc | 183 |
| abstract_inverted_index.proposed | 180 |
| abstract_inverted_index.research | 215 |
| abstract_inverted_index.sequence | 43 |
| abstract_inverted_index.systems, | 98 |
| abstract_inverted_index.systems. | 25 |
| abstract_inverted_index.Extensive | 162 |
| abstract_inverted_index.Moreover, | 138 |
| abstract_inverted_index.Reasoning | 147, 152 |
| abstract_inverted_index.backbones | 197 |
| abstract_inverted_index.capturing | 10 |
| abstract_inverted_index.computing | 94, 218 |
| abstract_inverted_index.different | 170 |
| abstract_inverted_index.framework | 95 |
| abstract_inverted_index.inference | 54 |
| abstract_inverted_index.introduce | 140 |
| abstract_inverted_index.long-tail | 78 |
| abstract_inverted_index.paradigm, | 35, 55 |
| abstract_inverted_index.promising | 211 |
| abstract_inverted_index.reasoning | 123, 136, 160 |
| abstract_inverted_index.struggles | 62 |
| abstract_inverted_index.30\%-50\%. | 200 |
| abstract_inverted_index.Sequential | 0 |
| abstract_inverted_index.approaches | 28 |
| abstract_inverted_index.embeddings | 125 |
| abstract_inverted_index.generality | 175 |
| abstract_inverted_index.historical | 15 |
| abstract_inverted_index.multi-step | 105, 135 |
| abstract_inverted_index.potential. | 161 |
| abstract_inverted_index.real-world | 23, 167 |
| abstract_inverted_index.reasoning. | 106 |
| abstract_inverted_index.sequence's | 112 |
| abstract_inverted_index.sequential | 11, 118, 195, 220 |
| abstract_inverted_index.suboptimal | 82 |
| abstract_inverted_index.Progressive | 151 |
| abstract_inverted_index.Remarkably, | 182 |
| abstract_inverted_index.computation | 34 |
| abstract_inverted_index.demonstrate | 173 |
| abstract_inverted_index.effectively | 157 |
| abstract_inverted_index.experiments | 163 |
| abstract_inverted_index.lightweight | 142 |
| abstract_inverted_index.performance | 191 |
| abstract_inverted_index.preferences | 71 |
| abstract_inverted_index.recommender | 24, 97, 119 |
| abstract_inverted_index.performance. | 83 |
| abstract_inverted_index.Specifically, | 107 |
| abstract_inverted_index.approximately | 199 |
| abstract_inverted_index.architectures | 172 |
| abstract_inverted_index.computational | 60 |
| abstract_inverted_index.effectiveness | 177 |
| abstract_inverted_index.incorporating | 121 |
| abstract_inverted_index.interactions, | 16 |
| abstract_inverted_index.predominantly | 29 |
| abstract_inverted_index.significantly | 188 |
| abstract_inverted_index.understanding | 76 |
| abstract_inverted_index.Recommendation | 1 |
| abstract_inverted_index.inference-time | 93, 217 |
| abstract_inverted_index.recommendation | 196 |
| abstract_inverted_index.reasoning-based | 143 |
| abstract_inverted_index.recommendation. | 221 |
| abstract_inverted_index.representation. | 49 |
| abstract_inverted_index.representations | 102 |
| abstract_inverted_index.\textbf{ReaRec}, | 90 |
| abstract_inverted_index.autoregressively | 109 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 6 |
| citation_normalized_percentile |