Can we only use guideline instead of shot in prompt? Article Swipe
Jiaxiang Chen
,
Song Wang
,
Zhigang Li
,
Wayne Xiong
,
Lizhen Qu
,
Zenglin Xu
,
Qi Yuan
·
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2409.12979
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2409.12979
Currently, prompting techniques can be mainly divided into two categories:1)shot method implicitly inspires the model to answer the question by mimicing the steps in the given example, e.g., the few-shot CoT. 2) Guideline method explicitly instructs the model to reason by following guidelines, which contains succinct and concise task-specific knowledge. Shot method is prone to difficulties in terms of selection of shots type, the number of shots, and the design of the reasoning steps, so a question arises: can we only use guideline instead of shot in the prompt? To this end, we propose the FGT framework to automatically learn task-specific guidelines from dataset consisting of Feedback, Guideline, and Tree-gather agents. First, the feedback agent is designed to evaluate the outcomes, both right and wrong, of each Q&A to gather insights guiding more effective optimization strategies. Next, the guideline agent is tasked with deriving guidelines from each piece of feedback and storing them in local memory. Lastly, the tree-gather agent aggregates all guidelines hierarchically through a tree structure, ultimately obtaining all unduplicated guidelines from a global perspective. In addition, we induce the model to generate intermediate processes to ensure the reasoning consistent with the guidelines. Experimental results demonstrate that our approach achieves superior performance across multiple tasks, thereby highlighting the effectiveness of using the guidelines in prompt.
Related Topics
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2409.12979
- https://arxiv.org/pdf/2409.12979
- OA Status
- green
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4403713531
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4403713531Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2409.12979Digital Object Identifier
- Title
-
Can we only use guideline instead of shot in prompt?Work title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-09-03Full publication date if available
- Authors
-
Jiaxiang Chen, Song Wang, Zhigang Li, Wayne Xiong, Lizhen Qu, Zenglin Xu, Qi YuanList of authors in order
- Landing page
-
https://arxiv.org/abs/2409.12979Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2409.12979Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2409.12979Direct OA link when available
- Concepts
-
Guideline, Shot (pellet), Medicine, Computer science, Chemistry, Pathology, Organic chemistryTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4403713531 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2409.12979 |
| ids.doi | https://doi.org/10.48550/arxiv.2409.12979 |
| ids.openalex | https://openalex.org/W4403713531 |
| fwci | |
| type | preprint |
| title | Can we only use guideline instead of shot in prompt? |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T12664 |
| topics[0].field.id | https://openalex.org/fields/27 |
| topics[0].field.display_name | Medicine |
| topics[0].score | 0.9983999729156494 |
| topics[0].domain.id | https://openalex.org/domains/4 |
| topics[0].domain.display_name | Health Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/2739 |
| topics[0].subfield.display_name | Public Health, Environmental and Occupational Health |
| topics[0].display_name | Clinical practice guidelines implementation |
| topics[1].id | https://openalex.org/T11930 |
| topics[1].field.id | https://openalex.org/fields/27 |
| topics[1].field.display_name | Medicine |
| topics[1].score | 0.9779999852180481 |
| topics[1].domain.id | https://openalex.org/domains/4 |
| topics[1].domain.display_name | Health Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/2705 |
| topics[1].subfield.display_name | Cardiology and Cardiovascular Medicine |
| topics[1].display_name | Cardiac, Anesthesia and Surgical Outcomes |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C2780182762 |
| concepts[0].level | 2 |
| concepts[0].score | 0.7858289480209351 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q1630279 |
| concepts[0].display_name | Guideline |
| concepts[1].id | https://openalex.org/C2778344882 |
| concepts[1].level | 2 |
| concepts[1].score | 0.6931724548339844 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q278938 |
| concepts[1].display_name | Shot (pellet) |
| concepts[2].id | https://openalex.org/C71924100 |
| concepts[2].level | 0 |
| concepts[2].score | 0.35864782333374023 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q11190 |
| concepts[2].display_name | Medicine |
| concepts[3].id | https://openalex.org/C41008148 |
| concepts[3].level | 0 |
| concepts[3].score | 0.3223005533218384 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[3].display_name | Computer science |
| concepts[4].id | https://openalex.org/C185592680 |
| concepts[4].level | 0 |
| concepts[4].score | 0.15268030762672424 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q2329 |
| concepts[4].display_name | Chemistry |
| concepts[5].id | https://openalex.org/C142724271 |
| concepts[5].level | 1 |
| concepts[5].score | 0.0552840530872345 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q7208 |
| concepts[5].display_name | Pathology |
| concepts[6].id | https://openalex.org/C178790620 |
| concepts[6].level | 1 |
| concepts[6].score | 0.0 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q11351 |
| concepts[6].display_name | Organic chemistry |
| keywords[0].id | https://openalex.org/keywords/guideline |
| keywords[0].score | 0.7858289480209351 |
| keywords[0].display_name | Guideline |
| keywords[1].id | https://openalex.org/keywords/shot |
| keywords[1].score | 0.6931724548339844 |
| keywords[1].display_name | Shot (pellet) |
| keywords[2].id | https://openalex.org/keywords/medicine |
| keywords[2].score | 0.35864782333374023 |
| keywords[2].display_name | Medicine |
| keywords[3].id | https://openalex.org/keywords/computer-science |
| keywords[3].score | 0.3223005533218384 |
| keywords[3].display_name | Computer science |
| keywords[4].id | https://openalex.org/keywords/chemistry |
| keywords[4].score | 0.15268030762672424 |
| keywords[4].display_name | Chemistry |
| keywords[5].id | https://openalex.org/keywords/pathology |
| keywords[5].score | 0.0552840530872345 |
| keywords[5].display_name | Pathology |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2409.12979 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2409.12979 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2409.12979 |
| locations[1].id | doi:10.48550/arxiv.2409.12979 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2409.12979 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5114831692 |
| authorships[0].author.orcid | |
| authorships[0].author.display_name | Jiaxiang Chen |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Chen, Jiaxiang |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5082259804 |
| authorships[1].author.orcid | https://orcid.org/0000-0003-4152-5295 |
| authorships[1].author.display_name | Song Wang |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Wang, Song |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5100363797 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-1324-0893 |
| authorships[2].author.display_name | Zhigang Li |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Li, Zhucong |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5114389206 |
| authorships[3].author.orcid | |
| authorships[3].author.display_name | Wayne Xiong |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Xiong, Wayne |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5008486397 |
| authorships[4].author.orcid | https://orcid.org/0000-0002-7764-431X |
| authorships[4].author.display_name | Lizhen Qu |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Qu, Lizhen |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5051227924 |
| authorships[5].author.orcid | https://orcid.org/0000-0001-5550-6461 |
| authorships[5].author.display_name | Zenglin Xu |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Xu, Zenglin |
| authorships[5].is_corresponding | False |
| authorships[6].author.id | https://openalex.org/A5100676882 |
| authorships[6].author.orcid | https://orcid.org/0000-0001-7806-4651 |
| authorships[6].author.display_name | Qi Yuan |
| authorships[6].author_position | last |
| authorships[6].raw_author_name | Qi, Yuan |
| authorships[6].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2409.12979 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Can we only use guideline instead of shot in prompt? |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T12664 |
| primary_topic.field.id | https://openalex.org/fields/27 |
| primary_topic.field.display_name | Medicine |
| primary_topic.score | 0.9983999729156494 |
| primary_topic.domain.id | https://openalex.org/domains/4 |
| primary_topic.domain.display_name | Health Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/2739 |
| primary_topic.subfield.display_name | Public Health, Environmental and Occupational Health |
| primary_topic.display_name | Clinical practice guidelines implementation |
| related_works | https://openalex.org/W4391375266, https://openalex.org/W2899084033, https://openalex.org/W2748952813, https://openalex.org/W3031052312, https://openalex.org/W4389568370, https://openalex.org/W3032375762, https://openalex.org/W1995515455, https://openalex.org/W2080531066, https://openalex.org/W3108674512, https://openalex.org/W1506200166 |
| cited_by_count | 0 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2409.12979 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2409.12979 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2409.12979 |
| primary_location.id | pmh:oai:arXiv.org:2409.12979 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2409.12979 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2409.12979 |
| publication_date | 2024-09-03 |
| publication_year | 2024 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 75, 165, 174 |
| abstract_inverted_index.2) | 31 |
| abstract_inverted_index.In | 177 |
| abstract_inverted_index.To | 89 |
| abstract_inverted_index.be | 4 |
| abstract_inverted_index.by | 19, 40 |
| abstract_inverted_index.in | 23, 56, 86, 153, 215 |
| abstract_inverted_index.is | 52, 115, 140 |
| abstract_inverted_index.of | 58, 60, 65, 70, 84, 105, 125, 148, 211 |
| abstract_inverted_index.so | 74 |
| abstract_inverted_index.to | 15, 38, 54, 97, 117, 128, 183, 187 |
| abstract_inverted_index.we | 79, 92, 179 |
| abstract_inverted_index.FGT | 95 |
| abstract_inverted_index.all | 161, 170 |
| abstract_inverted_index.and | 46, 67, 108, 123, 150 |
| abstract_inverted_index.can | 3, 78 |
| abstract_inverted_index.our | 199 |
| abstract_inverted_index.the | 13, 17, 21, 24, 28, 36, 63, 68, 71, 87, 94, 112, 119, 137, 157, 181, 189, 193, 209, 213 |
| abstract_inverted_index.two | 8 |
| abstract_inverted_index.use | 81 |
| abstract_inverted_index.CoT. | 30 |
| abstract_inverted_index.Shot | 50 |
| abstract_inverted_index.both | 121 |
| abstract_inverted_index.each | 126, 146 |
| abstract_inverted_index.end, | 91 |
| abstract_inverted_index.from | 102, 145, 173 |
| abstract_inverted_index.into | 7 |
| abstract_inverted_index.more | 132 |
| abstract_inverted_index.only | 80 |
| abstract_inverted_index.shot | 85 |
| abstract_inverted_index.that | 198 |
| abstract_inverted_index.them | 152 |
| abstract_inverted_index.this | 90 |
| abstract_inverted_index.tree | 166 |
| abstract_inverted_index.with | 142, 192 |
| abstract_inverted_index.Next, | 136 |
| abstract_inverted_index.agent | 114, 139, 159 |
| abstract_inverted_index.e.g., | 27 |
| abstract_inverted_index.given | 25 |
| abstract_inverted_index.learn | 99 |
| abstract_inverted_index.local | 154 |
| abstract_inverted_index.model | 14, 37, 182 |
| abstract_inverted_index.piece | 147 |
| abstract_inverted_index.prone | 53 |
| abstract_inverted_index.right | 122 |
| abstract_inverted_index.shots | 61 |
| abstract_inverted_index.steps | 22 |
| abstract_inverted_index.terms | 57 |
| abstract_inverted_index.type, | 62 |
| abstract_inverted_index.using | 212 |
| abstract_inverted_index.which | 43 |
| abstract_inverted_index.First, | 111 |
| abstract_inverted_index.across | 204 |
| abstract_inverted_index.answer | 16 |
| abstract_inverted_index.design | 69 |
| abstract_inverted_index.ensure | 188 |
| abstract_inverted_index.gather | 129 |
| abstract_inverted_index.global | 175 |
| abstract_inverted_index.induce | 180 |
| abstract_inverted_index.mainly | 5 |
| abstract_inverted_index.method | 10, 33, 51 |
| abstract_inverted_index.number | 64 |
| abstract_inverted_index.reason | 39 |
| abstract_inverted_index.shots, | 66 |
| abstract_inverted_index.steps, | 73 |
| abstract_inverted_index.tasked | 141 |
| abstract_inverted_index.tasks, | 206 |
| abstract_inverted_index.wrong, | 124 |
| abstract_inverted_index.Lastly, | 156 |
| abstract_inverted_index.Q&A | 127 |
| abstract_inverted_index.agents. | 110 |
| abstract_inverted_index.arises: | 77 |
| abstract_inverted_index.concise | 47 |
| abstract_inverted_index.dataset | 103 |
| abstract_inverted_index.divided | 6 |
| abstract_inverted_index.guiding | 131 |
| abstract_inverted_index.instead | 83 |
| abstract_inverted_index.memory. | 155 |
| abstract_inverted_index.prompt. | 216 |
| abstract_inverted_index.prompt? | 88 |
| abstract_inverted_index.propose | 93 |
| abstract_inverted_index.results | 196 |
| abstract_inverted_index.storing | 151 |
| abstract_inverted_index.thereby | 207 |
| abstract_inverted_index.through | 164 |
| abstract_inverted_index.achieves | 201 |
| abstract_inverted_index.approach | 200 |
| abstract_inverted_index.contains | 44 |
| abstract_inverted_index.deriving | 143 |
| abstract_inverted_index.designed | 116 |
| abstract_inverted_index.evaluate | 118 |
| abstract_inverted_index.example, | 26 |
| abstract_inverted_index.feedback | 113, 149 |
| abstract_inverted_index.few-shot | 29 |
| abstract_inverted_index.generate | 184 |
| abstract_inverted_index.insights | 130 |
| abstract_inverted_index.inspires | 12 |
| abstract_inverted_index.mimicing | 20 |
| abstract_inverted_index.multiple | 205 |
| abstract_inverted_index.question | 18, 76 |
| abstract_inverted_index.succinct | 45 |
| abstract_inverted_index.superior | 202 |
| abstract_inverted_index.Feedback, | 106 |
| abstract_inverted_index.Guideline | 32 |
| abstract_inverted_index.addition, | 178 |
| abstract_inverted_index.effective | 133 |
| abstract_inverted_index.following | 41 |
| abstract_inverted_index.framework | 96 |
| abstract_inverted_index.guideline | 82, 138 |
| abstract_inverted_index.instructs | 35 |
| abstract_inverted_index.obtaining | 169 |
| abstract_inverted_index.outcomes, | 120 |
| abstract_inverted_index.processes | 186 |
| abstract_inverted_index.prompting | 1 |
| abstract_inverted_index.reasoning | 72, 190 |
| abstract_inverted_index.selection | 59 |
| abstract_inverted_index.Currently, | 0 |
| abstract_inverted_index.Guideline, | 107 |
| abstract_inverted_index.aggregates | 160 |
| abstract_inverted_index.consistent | 191 |
| abstract_inverted_index.consisting | 104 |
| abstract_inverted_index.explicitly | 34 |
| abstract_inverted_index.guidelines | 101, 144, 162, 172, 214 |
| abstract_inverted_index.implicitly | 11 |
| abstract_inverted_index.knowledge. | 49 |
| abstract_inverted_index.structure, | 167 |
| abstract_inverted_index.techniques | 2 |
| abstract_inverted_index.ultimately | 168 |
| abstract_inverted_index.Tree-gather | 109 |
| abstract_inverted_index.demonstrate | 197 |
| abstract_inverted_index.guidelines, | 42 |
| abstract_inverted_index.guidelines. | 194 |
| abstract_inverted_index.performance | 203 |
| abstract_inverted_index.strategies. | 135 |
| abstract_inverted_index.tree-gather | 158 |
| abstract_inverted_index.Experimental | 195 |
| abstract_inverted_index.difficulties | 55 |
| abstract_inverted_index.highlighting | 208 |
| abstract_inverted_index.intermediate | 185 |
| abstract_inverted_index.optimization | 134 |
| abstract_inverted_index.perspective. | 176 |
| abstract_inverted_index.unduplicated | 171 |
| abstract_inverted_index.automatically | 98 |
| abstract_inverted_index.effectiveness | 210 |
| abstract_inverted_index.task-specific | 48, 100 |
| abstract_inverted_index.hierarchically | 163 |
| abstract_inverted_index.categories:1)shot | 9 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 7 |
| citation_normalized_percentile |