From Questions to Insightful Answers: Building an Informed Chatbot for University Resources Article Swipe
Subash Neupane
,
Elias Hossain
,
Jason M. Keith
,
Himanshu Tripathi
,
Farbod Ghiasi
,
Noorbakhsh Amiri Golilarz
,
Amin Amirlatifi
,
Sudip Mittal
,
Shahram Rahimi
·
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2405.08120
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2405.08120
This paper presents BARKPLUG V.2, a Large Language Model (LLM)-based chatbot system built using Retrieval Augmented Generation (RAG) pipelines to enhance the user experience and access to information within academic settings.The objective of BARKPLUG V.2 is to provide information to users about various campus resources, including academic departments, programs, campus facilities, and student resources at a university setting in an interactive fashion. Our system leverages university data as an external data corpus and ingests it into our RAG pipelines for domain-specific question-answering tasks. We evaluate the effectiveness of our system in generating accurate and pertinent responses for Mississippi State University, as a case study, using quantitative measures, employing frameworks such as Retrieval Augmented Generation Assessment(RAGAS). Furthermore, we evaluate the usability of this system via subjective satisfaction surveys using the System Usability Scale (SUS). Our system demonstrates impressive quantitative performance, with a mean RAGAS score of 0.96, and experience, as validated by usability assessments.
Related Topics
Concepts
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2405.08120
- https://arxiv.org/pdf/2405.08120
- OA Status
- green
- Cited By
- 3
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4396945301
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4396945301Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2405.08120Digital Object Identifier
- Title
-
From Questions to Insightful Answers: Building an Informed Chatbot for University ResourcesWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-05-13Full publication date if available
- Authors
-
Subash Neupane, Elias Hossain, Jason M. Keith, Himanshu Tripathi, Farbod Ghiasi, Noorbakhsh Amiri Golilarz, Amin Amirlatifi, Sudip Mittal, Shahram RahimiList of authors in order
- Landing page
-
https://arxiv.org/abs/2405.08120Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2405.08120Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2405.08120Direct OA link when available
- Concepts
-
Chatbot, Computer science, Psychology, Engineering ethics, Sociology, World Wide Web, EngineeringTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
3Total citation count in OpenAlex
- Citations by year (recent)
-
2024: 3Per-year citation counts (last 5 years)
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4396945301 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2405.08120 |
| ids.doi | https://doi.org/10.48550/arxiv.2405.08120 |
| ids.openalex | https://openalex.org/W4396945301 |
| fwci | |
| type | preprint |
| title | From Questions to Insightful Answers: Building an Informed Chatbot for University Resources |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T12128 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.989300012588501 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1702 |
| topics[0].subfield.display_name | Artificial Intelligence |
| topics[0].display_name | AI in Service Interactions |
| topics[1].id | https://openalex.org/T11995 |
| topics[1].field.id | https://openalex.org/fields/14 |
| topics[1].field.display_name | Business, Management and Accounting |
| topics[1].score | 0.9474999904632568 |
| topics[1].domain.id | https://openalex.org/domains/2 |
| topics[1].domain.display_name | Social Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1404 |
| topics[1].subfield.display_name | Management Information Systems |
| topics[1].display_name | FinTech, Crowdfunding, Digital Finance |
| topics[2].id | https://openalex.org/T14246 |
| topics[2].field.id | https://openalex.org/fields/17 |
| topics[2].field.display_name | Computer Science |
| topics[2].score | 0.9401999711990356 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1706 |
| topics[2].subfield.display_name | Computer Science Applications |
| topics[2].display_name | E-Learning and Knowledge Management |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C2779041454 |
| concepts[0].level | 2 |
| concepts[0].score | 0.9033383131027222 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q870780 |
| concepts[0].display_name | Chatbot |
| concepts[1].id | https://openalex.org/C41008148 |
| concepts[1].level | 0 |
| concepts[1].score | 0.35985302925109863 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[1].display_name | Computer science |
| concepts[2].id | https://openalex.org/C15744967 |
| concepts[2].level | 0 |
| concepts[2].score | 0.35870179533958435 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q9418 |
| concepts[2].display_name | Psychology |
| concepts[3].id | https://openalex.org/C55587333 |
| concepts[3].level | 1 |
| concepts[3].score | 0.3355292081832886 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q1133029 |
| concepts[3].display_name | Engineering ethics |
| concepts[4].id | https://openalex.org/C144024400 |
| concepts[4].level | 0 |
| concepts[4].score | 0.3269524872303009 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q21201 |
| concepts[4].display_name | Sociology |
| concepts[5].id | https://openalex.org/C136764020 |
| concepts[5].level | 1 |
| concepts[5].score | 0.28077274560928345 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q466 |
| concepts[5].display_name | World Wide Web |
| concepts[6].id | https://openalex.org/C127413603 |
| concepts[6].level | 0 |
| concepts[6].score | 0.2213234305381775 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q11023 |
| concepts[6].display_name | Engineering |
| keywords[0].id | https://openalex.org/keywords/chatbot |
| keywords[0].score | 0.9033383131027222 |
| keywords[0].display_name | Chatbot |
| keywords[1].id | https://openalex.org/keywords/computer-science |
| keywords[1].score | 0.35985302925109863 |
| keywords[1].display_name | Computer science |
| keywords[2].id | https://openalex.org/keywords/psychology |
| keywords[2].score | 0.35870179533958435 |
| keywords[2].display_name | Psychology |
| keywords[3].id | https://openalex.org/keywords/engineering-ethics |
| keywords[3].score | 0.3355292081832886 |
| keywords[3].display_name | Engineering ethics |
| keywords[4].id | https://openalex.org/keywords/sociology |
| keywords[4].score | 0.3269524872303009 |
| keywords[4].display_name | Sociology |
| keywords[5].id | https://openalex.org/keywords/world-wide-web |
| keywords[5].score | 0.28077274560928345 |
| keywords[5].display_name | World Wide Web |
| keywords[6].id | https://openalex.org/keywords/engineering |
| keywords[6].score | 0.2213234305381775 |
| keywords[6].display_name | Engineering |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2405.08120 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | cc-by |
| locations[0].pdf_url | https://arxiv.org/pdf/2405.08120 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2405.08120 |
| locations[1].id | doi:10.48550/arxiv.2405.08120 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | cc-by |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | https://openalex.org/licenses/cc-by |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2405.08120 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5083240694 |
| authorships[0].author.orcid | https://orcid.org/0000-0001-9260-3914 |
| authorships[0].author.display_name | Subash Neupane |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Neupane, Subash |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5111197082 |
| authorships[1].author.orcid | |
| authorships[1].author.display_name | Elias Hossain |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Hossain, Elias |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5063737534 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-5292-397X |
| authorships[2].author.display_name | Jason M. Keith |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Keith, Jason |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5098625349 |
| authorships[3].author.orcid | |
| authorships[3].author.display_name | Himanshu Tripathi |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Tripathi, Himanshu |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5068518265 |
| authorships[4].author.orcid | |
| authorships[4].author.display_name | Farbod Ghiasi |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Ghiasi, Farbod |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5034612249 |
| authorships[5].author.orcid | https://orcid.org/0000-0003-2676-989X |
| authorships[5].author.display_name | Noorbakhsh Amiri Golilarz |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Golilarz, Noorbakhsh Amiri |
| authorships[5].is_corresponding | False |
| authorships[6].author.id | https://openalex.org/A5011806403 |
| authorships[6].author.orcid | https://orcid.org/0000-0002-2225-2087 |
| authorships[6].author.display_name | Amin Amirlatifi |
| authorships[6].author_position | middle |
| authorships[6].raw_author_name | Amirlatifi, Amin |
| authorships[6].is_corresponding | False |
| authorships[7].author.id | https://openalex.org/A5074949168 |
| authorships[7].author.orcid | https://orcid.org/0000-0001-9151-8347 |
| authorships[7].author.display_name | Sudip Mittal |
| authorships[7].author_position | middle |
| authorships[7].raw_author_name | Mittal, Sudip |
| authorships[7].is_corresponding | False |
| authorships[8].author.id | https://openalex.org/A5009452693 |
| authorships[8].author.orcid | https://orcid.org/0000-0003-2779-0076 |
| authorships[8].author.display_name | Shahram Rahimi |
| authorships[8].author_position | last |
| authorships[8].raw_author_name | Rahimi, Shahram |
| authorships[8].is_corresponding | False |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2405.08120 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2024-05-16T00:00:00 |
| display_name | From Questions to Insightful Answers: Building an Informed Chatbot for University Resources |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T12128 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.989300012588501 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1702 |
| primary_topic.subfield.display_name | Artificial Intelligence |
| primary_topic.display_name | AI in Service Interactions |
| related_works | https://openalex.org/W4391375266, https://openalex.org/W2748952813, https://openalex.org/W4383501580, https://openalex.org/W4214931137, https://openalex.org/W4387007686, https://openalex.org/W4313813117, https://openalex.org/W4382052417, https://openalex.org/W3192088754, https://openalex.org/W3084631705, https://openalex.org/W3176146353 |
| cited_by_count | 3 |
| counts_by_year[0].year | 2024 |
| counts_by_year[0].cited_by_count | 3 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2405.08120 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2405.08120 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2405.08120 |
| primary_location.id | pmh:oai:arXiv.org:2405.08120 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | cc-by |
| primary_location.pdf_url | https://arxiv.org/pdf/2405.08120 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2405.08120 |
| publication_date | 2024-05-13 |
| publication_year | 2024 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 5, 55, 101, 140 |
| abstract_inverted_index.We | 83 |
| abstract_inverted_index.an | 59, 68 |
| abstract_inverted_index.as | 67, 100, 110, 148 |
| abstract_inverted_index.at | 54 |
| abstract_inverted_index.by | 150 |
| abstract_inverted_index.in | 58, 90 |
| abstract_inverted_index.is | 35 |
| abstract_inverted_index.it | 74 |
| abstract_inverted_index.of | 32, 87, 120, 144 |
| abstract_inverted_index.to | 19, 26, 36, 39 |
| abstract_inverted_index.we | 116 |
| abstract_inverted_index.Our | 62, 133 |
| abstract_inverted_index.RAG | 77 |
| abstract_inverted_index.V.2 | 34 |
| abstract_inverted_index.and | 24, 51, 72, 93, 146 |
| abstract_inverted_index.for | 79, 96 |
| abstract_inverted_index.our | 76, 88 |
| abstract_inverted_index.the | 21, 85, 118, 128 |
| abstract_inverted_index.via | 123 |
| abstract_inverted_index.This | 0 |
| abstract_inverted_index.V.2, | 4 |
| abstract_inverted_index.case | 102 |
| abstract_inverted_index.data | 66, 70 |
| abstract_inverted_index.into | 75 |
| abstract_inverted_index.mean | 141 |
| abstract_inverted_index.such | 109 |
| abstract_inverted_index.this | 121 |
| abstract_inverted_index.user | 22 |
| abstract_inverted_index.with | 139 |
| abstract_inverted_index.(RAG) | 17 |
| abstract_inverted_index.0.96, | 145 |
| abstract_inverted_index.Large | 6 |
| abstract_inverted_index.Model | 8 |
| abstract_inverted_index.RAGAS | 142 |
| abstract_inverted_index.Scale | 131 |
| abstract_inverted_index.State | 98 |
| abstract_inverted_index.about | 41 |
| abstract_inverted_index.built | 12 |
| abstract_inverted_index.paper | 1 |
| abstract_inverted_index.score | 143 |
| abstract_inverted_index.users | 40 |
| abstract_inverted_index.using | 13, 104, 127 |
| abstract_inverted_index.(SUS). | 132 |
| abstract_inverted_index.System | 129 |
| abstract_inverted_index.access | 25 |
| abstract_inverted_index.campus | 43, 49 |
| abstract_inverted_index.corpus | 71 |
| abstract_inverted_index.study, | 103 |
| abstract_inverted_index.system | 11, 63, 89, 122, 134 |
| abstract_inverted_index.tasks. | 82 |
| abstract_inverted_index.within | 28 |
| abstract_inverted_index.chatbot | 10 |
| abstract_inverted_index.enhance | 20 |
| abstract_inverted_index.ingests | 73 |
| abstract_inverted_index.provide | 37 |
| abstract_inverted_index.setting | 57 |
| abstract_inverted_index.student | 52 |
| abstract_inverted_index.surveys | 126 |
| abstract_inverted_index.various | 42 |
| abstract_inverted_index.BARKPLUG | 3, 33 |
| abstract_inverted_index.Language | 7 |
| abstract_inverted_index.academic | 29, 46 |
| abstract_inverted_index.accurate | 92 |
| abstract_inverted_index.evaluate | 84, 117 |
| abstract_inverted_index.external | 69 |
| abstract_inverted_index.fashion. | 61 |
| abstract_inverted_index.presents | 2 |
| abstract_inverted_index.Augmented | 15, 112 |
| abstract_inverted_index.Retrieval | 14, 111 |
| abstract_inverted_index.Usability | 130 |
| abstract_inverted_index.employing | 107 |
| abstract_inverted_index.including | 45 |
| abstract_inverted_index.leverages | 64 |
| abstract_inverted_index.measures, | 106 |
| abstract_inverted_index.objective | 31 |
| abstract_inverted_index.pertinent | 94 |
| abstract_inverted_index.pipelines | 18, 78 |
| abstract_inverted_index.programs, | 48 |
| abstract_inverted_index.resources | 53 |
| abstract_inverted_index.responses | 95 |
| abstract_inverted_index.usability | 119, 151 |
| abstract_inverted_index.validated | 149 |
| abstract_inverted_index.Generation | 16, 113 |
| abstract_inverted_index.experience | 23 |
| abstract_inverted_index.frameworks | 108 |
| abstract_inverted_index.generating | 91 |
| abstract_inverted_index.impressive | 136 |
| abstract_inverted_index.resources, | 44 |
| abstract_inverted_index.subjective | 124 |
| abstract_inverted_index.university | 56, 65 |
| abstract_inverted_index.(LLM)-based | 9 |
| abstract_inverted_index.Mississippi | 97 |
| abstract_inverted_index.University, | 99 |
| abstract_inverted_index.experience, | 147 |
| abstract_inverted_index.facilities, | 50 |
| abstract_inverted_index.information | 27, 38 |
| abstract_inverted_index.interactive | 60 |
| abstract_inverted_index.Furthermore, | 115 |
| abstract_inverted_index.assessments. | 152 |
| abstract_inverted_index.demonstrates | 135 |
| abstract_inverted_index.departments, | 47 |
| abstract_inverted_index.performance, | 138 |
| abstract_inverted_index.quantitative | 105, 137 |
| abstract_inverted_index.satisfaction | 125 |
| abstract_inverted_index.settings.The | 30 |
| abstract_inverted_index.effectiveness | 86 |
| abstract_inverted_index.domain-specific | 80 |
| abstract_inverted_index.Assessment(RAGAS). | 114 |
| abstract_inverted_index.question-answering | 81 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 9 |
| citation_normalized_percentile |