Infusing Emotions into Task-oriented Dialogue Systems: Understanding, Management, and Generation Article Swipe
Shutong Feng
,
Hsien-chin Lin
,
Christian Geishauser
,
Nurul Lubis
,
Carel van Niekerk
,
Michael Heck
,
Benjamin Ruppik
,
Renato Vukovic
,
Milica Gašić
·
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2408.02417
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2408.02417
Emotions are indispensable in human communication, but are often overlooked in task-oriented dialogue (ToD) modelling, where the task success is the primary focus. While existing works have explored user emotions or similar concepts in some ToD tasks, none has so far included emotion modelling into a fully-fledged ToD system nor conducted interaction with human or simulated users. In this work, we incorporate emotion into the complete ToD processing loop, involving understanding, management, and generation. To this end, we extend the EmoWOZ dataset (Feng et al., 2022) with system affective behaviour labels. Through interactive experimentation involving both simulated and human users, we demonstrate that our proposed framework significantly enhances the user's emotional experience as well as the task success.
Related Topics
Concepts
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2408.02417
- https://arxiv.org/pdf/2408.02417
- OA Status
- green
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4406490396
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4406490396Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2408.02417Digital Object Identifier
- Title
-
Infusing Emotions into Task-oriented Dialogue Systems: Understanding, Management, and GenerationWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-08-05Full publication date if available
- Authors
-
Shutong Feng, Hsien-chin Lin, Christian Geishauser, Nurul Lubis, Carel van Niekerk, Michael Heck, Benjamin Ruppik, Renato Vukovic, Milica GašićList of authors in order
- Landing page
-
https://arxiv.org/abs/2408.02417Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2408.02417Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2408.02417Direct OA link when available
- Concepts
-
Task (project management), Psychology, Cognitive psychology, Process management, Cognitive science, Knowledge management, Computer science, Human–computer interaction, Business, Engineering, Systems engineeringTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4406490396 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2408.02417 |
| ids.doi | https://doi.org/10.48550/arxiv.2408.02417 |
| ids.openalex | https://openalex.org/W4406490396 |
| fwci | |
| type | preprint |
| title | Infusing Emotions into Task-oriented Dialogue Systems: Understanding, Management, and Generation |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T12031 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.8720999956130981 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1702 |
| topics[0].subfield.display_name | Artificial Intelligence |
| topics[0].display_name | Speech and dialogue systems |
| topics[1].id | https://openalex.org/T11902 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.7544999718666077 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1702 |
| topics[1].subfield.display_name | Artificial Intelligence |
| topics[1].display_name | Intelligent Tutoring Systems and Adaptive Learning |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C2780451532 |
| concepts[0].level | 2 |
| concepts[0].score | 0.6913256049156189 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q759676 |
| concepts[0].display_name | Task (project management) |
| concepts[1].id | https://openalex.org/C15744967 |
| concepts[1].level | 0 |
| concepts[1].score | 0.5056612491607666 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q9418 |
| concepts[1].display_name | Psychology |
| concepts[2].id | https://openalex.org/C180747234 |
| concepts[2].level | 1 |
| concepts[2].score | 0.484881728887558 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q23373 |
| concepts[2].display_name | Cognitive psychology |
| concepts[3].id | https://openalex.org/C195094911 |
| concepts[3].level | 1 |
| concepts[3].score | 0.396717369556427 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q14167904 |
| concepts[3].display_name | Process management |
| concepts[4].id | https://openalex.org/C188147891 |
| concepts[4].level | 1 |
| concepts[4].score | 0.3912353515625 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q147638 |
| concepts[4].display_name | Cognitive science |
| concepts[5].id | https://openalex.org/C56739046 |
| concepts[5].level | 1 |
| concepts[5].score | 0.37501800060272217 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q192060 |
| concepts[5].display_name | Knowledge management |
| concepts[6].id | https://openalex.org/C41008148 |
| concepts[6].level | 0 |
| concepts[6].score | 0.3557950258255005 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[6].display_name | Computer science |
| concepts[7].id | https://openalex.org/C107457646 |
| concepts[7].level | 1 |
| concepts[7].score | 0.3481902778148651 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q207434 |
| concepts[7].display_name | Human–computer interaction |
| concepts[8].id | https://openalex.org/C144133560 |
| concepts[8].level | 0 |
| concepts[8].score | 0.2266649603843689 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q4830453 |
| concepts[8].display_name | Business |
| concepts[9].id | https://openalex.org/C127413603 |
| concepts[9].level | 0 |
| concepts[9].score | 0.1426120400428772 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q11023 |
| concepts[9].display_name | Engineering |
| concepts[10].id | https://openalex.org/C201995342 |
| concepts[10].level | 1 |
| concepts[10].score | 0.08315896987915039 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q682496 |
| concepts[10].display_name | Systems engineering |
| keywords[0].id | https://openalex.org/keywords/task |
| keywords[0].score | 0.6913256049156189 |
| keywords[0].display_name | Task (project management) |
| keywords[1].id | https://openalex.org/keywords/psychology |
| keywords[1].score | 0.5056612491607666 |
| keywords[1].display_name | Psychology |
| keywords[2].id | https://openalex.org/keywords/cognitive-psychology |
| keywords[2].score | 0.484881728887558 |
| keywords[2].display_name | Cognitive psychology |
| keywords[3].id | https://openalex.org/keywords/process-management |
| keywords[3].score | 0.396717369556427 |
| keywords[3].display_name | Process management |
| keywords[4].id | https://openalex.org/keywords/cognitive-science |
| keywords[4].score | 0.3912353515625 |
| keywords[4].display_name | Cognitive science |
| keywords[5].id | https://openalex.org/keywords/knowledge-management |
| keywords[5].score | 0.37501800060272217 |
| keywords[5].display_name | Knowledge management |
| keywords[6].id | https://openalex.org/keywords/computer-science |
| keywords[6].score | 0.3557950258255005 |
| keywords[6].display_name | Computer science |
| keywords[7].id | https://openalex.org/keywords/human–computer-interaction |
| keywords[7].score | 0.3481902778148651 |
| keywords[7].display_name | Human–computer interaction |
| keywords[8].id | https://openalex.org/keywords/business |
| keywords[8].score | 0.2266649603843689 |
| keywords[8].display_name | Business |
| keywords[9].id | https://openalex.org/keywords/engineering |
| keywords[9].score | 0.1426120400428772 |
| keywords[9].display_name | Engineering |
| keywords[10].id | https://openalex.org/keywords/systems-engineering |
| keywords[10].score | 0.08315896987915039 |
| keywords[10].display_name | Systems engineering |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2408.02417 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | cc-by |
| locations[0].pdf_url | https://arxiv.org/pdf/2408.02417 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2408.02417 |
| locations[1].id | doi:10.48550/arxiv.2408.02417 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2408.02417 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5031650617 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-1307-4223 |
| authorships[0].author.display_name | Shutong Feng |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Feng, Shutong |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5103130759 |
| authorships[1].author.orcid | https://orcid.org/0009-0006-0027-226X |
| authorships[1].author.display_name | Hsien-chin Lin |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Lin, Hsien-chin |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5057058723 |
| authorships[2].author.orcid | https://orcid.org/0009-0004-6369-3438 |
| authorships[2].author.display_name | Christian Geishauser |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Geishauser, Christian |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5044076701 |
| authorships[3].author.orcid | https://orcid.org/0000-0002-4461-7243 |
| authorships[3].author.display_name | Nurul Lubis |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Lubis, Nurul |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5023425411 |
| authorships[4].author.orcid | https://orcid.org/0000-0002-4551-7447 |
| authorships[4].author.display_name | Carel van Niekerk |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | van Niekerk, Carel |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5015873217 |
| authorships[5].author.orcid | https://orcid.org/0000-0001-9841-5025 |
| authorships[5].author.display_name | Michael Heck |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Heck, Michael |
| authorships[5].is_corresponding | False |
| authorships[6].author.id | https://openalex.org/A5065297641 |
| authorships[6].author.orcid | https://orcid.org/0000-0001-9035-9217 |
| authorships[6].author.display_name | Benjamin Ruppik |
| authorships[6].author_position | middle |
| authorships[6].raw_author_name | Ruppik, Benjamin |
| authorships[6].is_corresponding | False |
| authorships[7].author.id | https://openalex.org/A5068337980 |
| authorships[7].author.orcid | https://orcid.org/0000-0001-6303-9402 |
| authorships[7].author.display_name | Renato Vukovic |
| authorships[7].author_position | middle |
| authorships[7].raw_author_name | Vukovic, Renato |
| authorships[7].is_corresponding | False |
| authorships[8].author.id | https://openalex.org/A5051889115 |
| authorships[8].author.orcid | https://orcid.org/0000-0003-0318-9147 |
| authorships[8].author.display_name | Milica Gašić |
| authorships[8].author_position | last |
| authorships[8].raw_author_name | Gašić, Milica |
| authorships[8].is_corresponding | False |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2408.02417 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-01-17T00:00:00 |
| display_name | Infusing Emotions into Task-oriented Dialogue Systems: Understanding, Management, and Generation |
| has_fulltext | True |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T12031 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.8720999956130981 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1702 |
| primary_topic.subfield.display_name | Artificial Intelligence |
| primary_topic.display_name | Speech and dialogue systems |
| related_works | https://openalex.org/W4389443772, https://openalex.org/W2548721895, https://openalex.org/W2373456246, https://openalex.org/W2413419736, https://openalex.org/W4238809000, https://openalex.org/W2786646446, https://openalex.org/W2312871963, https://openalex.org/W3196817267, https://openalex.org/W1976600725, https://openalex.org/W4211075255 |
| cited_by_count | 0 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2408.02417 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2408.02417 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2408.02417 |
| primary_location.id | pmh:oai:arXiv.org:2408.02417 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | cc-by |
| primary_location.pdf_url | https://arxiv.org/pdf/2408.02417 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2408.02417 |
| publication_date | 2024-08-05 |
| publication_year | 2024 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 45 |
| abstract_inverted_index.In | 57 |
| abstract_inverted_index.To | 74 |
| abstract_inverted_index.as | 112, 114 |
| abstract_inverted_index.et | 83 |
| abstract_inverted_index.in | 3, 10, 33 |
| abstract_inverted_index.is | 19 |
| abstract_inverted_index.or | 30, 54 |
| abstract_inverted_index.so | 39 |
| abstract_inverted_index.we | 60, 77, 100 |
| abstract_inverted_index.ToD | 35, 47, 66 |
| abstract_inverted_index.and | 72, 97 |
| abstract_inverted_index.are | 1, 7 |
| abstract_inverted_index.but | 6 |
| abstract_inverted_index.far | 40 |
| abstract_inverted_index.has | 38 |
| abstract_inverted_index.nor | 49 |
| abstract_inverted_index.our | 103 |
| abstract_inverted_index.the | 16, 20, 64, 79, 108, 115 |
| abstract_inverted_index.al., | 84 |
| abstract_inverted_index.both | 95 |
| abstract_inverted_index.end, | 76 |
| abstract_inverted_index.have | 26 |
| abstract_inverted_index.into | 44, 63 |
| abstract_inverted_index.none | 37 |
| abstract_inverted_index.some | 34 |
| abstract_inverted_index.task | 17, 116 |
| abstract_inverted_index.that | 102 |
| abstract_inverted_index.this | 58, 75 |
| abstract_inverted_index.user | 28 |
| abstract_inverted_index.well | 113 |
| abstract_inverted_index.with | 52, 86 |
| abstract_inverted_index.(Feng | 82 |
| abstract_inverted_index.(ToD) | 13 |
| abstract_inverted_index.2022) | 85 |
| abstract_inverted_index.While | 23 |
| abstract_inverted_index.human | 4, 53, 98 |
| abstract_inverted_index.loop, | 68 |
| abstract_inverted_index.often | 8 |
| abstract_inverted_index.where | 15 |
| abstract_inverted_index.work, | 59 |
| abstract_inverted_index.works | 25 |
| abstract_inverted_index.EmoWOZ | 80 |
| abstract_inverted_index.extend | 78 |
| abstract_inverted_index.focus. | 22 |
| abstract_inverted_index.system | 48, 87 |
| abstract_inverted_index.tasks, | 36 |
| abstract_inverted_index.user's | 109 |
| abstract_inverted_index.users, | 99 |
| abstract_inverted_index.users. | 56 |
| abstract_inverted_index.Through | 91 |
| abstract_inverted_index.dataset | 81 |
| abstract_inverted_index.emotion | 42, 62 |
| abstract_inverted_index.labels. | 90 |
| abstract_inverted_index.primary | 21 |
| abstract_inverted_index.similar | 31 |
| abstract_inverted_index.success | 18 |
| abstract_inverted_index.Emotions | 0 |
| abstract_inverted_index.complete | 65 |
| abstract_inverted_index.concepts | 32 |
| abstract_inverted_index.dialogue | 12 |
| abstract_inverted_index.emotions | 29 |
| abstract_inverted_index.enhances | 107 |
| abstract_inverted_index.existing | 24 |
| abstract_inverted_index.explored | 27 |
| abstract_inverted_index.included | 41 |
| abstract_inverted_index.proposed | 104 |
| abstract_inverted_index.success. | 117 |
| abstract_inverted_index.affective | 88 |
| abstract_inverted_index.behaviour | 89 |
| abstract_inverted_index.conducted | 50 |
| abstract_inverted_index.emotional | 110 |
| abstract_inverted_index.framework | 105 |
| abstract_inverted_index.involving | 69, 94 |
| abstract_inverted_index.modelling | 43 |
| abstract_inverted_index.simulated | 55, 96 |
| abstract_inverted_index.experience | 111 |
| abstract_inverted_index.modelling, | 14 |
| abstract_inverted_index.overlooked | 9 |
| abstract_inverted_index.processing | 67 |
| abstract_inverted_index.demonstrate | 101 |
| abstract_inverted_index.generation. | 73 |
| abstract_inverted_index.incorporate | 61 |
| abstract_inverted_index.interaction | 51 |
| abstract_inverted_index.interactive | 92 |
| abstract_inverted_index.management, | 71 |
| abstract_inverted_index.fully-fledged | 46 |
| abstract_inverted_index.indispensable | 2 |
| abstract_inverted_index.significantly | 106 |
| abstract_inverted_index.task-oriented | 11 |
| abstract_inverted_index.communication, | 5 |
| abstract_inverted_index.understanding, | 70 |
| abstract_inverted_index.experimentation | 93 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 9 |
| citation_normalized_percentile |