Temporal Label Hierachical Network for Compound Emotion Recognition Article Swipe
Sunan Li
,
Hailun Lian
,
Cheng Lu
,
Yan Zhao
,
Tianhua Qi
,
Hao Yang
,
Yuan Zong
,
Wenming Zheng
·
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2407.12973
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2407.12973
The emotion recognition has attracted more attention in recent decades. Although significant progress has been made in the recognition technology of the seven basic emotions, existing methods are still hard to tackle compound emotion recognition that occurred commonly in practical application. This article introduces our achievements in the 7th Field Emotion Behavior Analysis (ABAW) competition. In the competition, we selected pre trained ResNet18 and Transformer, which have been widely validated, as the basic network framework. Considering the continuity of emotions over time, we propose a time pyramid structure network for frame level emotion prediction. Furthermore. At the same time, in order to address the lack of data in composite emotion recognition, we utilized fine-grained labels from the DFEW database to construct training data for emotion categories in competitions. Taking into account the characteristics of valence arousal of various complex emotions, we constructed a classification framework from coarse to fine in the label space.
Related Topics
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2407.12973
- https://arxiv.org/pdf/2407.12973
- OA Status
- green
- Cited By
- 1
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4406058602
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4406058602Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2407.12973Digital Object Identifier
- Title
-
Temporal Label Hierachical Network for Compound Emotion RecognitionWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-07-17Full publication date if available
- Authors
-
Sunan Li, Hailun Lian, Cheng Lu, Yan Zhao, Tianhua Qi, Hao Yang, Yuan Zong, Wenming ZhengList of authors in order
- Landing page
-
https://arxiv.org/abs/2407.12973Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2407.12973Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2407.12973Direct OA link when available
- Concepts
-
Artificial intelligence, Computer science, PsychologyTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
1Total citation count in OpenAlex
- Citations by year (recent)
-
2025: 1Per-year citation counts (last 5 years)
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4406058602 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2407.12973 |
| ids.doi | https://doi.org/10.48550/arxiv.2407.12973 |
| ids.openalex | https://openalex.org/W4406058602 |
| fwci | |
| type | preprint |
| title | Temporal Label Hierachical Network for Compound Emotion Recognition |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T10667 |
| topics[0].field.id | https://openalex.org/fields/32 |
| topics[0].field.display_name | Psychology |
| topics[0].score | 0.942300021648407 |
| topics[0].domain.id | https://openalex.org/domains/2 |
| topics[0].domain.display_name | Social Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/3205 |
| topics[0].subfield.display_name | Experimental and Cognitive Psychology |
| topics[0].display_name | Emotion and Mood Recognition |
| topics[1].id | https://openalex.org/T11439 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9045000076293945 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1707 |
| topics[1].subfield.display_name | Computer Vision and Pattern Recognition |
| topics[1].display_name | Video Analysis and Summarization |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C154945302 |
| concepts[0].level | 1 |
| concepts[0].score | 0.42516791820526123 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[0].display_name | Artificial intelligence |
| concepts[1].id | https://openalex.org/C41008148 |
| concepts[1].level | 0 |
| concepts[1].score | 0.38303351402282715 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[1].display_name | Computer science |
| concepts[2].id | https://openalex.org/C15744967 |
| concepts[2].level | 0 |
| concepts[2].score | 0.37824511528015137 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q9418 |
| concepts[2].display_name | Psychology |
| keywords[0].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[0].score | 0.42516791820526123 |
| keywords[0].display_name | Artificial intelligence |
| keywords[1].id | https://openalex.org/keywords/computer-science |
| keywords[1].score | 0.38303351402282715 |
| keywords[1].display_name | Computer science |
| keywords[2].id | https://openalex.org/keywords/psychology |
| keywords[2].score | 0.37824511528015137 |
| keywords[2].display_name | Psychology |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2407.12973 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2407.12973 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2407.12973 |
| locations[1].id | doi:10.48550/arxiv.2407.12973 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | cc-by |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | https://openalex.org/licenses/cc-by |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2407.12973 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5114859532 |
| authorships[0].author.orcid | https://orcid.org/0000-0003-1494-4873 |
| authorships[0].author.display_name | Sunan Li |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Li, Sunan |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5091060125 |
| authorships[1].author.orcid | https://orcid.org/0000-0002-1355-9503 |
| authorships[1].author.display_name | Hailun Lian |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Lian, Hailun |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5024288211 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-7651-3924 |
| authorships[2].author.display_name | Cheng Lu |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Lu, Cheng |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5060365518 |
| authorships[3].author.orcid | https://orcid.org/0000-0002-0242-3707 |
| authorships[3].author.display_name | Yan Zhao |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Zhao, Yan |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5040782290 |
| authorships[4].author.orcid | https://orcid.org/0009-0005-5780-9374 |
| authorships[4].author.display_name | Tianhua Qi |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Qi, Tianhua |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5101861496 |
| authorships[5].author.orcid | https://orcid.org/0000-0002-8112-0869 |
| authorships[5].author.display_name | Hao Yang |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Yang, Hao |
| authorships[5].is_corresponding | False |
| authorships[6].author.id | https://openalex.org/A5027316177 |
| authorships[6].author.orcid | https://orcid.org/0000-0002-0839-8792 |
| authorships[6].author.display_name | Yuan Zong |
| authorships[6].author_position | middle |
| authorships[6].raw_author_name | Zong, Yuan |
| authorships[6].is_corresponding | False |
| authorships[7].author.id | https://openalex.org/A5029771864 |
| authorships[7].author.orcid | https://orcid.org/0000-0002-7764-5179 |
| authorships[7].author.display_name | Wenming Zheng |
| authorships[7].author_position | last |
| authorships[7].raw_author_name | Zheng, Wenming |
| authorships[7].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2407.12973 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Temporal Label Hierachical Network for Compound Emotion Recognition |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T10667 |
| primary_topic.field.id | https://openalex.org/fields/32 |
| primary_topic.field.display_name | Psychology |
| primary_topic.score | 0.942300021648407 |
| primary_topic.domain.id | https://openalex.org/domains/2 |
| primary_topic.domain.display_name | Social Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/3205 |
| primary_topic.subfield.display_name | Experimental and Cognitive Psychology |
| primary_topic.display_name | Emotion and Mood Recognition |
| related_works | https://openalex.org/W4391375266, https://openalex.org/W2899084033, https://openalex.org/W2748952813, https://openalex.org/W2390279801, https://openalex.org/W4391913857, https://openalex.org/W2358668433, https://openalex.org/W4396701345, https://openalex.org/W2376932109, https://openalex.org/W2001405890, https://openalex.org/W4396696052 |
| cited_by_count | 1 |
| counts_by_year[0].year | 2025 |
| counts_by_year[0].cited_by_count | 1 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2407.12973 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2407.12973 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2407.12973 |
| primary_location.id | pmh:oai:arXiv.org:2407.12973 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2407.12973 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2407.12973 |
| publication_date | 2024-07-17 |
| publication_year | 2024 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 84, 142 |
| abstract_inverted_index.At | 95 |
| abstract_inverted_index.In | 55 |
| abstract_inverted_index.as | 70 |
| abstract_inverted_index.in | 7, 16, 38, 46, 99, 107, 126, 149 |
| abstract_inverted_index.of | 20, 78, 105, 133, 136 |
| abstract_inverted_index.to | 30, 101, 119, 147 |
| abstract_inverted_index.we | 58, 82, 111, 140 |
| abstract_inverted_index.7th | 48 |
| abstract_inverted_index.The | 0 |
| abstract_inverted_index.and | 63 |
| abstract_inverted_index.are | 27 |
| abstract_inverted_index.for | 89, 123 |
| abstract_inverted_index.has | 3, 13 |
| abstract_inverted_index.our | 44 |
| abstract_inverted_index.pre | 60 |
| abstract_inverted_index.the | 17, 21, 47, 56, 71, 76, 96, 103, 116, 131, 150 |
| abstract_inverted_index.DFEW | 117 |
| abstract_inverted_index.This | 41 |
| abstract_inverted_index.been | 14, 67 |
| abstract_inverted_index.data | 106, 122 |
| abstract_inverted_index.fine | 148 |
| abstract_inverted_index.from | 115, 145 |
| abstract_inverted_index.hard | 29 |
| abstract_inverted_index.have | 66 |
| abstract_inverted_index.into | 129 |
| abstract_inverted_index.lack | 104 |
| abstract_inverted_index.made | 15 |
| abstract_inverted_index.more | 5 |
| abstract_inverted_index.over | 80 |
| abstract_inverted_index.same | 97 |
| abstract_inverted_index.that | 35 |
| abstract_inverted_index.time | 85 |
| abstract_inverted_index.Field | 49 |
| abstract_inverted_index.basic | 23, 72 |
| abstract_inverted_index.frame | 90 |
| abstract_inverted_index.label | 151 |
| abstract_inverted_index.level | 91 |
| abstract_inverted_index.order | 100 |
| abstract_inverted_index.seven | 22 |
| abstract_inverted_index.still | 28 |
| abstract_inverted_index.time, | 81, 98 |
| abstract_inverted_index.which | 65 |
| abstract_inverted_index.(ABAW) | 53 |
| abstract_inverted_index.Taking | 128 |
| abstract_inverted_index.coarse | 146 |
| abstract_inverted_index.labels | 114 |
| abstract_inverted_index.recent | 8 |
| abstract_inverted_index.space. | 152 |
| abstract_inverted_index.tackle | 31 |
| abstract_inverted_index.widely | 68 |
| abstract_inverted_index.Emotion | 50 |
| abstract_inverted_index.account | 130 |
| abstract_inverted_index.address | 102 |
| abstract_inverted_index.arousal | 135 |
| abstract_inverted_index.article | 42 |
| abstract_inverted_index.complex | 138 |
| abstract_inverted_index.emotion | 1, 33, 92, 109, 124 |
| abstract_inverted_index.methods | 26 |
| abstract_inverted_index.network | 73, 88 |
| abstract_inverted_index.propose | 83 |
| abstract_inverted_index.pyramid | 86 |
| abstract_inverted_index.trained | 61 |
| abstract_inverted_index.valence | 134 |
| abstract_inverted_index.various | 137 |
| abstract_inverted_index.Although | 10 |
| abstract_inverted_index.Analysis | 52 |
| abstract_inverted_index.Behavior | 51 |
| abstract_inverted_index.ResNet18 | 62 |
| abstract_inverted_index.commonly | 37 |
| abstract_inverted_index.compound | 32 |
| abstract_inverted_index.database | 118 |
| abstract_inverted_index.decades. | 9 |
| abstract_inverted_index.emotions | 79 |
| abstract_inverted_index.existing | 25 |
| abstract_inverted_index.occurred | 36 |
| abstract_inverted_index.progress | 12 |
| abstract_inverted_index.selected | 59 |
| abstract_inverted_index.training | 121 |
| abstract_inverted_index.utilized | 112 |
| abstract_inverted_index.attention | 6 |
| abstract_inverted_index.attracted | 4 |
| abstract_inverted_index.composite | 108 |
| abstract_inverted_index.construct | 120 |
| abstract_inverted_index.emotions, | 24, 139 |
| abstract_inverted_index.framework | 144 |
| abstract_inverted_index.practical | 39 |
| abstract_inverted_index.structure | 87 |
| abstract_inverted_index.categories | 125 |
| abstract_inverted_index.continuity | 77 |
| abstract_inverted_index.framework. | 74 |
| abstract_inverted_index.introduces | 43 |
| abstract_inverted_index.technology | 19 |
| abstract_inverted_index.validated, | 69 |
| abstract_inverted_index.Considering | 75 |
| abstract_inverted_index.constructed | 141 |
| abstract_inverted_index.prediction. | 93 |
| abstract_inverted_index.recognition | 2, 18, 34 |
| abstract_inverted_index.significant | 11 |
| abstract_inverted_index.Furthermore. | 94 |
| abstract_inverted_index.Transformer, | 64 |
| abstract_inverted_index.achievements | 45 |
| abstract_inverted_index.application. | 40 |
| abstract_inverted_index.competition, | 57 |
| abstract_inverted_index.competition. | 54 |
| abstract_inverted_index.fine-grained | 113 |
| abstract_inverted_index.recognition, | 110 |
| abstract_inverted_index.competitions. | 127 |
| abstract_inverted_index.classification | 143 |
| abstract_inverted_index.characteristics | 132 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 8 |
| citation_normalized_percentile |