Multimodal Trustworthy Semantic Communication for Audio-Visual Event Localization Article Swipe
Yi Li
,
Zhe Xiang
,
F. Richard Yu
,
Zhangshuang Guan
,
Hui Ji
,
Zhiguo Wan
,
Cheng Feng
·
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2411.01991
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2411.01991
The exponential growth in wireless data traffic, driven by the proliferation of mobile devices and smart applications, poses significant challenges for modern communication systems. Ensuring the secure and reliable transmission of multimodal semantic information is increasingly critical, particularly for tasks like Audio-Visual Event (AVE) localization. This letter introduces MMTrustSC, a novel framework designed to address these challenges by enhancing the security and reliability of multimodal communication. MMTrustSC incorporates advanced semantic encoding techniques to safeguard data integrity and privacy. It features a two-level coding scheme that combines error-correcting codes with conventional encoders to improve the accuracy and reliability of multimodal data transmission. Additionally, MMTrustSC employs hybrid encryption, integrating both asymmetric and symmetric encryption methods, to secure semantic information and ensure its confidentiality and integrity across potentially hostile networks. Simulation results validate MMTrustSC's effectiveness, demonstrating substantial improvements in data transmission accuracy and reliability for AVE localization tasks. This framework represents a significant advancement in managing intermodal information complementarity and mitigating physical noise, thus enhancing overall system performance.
Related Topics
Concepts
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2411.01991
- https://arxiv.org/pdf/2411.01991
- OA Status
- green
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4404353292
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4404353292Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2411.01991Digital Object Identifier
- Title
-
Multimodal Trustworthy Semantic Communication for Audio-Visual Event LocalizationWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-11-04Full publication date if available
- Authors
-
Yi Li, Zhe Xiang, F. Richard Yu, Zhangshuang Guan, Hui Ji, Zhiguo Wan, Cheng FengList of authors in order
- Landing page
-
https://arxiv.org/abs/2411.01991Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2411.01991Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2411.01991Direct OA link when available
- Concepts
-
Trustworthiness, Computer science, Event (particle physics), Audio visual, Human–computer interaction, Internet privacy, Multimedia, Quantum mechanics, PhysicsTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4404353292 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2411.01991 |
| ids.doi | https://doi.org/10.48550/arxiv.2411.01991 |
| ids.openalex | https://openalex.org/W4404353292 |
| fwci | |
| type | preprint |
| title | Multimodal Trustworthy Semantic Communication for Audio-Visual Event Localization |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T11309 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.9922000169754028 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1711 |
| topics[0].subfield.display_name | Signal Processing |
| topics[0].display_name | Music and Audio Processing |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C153701036 |
| concepts[0].level | 2 |
| concepts[0].score | 0.6865718364715576 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q659974 |
| concepts[0].display_name | Trustworthiness |
| concepts[1].id | https://openalex.org/C41008148 |
| concepts[1].level | 0 |
| concepts[1].score | 0.6836128234863281 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[1].display_name | Computer science |
| concepts[2].id | https://openalex.org/C2779662365 |
| concepts[2].level | 2 |
| concepts[2].score | 0.6044823527336121 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q5416694 |
| concepts[2].display_name | Event (particle physics) |
| concepts[3].id | https://openalex.org/C3017588708 |
| concepts[3].level | 2 |
| concepts[3].score | 0.5034732222557068 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q758901 |
| concepts[3].display_name | Audio visual |
| concepts[4].id | https://openalex.org/C107457646 |
| concepts[4].level | 1 |
| concepts[4].score | 0.33040791749954224 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q207434 |
| concepts[4].display_name | Human–computer interaction |
| concepts[5].id | https://openalex.org/C108827166 |
| concepts[5].level | 1 |
| concepts[5].score | 0.3168255090713501 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q175975 |
| concepts[5].display_name | Internet privacy |
| concepts[6].id | https://openalex.org/C49774154 |
| concepts[6].level | 1 |
| concepts[6].score | 0.23108577728271484 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q131765 |
| concepts[6].display_name | Multimedia |
| concepts[7].id | https://openalex.org/C62520636 |
| concepts[7].level | 1 |
| concepts[7].score | 0.0 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q944 |
| concepts[7].display_name | Quantum mechanics |
| concepts[8].id | https://openalex.org/C121332964 |
| concepts[8].level | 0 |
| concepts[8].score | 0.0 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q413 |
| concepts[8].display_name | Physics |
| keywords[0].id | https://openalex.org/keywords/trustworthiness |
| keywords[0].score | 0.6865718364715576 |
| keywords[0].display_name | Trustworthiness |
| keywords[1].id | https://openalex.org/keywords/computer-science |
| keywords[1].score | 0.6836128234863281 |
| keywords[1].display_name | Computer science |
| keywords[2].id | https://openalex.org/keywords/event |
| keywords[2].score | 0.6044823527336121 |
| keywords[2].display_name | Event (particle physics) |
| keywords[3].id | https://openalex.org/keywords/audio-visual |
| keywords[3].score | 0.5034732222557068 |
| keywords[3].display_name | Audio visual |
| keywords[4].id | https://openalex.org/keywords/human–computer-interaction |
| keywords[4].score | 0.33040791749954224 |
| keywords[4].display_name | Human–computer interaction |
| keywords[5].id | https://openalex.org/keywords/internet-privacy |
| keywords[5].score | 0.3168255090713501 |
| keywords[5].display_name | Internet privacy |
| keywords[6].id | https://openalex.org/keywords/multimedia |
| keywords[6].score | 0.23108577728271484 |
| keywords[6].display_name | Multimedia |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2411.01991 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2411.01991 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2411.01991 |
| locations[1].id | doi:10.48550/arxiv.2411.01991 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2411.01991 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5010652928 |
| authorships[0].author.orcid | https://orcid.org/0009-0006-0913-0786 |
| authorships[0].author.display_name | Yi Li |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Li, Yuandi |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5065130747 |
| authorships[1].author.orcid | https://orcid.org/0000-0002-1958-593X |
| authorships[1].author.display_name | Zhe Xiang |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Xiang, Zhe |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5100420016 |
| authorships[2].author.orcid | https://orcid.org/0000-0003-1006-7594 |
| authorships[2].author.display_name | F. Richard Yu |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Yu, Fei |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5079356148 |
| authorships[3].author.orcid | https://orcid.org/0000-0002-8364-4578 |
| authorships[3].author.display_name | Zhangshuang Guan |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Guan, Zhangshuang |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5030046423 |
| authorships[4].author.orcid | https://orcid.org/0000-0002-1674-6056 |
| authorships[4].author.display_name | Hui Ji |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Ji, Hui |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5043935709 |
| authorships[5].author.orcid | https://orcid.org/0000-0003-1319-1224 |
| authorships[5].author.display_name | Zhiguo Wan |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Wan, Zhiguo |
| authorships[5].is_corresponding | False |
| authorships[6].author.id | https://openalex.org/A5101832747 |
| authorships[6].author.orcid | https://orcid.org/0000-0003-3861-0042 |
| authorships[6].author.display_name | Cheng Feng |
| authorships[6].author_position | last |
| authorships[6].raw_author_name | Feng, Cheng |
| authorships[6].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2411.01991 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2024-11-14T00:00:00 |
| display_name | Multimodal Trustworthy Semantic Communication for Audio-Visual Event Localization |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T11309 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.9922000169754028 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1711 |
| primary_topic.subfield.display_name | Signal Processing |
| primary_topic.display_name | Music and Audio Processing |
| related_works | https://openalex.org/W2271369634, https://openalex.org/W3147472394, https://openalex.org/W2047100085, https://openalex.org/W2350550760, https://openalex.org/W578794879, https://openalex.org/W2625296515, https://openalex.org/W3137890128, https://openalex.org/W2076536433, https://openalex.org/W1984634519, https://openalex.org/W4245955731 |
| cited_by_count | 0 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2411.01991 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2411.01991 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2411.01991 |
| primary_location.id | pmh:oai:arXiv.org:2411.01991 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2411.01991 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2411.01991 |
| publication_date | 2024-11-04 |
| publication_year | 2024 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 49, 80, 148 |
| abstract_inverted_index.It | 78 |
| abstract_inverted_index.by | 8, 57 |
| abstract_inverted_index.in | 3, 135, 151 |
| abstract_inverted_index.is | 34 |
| abstract_inverted_index.of | 11, 30, 63, 97 |
| abstract_inverted_index.to | 53, 72, 91, 113 |
| abstract_inverted_index.AVE | 142 |
| abstract_inverted_index.The | 0 |
| abstract_inverted_index.and | 14, 27, 61, 76, 95, 109, 117, 121, 139, 156 |
| abstract_inverted_index.for | 20, 38, 141 |
| abstract_inverted_index.its | 119 |
| abstract_inverted_index.the | 9, 25, 59, 93 |
| abstract_inverted_index.This | 45, 145 |
| abstract_inverted_index.both | 107 |
| abstract_inverted_index.data | 5, 74, 99, 136 |
| abstract_inverted_index.like | 40 |
| abstract_inverted_index.that | 84 |
| abstract_inverted_index.thus | 160 |
| abstract_inverted_index.with | 88 |
| abstract_inverted_index.(AVE) | 43 |
| abstract_inverted_index.Event | 42 |
| abstract_inverted_index.codes | 87 |
| abstract_inverted_index.novel | 50 |
| abstract_inverted_index.poses | 17 |
| abstract_inverted_index.smart | 15 |
| abstract_inverted_index.tasks | 39 |
| abstract_inverted_index.these | 55 |
| abstract_inverted_index.across | 123 |
| abstract_inverted_index.coding | 82 |
| abstract_inverted_index.driven | 7 |
| abstract_inverted_index.ensure | 118 |
| abstract_inverted_index.growth | 2 |
| abstract_inverted_index.hybrid | 104 |
| abstract_inverted_index.letter | 46 |
| abstract_inverted_index.mobile | 12 |
| abstract_inverted_index.modern | 21 |
| abstract_inverted_index.noise, | 159 |
| abstract_inverted_index.scheme | 83 |
| abstract_inverted_index.secure | 26, 114 |
| abstract_inverted_index.system | 163 |
| abstract_inverted_index.tasks. | 144 |
| abstract_inverted_index.address | 54 |
| abstract_inverted_index.devices | 13 |
| abstract_inverted_index.employs | 103 |
| abstract_inverted_index.hostile | 125 |
| abstract_inverted_index.improve | 92 |
| abstract_inverted_index.overall | 162 |
| abstract_inverted_index.results | 128 |
| abstract_inverted_index.Ensuring | 24 |
| abstract_inverted_index.accuracy | 94, 138 |
| abstract_inverted_index.advanced | 68 |
| abstract_inverted_index.combines | 85 |
| abstract_inverted_index.designed | 52 |
| abstract_inverted_index.encoders | 90 |
| abstract_inverted_index.encoding | 70 |
| abstract_inverted_index.features | 79 |
| abstract_inverted_index.managing | 152 |
| abstract_inverted_index.methods, | 112 |
| abstract_inverted_index.physical | 158 |
| abstract_inverted_index.privacy. | 77 |
| abstract_inverted_index.reliable | 28 |
| abstract_inverted_index.security | 60 |
| abstract_inverted_index.semantic | 32, 69, 115 |
| abstract_inverted_index.systems. | 23 |
| abstract_inverted_index.traffic, | 6 |
| abstract_inverted_index.validate | 129 |
| abstract_inverted_index.wireless | 4 |
| abstract_inverted_index.MMTrustSC | 66, 102 |
| abstract_inverted_index.critical, | 36 |
| abstract_inverted_index.enhancing | 58, 161 |
| abstract_inverted_index.framework | 51, 146 |
| abstract_inverted_index.integrity | 75, 122 |
| abstract_inverted_index.networks. | 126 |
| abstract_inverted_index.safeguard | 73 |
| abstract_inverted_index.symmetric | 110 |
| abstract_inverted_index.two-level | 81 |
| abstract_inverted_index.MMTrustSC, | 48 |
| abstract_inverted_index.Simulation | 127 |
| abstract_inverted_index.asymmetric | 108 |
| abstract_inverted_index.challenges | 19, 56 |
| abstract_inverted_index.encryption | 111 |
| abstract_inverted_index.intermodal | 153 |
| abstract_inverted_index.introduces | 47 |
| abstract_inverted_index.mitigating | 157 |
| abstract_inverted_index.multimodal | 31, 64, 98 |
| abstract_inverted_index.represents | 147 |
| abstract_inverted_index.techniques | 71 |
| abstract_inverted_index.MMTrustSC's | 130 |
| abstract_inverted_index.advancement | 150 |
| abstract_inverted_index.encryption, | 105 |
| abstract_inverted_index.exponential | 1 |
| abstract_inverted_index.information | 33, 116, 154 |
| abstract_inverted_index.integrating | 106 |
| abstract_inverted_index.potentially | 124 |
| abstract_inverted_index.reliability | 62, 96, 140 |
| abstract_inverted_index.significant | 18, 149 |
| abstract_inverted_index.substantial | 133 |
| abstract_inverted_index.Audio-Visual | 41 |
| abstract_inverted_index.conventional | 89 |
| abstract_inverted_index.improvements | 134 |
| abstract_inverted_index.incorporates | 67 |
| abstract_inverted_index.increasingly | 35 |
| abstract_inverted_index.localization | 143 |
| abstract_inverted_index.particularly | 37 |
| abstract_inverted_index.performance. | 164 |
| abstract_inverted_index.transmission | 29, 137 |
| abstract_inverted_index.Additionally, | 101 |
| abstract_inverted_index.applications, | 16 |
| abstract_inverted_index.communication | 22 |
| abstract_inverted_index.demonstrating | 132 |
| abstract_inverted_index.localization. | 44 |
| abstract_inverted_index.proliferation | 10 |
| abstract_inverted_index.transmission. | 100 |
| abstract_inverted_index.communication. | 65 |
| abstract_inverted_index.effectiveness, | 131 |
| abstract_inverted_index.complementarity | 155 |
| abstract_inverted_index.confidentiality | 120 |
| abstract_inverted_index.error-correcting | 86 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 7 |
| citation_normalized_percentile |