Enhanced Multimodal Video Retrieval System: Integrating Query Expansion and Cross-modal Temporal Event Retrieval Article Swipe
YOU?
·
· 2025
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2512.06334
Multimedia information retrieval from videos remains a challenging problem. While recent systems have advanced multimodal search through semantic, object, and OCR queries - and can retrieve temporally consecutive scenes - they often rely on a single query modality for an entire sequence, limiting robustness in complex temporal contexts. To overcome this, we propose a cross-modal temporal event retrieval framework that enables different query modalities to describe distinct scenes within a sequence. To determine decision thresholds for scene transition and slide change adaptively, we build Kernel Density Gaussian Mixture Thresholding (KDE-GMM) algorithm, ensuring optimal keyframe selection. These extracted keyframes act as compact, high-quality visual exemplars that retain each segment's semantic essence, improving retrieval precision and efficiency. Additionally, the system incorporates a large language model (LLM) to refine and expand user queries, enhancing overall retrieval performance. The proposed system's effectiveness and robustness were demonstrated through its strong results in the Ho Chi Minh AI Challenge 2025.
Related Topics
- Type
- preprint
- Landing Page
- https://doi.org/10.48550/arxiv.2512.06334
- OA Status
- green
- OpenAlex ID
- https://openalex.org/W7111372480
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W7111372480Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2512.06334Digital Object Identifier
- Title
-
Enhanced Multimodal Video Retrieval System: Integrating Query Expansion and Cross-modal Temporal Event RetrievalWork title
- Type
-
preprintOpenAlex work type
- Publication year
-
2025Year of publication
- Publication date
-
2025-12-06Full publication date if available
- Authors
-
Vo Van Thinh, Nguyen Minh Khoi, Tran Minh Huy, Nguyen-Tran, Anh-Quan, Nguyen Duy Tan, Nguyen Khanh Loi, Phan, Anh-MinhList of authors in order
- Landing page
-
https://doi.org/10.48550/arxiv.2512.06334Publisher landing page
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://doi.org/10.48550/arxiv.2512.06334Direct OA link when available
- Concepts
-
Computer science, Robustness (evolution), Video retrieval, Artificial intelligence, Query expansion, Thresholding, Visual Word, Image retrieval, Information retrieval, Kernel density estimation, Event (particle physics), Limiting, Mixture model, Search engine indexing, Modalities, Query language, Discriminative model, Relevance feedback, Kernel (algebra), Visualization, Modality (human–computer interaction), Pattern recognition (psychology), Sliding window protocol, Computer vision, Histogram, Machine learningTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
Full payload
| id | https://openalex.org/W7111372480 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2512.06334 |
| ids.doi | https://doi.org/10.48550/arxiv.2512.06334 |
| ids.openalex | https://openalex.org/W7111372480 |
| fwci | |
| type | preprint |
| title | Enhanced Multimodal Video Retrieval System: Integrating Query Expansion and Cross-modal Temporal Event Retrieval |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C41008148 |
| concepts[0].level | 0 |
| concepts[0].score | 0.8335316181182861 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[0].display_name | Computer science |
| concepts[1].id | https://openalex.org/C63479239 |
| concepts[1].level | 3 |
| concepts[1].score | 0.637570321559906 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q7353546 |
| concepts[1].display_name | Robustness (evolution) |
| concepts[2].id | https://openalex.org/C2983174267 |
| concepts[2].level | 2 |
| concepts[2].score | 0.6131018400192261 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q3775098 |
| concepts[2].display_name | Video retrieval |
| concepts[3].id | https://openalex.org/C154945302 |
| concepts[3].level | 1 |
| concepts[3].score | 0.565542995929718 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[3].display_name | Artificial intelligence |
| concepts[4].id | https://openalex.org/C99016210 |
| concepts[4].level | 2 |
| concepts[4].score | 0.5648579597473145 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q5488129 |
| concepts[4].display_name | Query expansion |
| concepts[5].id | https://openalex.org/C191178318 |
| concepts[5].level | 3 |
| concepts[5].score | 0.5130377411842346 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q2256906 |
| concepts[5].display_name | Thresholding |
| concepts[6].id | https://openalex.org/C189391414 |
| concepts[6].level | 4 |
| concepts[6].score | 0.487452894449234 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q7936579 |
| concepts[6].display_name | Visual Word |
| concepts[7].id | https://openalex.org/C1667742 |
| concepts[7].level | 3 |
| concepts[7].score | 0.46033111214637756 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q10927554 |
| concepts[7].display_name | Image retrieval |
| concepts[8].id | https://openalex.org/C23123220 |
| concepts[8].level | 1 |
| concepts[8].score | 0.4590102732181549 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q816826 |
| concepts[8].display_name | Information retrieval |
| concepts[9].id | https://openalex.org/C71134354 |
| concepts[9].level | 3 |
| concepts[9].score | 0.41141384840011597 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q458825 |
| concepts[9].display_name | Kernel density estimation |
| concepts[10].id | https://openalex.org/C2779662365 |
| concepts[10].level | 2 |
| concepts[10].score | 0.4088483154773712 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q5416694 |
| concepts[10].display_name | Event (particle physics) |
| concepts[11].id | https://openalex.org/C188198153 |
| concepts[11].level | 2 |
| concepts[11].score | 0.3854134976863861 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q1613840 |
| concepts[11].display_name | Limiting |
| concepts[12].id | https://openalex.org/C61224824 |
| concepts[12].level | 2 |
| concepts[12].score | 0.33467897772789 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q2260434 |
| concepts[12].display_name | Mixture model |
| concepts[13].id | https://openalex.org/C75165309 |
| concepts[13].level | 2 |
| concepts[13].score | 0.32946544885635376 |
| concepts[13].wikidata | https://www.wikidata.org/wiki/Q2258979 |
| concepts[13].display_name | Search engine indexing |
| concepts[14].id | https://openalex.org/C2779903281 |
| concepts[14].level | 2 |
| concepts[14].score | 0.327447772026062 |
| concepts[14].wikidata | https://www.wikidata.org/wiki/Q6888026 |
| concepts[14].display_name | Modalities |
| concepts[15].id | https://openalex.org/C192028432 |
| concepts[15].level | 2 |
| concepts[15].score | 0.32003435492515564 |
| concepts[15].wikidata | https://www.wikidata.org/wiki/Q845739 |
| concepts[15].display_name | Query language |
| concepts[16].id | https://openalex.org/C97931131 |
| concepts[16].level | 2 |
| concepts[16].score | 0.31693994998931885 |
| concepts[16].wikidata | https://www.wikidata.org/wiki/Q5282087 |
| concepts[16].display_name | Discriminative model |
| concepts[17].id | https://openalex.org/C2779532271 |
| concepts[17].level | 4 |
| concepts[17].score | 0.31098026037216187 |
| concepts[17].wikidata | https://www.wikidata.org/wiki/Q445558 |
| concepts[17].display_name | Relevance feedback |
| concepts[18].id | https://openalex.org/C74193536 |
| concepts[18].level | 2 |
| concepts[18].score | 0.29281479120254517 |
| concepts[18].wikidata | https://www.wikidata.org/wiki/Q574844 |
| concepts[18].display_name | Kernel (algebra) |
| concepts[19].id | https://openalex.org/C36464697 |
| concepts[19].level | 2 |
| concepts[19].score | 0.27829626202583313 |
| concepts[19].wikidata | https://www.wikidata.org/wiki/Q451553 |
| concepts[19].display_name | Visualization |
| concepts[20].id | https://openalex.org/C2780226545 |
| concepts[20].level | 2 |
| concepts[20].score | 0.2776508033275604 |
| concepts[20].wikidata | https://www.wikidata.org/wiki/Q6888030 |
| concepts[20].display_name | Modality (human–computer interaction) |
| concepts[21].id | https://openalex.org/C153180895 |
| concepts[21].level | 2 |
| concepts[21].score | 0.2733648717403412 |
| concepts[21].wikidata | https://www.wikidata.org/wiki/Q7148389 |
| concepts[21].display_name | Pattern recognition (psychology) |
| concepts[22].id | https://openalex.org/C102392041 |
| concepts[22].level | 3 |
| concepts[22].score | 0.2726901173591614 |
| concepts[22].wikidata | https://www.wikidata.org/wiki/Q592860 |
| concepts[22].display_name | Sliding window protocol |
| concepts[23].id | https://openalex.org/C31972630 |
| concepts[23].level | 1 |
| concepts[23].score | 0.2711522877216339 |
| concepts[23].wikidata | https://www.wikidata.org/wiki/Q844240 |
| concepts[23].display_name | Computer vision |
| concepts[24].id | https://openalex.org/C53533937 |
| concepts[24].level | 3 |
| concepts[24].score | 0.26442059874534607 |
| concepts[24].wikidata | https://www.wikidata.org/wiki/Q185020 |
| concepts[24].display_name | Histogram |
| concepts[25].id | https://openalex.org/C119857082 |
| concepts[25].level | 1 |
| concepts[25].score | 0.2514597177505493 |
| concepts[25].wikidata | https://www.wikidata.org/wiki/Q2539 |
| concepts[25].display_name | Machine learning |
| keywords[0].id | https://openalex.org/keywords/robustness |
| keywords[0].score | 0.637570321559906 |
| keywords[0].display_name | Robustness (evolution) |
| keywords[1].id | https://openalex.org/keywords/video-retrieval |
| keywords[1].score | 0.6131018400192261 |
| keywords[1].display_name | Video retrieval |
| keywords[2].id | https://openalex.org/keywords/query-expansion |
| keywords[2].score | 0.5648579597473145 |
| keywords[2].display_name | Query expansion |
| keywords[3].id | https://openalex.org/keywords/thresholding |
| keywords[3].score | 0.5130377411842346 |
| keywords[3].display_name | Thresholding |
| keywords[4].id | https://openalex.org/keywords/visual-word |
| keywords[4].score | 0.487452894449234 |
| keywords[4].display_name | Visual Word |
| keywords[5].id | https://openalex.org/keywords/image-retrieval |
| keywords[5].score | 0.46033111214637756 |
| keywords[5].display_name | Image retrieval |
| keywords[6].id | https://openalex.org/keywords/kernel-density-estimation |
| keywords[6].score | 0.41141384840011597 |
| keywords[6].display_name | Kernel density estimation |
| keywords[7].id | https://openalex.org/keywords/event |
| keywords[7].score | 0.4088483154773712 |
| keywords[7].display_name | Event (particle physics) |
| keywords[8].id | https://openalex.org/keywords/limiting |
| keywords[8].score | 0.3854134976863861 |
| keywords[8].display_name | Limiting |
| language | |
| locations[0].id | doi:10.48550/arxiv.2512.06334 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | |
| locations[0].version | |
| locations[0].raw_type | article |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | https://doi.org/10.48550/arxiv.2512.06334 |
| indexed_in | datacite |
| authorships[0].author.id | https://openalex.org/A2222543671 |
| authorships[0].author.orcid | |
| authorships[0].author.display_name | Vo Van Thinh |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Vo, Van-Thinh |
| authorships[0].is_corresponding | True |
| authorships[1].author.id | https://openalex.org/A2303543500 |
| authorships[1].author.orcid | |
| authorships[1].author.display_name | Nguyen Minh Khoi |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Nguyen, Minh-Khoi |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A3163567742 |
| authorships[2].author.orcid | |
| authorships[2].author.display_name | Tran Minh Huy |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Tran, Minh-Huy |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | |
| authorships[3].author.orcid | |
| authorships[3].author.display_name | Nguyen-Tran, Anh-Quan |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Nguyen-Tran, Anh-Quan |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A2250377597 |
| authorships[4].author.orcid | https://orcid.org/0000-0001-9538-1181 |
| authorships[4].author.display_name | Nguyen Duy Tan |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Nguyen, Duy-Tan |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5119252880 |
| authorships[5].author.orcid | |
| authorships[5].author.display_name | Nguyen Khanh Loi |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Nguyen, Khanh-Loi |
| authorships[5].is_corresponding | False |
| authorships[6].author.id | |
| authorships[6].author.orcid | |
| authorships[6].author.display_name | Phan, Anh-Minh |
| authorships[6].author_position | last |
| authorships[6].raw_author_name | Phan, Anh-Minh |
| authorships[6].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://doi.org/10.48550/arxiv.2512.06334 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-12-10T00:00:00 |
| display_name | Enhanced Multimodal Video Retrieval System: Integrating Query Expansion and Cross-modal Temporal Event Retrieval |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-12-10T02:49:46.989445 |
| primary_topic | |
| cited_by_count | 0 |
| locations_count | 1 |
| best_oa_location.id | doi:10.48550/arxiv.2512.06334 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | |
| best_oa_location.version | |
| best_oa_location.raw_type | article |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | https://doi.org/10.48550/arxiv.2512.06334 |
| primary_location.id | doi:10.48550/arxiv.2512.06334 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | |
| primary_location.version | |
| primary_location.raw_type | article |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | https://doi.org/10.48550/arxiv.2512.06334 |
| publication_date | 2025-12-06 |
| publication_year | 2025 |
| referenced_works_count | 0 |
| abstract_inverted_index.- | 22, 29 |
| abstract_inverted_index.a | 6, 34, 53, 69, 119 |
| abstract_inverted_index.AI | 151 |
| abstract_inverted_index.Ho | 148 |
| abstract_inverted_index.To | 48, 71 |
| abstract_inverted_index.an | 39 |
| abstract_inverted_index.as | 99 |
| abstract_inverted_index.in | 44, 146 |
| abstract_inverted_index.on | 33 |
| abstract_inverted_index.to | 64, 124 |
| abstract_inverted_index.we | 51, 82 |
| abstract_inverted_index.Chi | 149 |
| abstract_inverted_index.OCR | 20 |
| abstract_inverted_index.The | 134 |
| abstract_inverted_index.act | 98 |
| abstract_inverted_index.and | 19, 23, 78, 113, 126, 138 |
| abstract_inverted_index.can | 24 |
| abstract_inverted_index.for | 38, 75 |
| abstract_inverted_index.its | 143 |
| abstract_inverted_index.the | 116, 147 |
| abstract_inverted_index.Minh | 150 |
| abstract_inverted_index.each | 106 |
| abstract_inverted_index.from | 3 |
| abstract_inverted_index.have | 12 |
| abstract_inverted_index.rely | 32 |
| abstract_inverted_index.that | 59, 104 |
| abstract_inverted_index.they | 30 |
| abstract_inverted_index.user | 128 |
| abstract_inverted_index.were | 140 |
| abstract_inverted_index.(LLM) | 123 |
| abstract_inverted_index.2025. | 153 |
| abstract_inverted_index.These | 95 |
| abstract_inverted_index.While | 9 |
| abstract_inverted_index.build | 83 |
| abstract_inverted_index.event | 56 |
| abstract_inverted_index.large | 120 |
| abstract_inverted_index.model | 122 |
| abstract_inverted_index.often | 31 |
| abstract_inverted_index.query | 36, 62 |
| abstract_inverted_index.scene | 76 |
| abstract_inverted_index.slide | 79 |
| abstract_inverted_index.this, | 50 |
| abstract_inverted_index.Kernel | 84 |
| abstract_inverted_index.change | 80 |
| abstract_inverted_index.entire | 40 |
| abstract_inverted_index.expand | 127 |
| abstract_inverted_index.recent | 10 |
| abstract_inverted_index.refine | 125 |
| abstract_inverted_index.retain | 105 |
| abstract_inverted_index.scenes | 28, 67 |
| abstract_inverted_index.search | 15 |
| abstract_inverted_index.single | 35 |
| abstract_inverted_index.strong | 144 |
| abstract_inverted_index.system | 117 |
| abstract_inverted_index.videos | 4 |
| abstract_inverted_index.visual | 102 |
| abstract_inverted_index.within | 68 |
| abstract_inverted_index.Density | 85 |
| abstract_inverted_index.Mixture | 87 |
| abstract_inverted_index.complex | 45 |
| abstract_inverted_index.enables | 60 |
| abstract_inverted_index.object, | 18 |
| abstract_inverted_index.optimal | 92 |
| abstract_inverted_index.overall | 131 |
| abstract_inverted_index.propose | 52 |
| abstract_inverted_index.queries | 21 |
| abstract_inverted_index.remains | 5 |
| abstract_inverted_index.results | 145 |
| abstract_inverted_index.systems | 11 |
| abstract_inverted_index.through | 16, 142 |
| abstract_inverted_index.Gaussian | 86 |
| abstract_inverted_index.advanced | 13 |
| abstract_inverted_index.compact, | 100 |
| abstract_inverted_index.decision | 73 |
| abstract_inverted_index.describe | 65 |
| abstract_inverted_index.distinct | 66 |
| abstract_inverted_index.ensuring | 91 |
| abstract_inverted_index.essence, | 109 |
| abstract_inverted_index.keyframe | 93 |
| abstract_inverted_index.language | 121 |
| abstract_inverted_index.limiting | 42 |
| abstract_inverted_index.modality | 37 |
| abstract_inverted_index.overcome | 49 |
| abstract_inverted_index.problem. | 8 |
| abstract_inverted_index.proposed | 135 |
| abstract_inverted_index.queries, | 129 |
| abstract_inverted_index.retrieve | 25 |
| abstract_inverted_index.semantic | 108 |
| abstract_inverted_index.system's | 136 |
| abstract_inverted_index.temporal | 46, 55 |
| abstract_inverted_index.(KDE-GMM) | 89 |
| abstract_inverted_index.Challenge | 152 |
| abstract_inverted_index.contexts. | 47 |
| abstract_inverted_index.determine | 72 |
| abstract_inverted_index.different | 61 |
| abstract_inverted_index.enhancing | 130 |
| abstract_inverted_index.exemplars | 103 |
| abstract_inverted_index.extracted | 96 |
| abstract_inverted_index.framework | 58 |
| abstract_inverted_index.improving | 110 |
| abstract_inverted_index.keyframes | 97 |
| abstract_inverted_index.precision | 112 |
| abstract_inverted_index.retrieval | 2, 57, 111, 132 |
| abstract_inverted_index.segment's | 107 |
| abstract_inverted_index.semantic, | 17 |
| abstract_inverted_index.sequence, | 41 |
| abstract_inverted_index.sequence. | 70 |
| abstract_inverted_index.Multimedia | 0 |
| abstract_inverted_index.algorithm, | 90 |
| abstract_inverted_index.modalities | 63 |
| abstract_inverted_index.multimodal | 14 |
| abstract_inverted_index.robustness | 43, 139 |
| abstract_inverted_index.selection. | 94 |
| abstract_inverted_index.temporally | 26 |
| abstract_inverted_index.thresholds | 74 |
| abstract_inverted_index.transition | 77 |
| abstract_inverted_index.adaptively, | 81 |
| abstract_inverted_index.challenging | 7 |
| abstract_inverted_index.consecutive | 27 |
| abstract_inverted_index.cross-modal | 54 |
| abstract_inverted_index.efficiency. | 114 |
| abstract_inverted_index.information | 1 |
| abstract_inverted_index.Thresholding | 88 |
| abstract_inverted_index.demonstrated | 141 |
| abstract_inverted_index.high-quality | 101 |
| abstract_inverted_index.incorporates | 118 |
| abstract_inverted_index.performance. | 133 |
| abstract_inverted_index.Additionally, | 115 |
| abstract_inverted_index.effectiveness | 137 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 7 |
| citation_normalized_percentile |