Exploring foci of:
arXiv (Cornell University)
Beyond Images: Adaptive Fusion of Visual and Textual Data for Food Classification
August 2023 • Prateek Mittal, Puneet Goyal, Joohi Chauhan
This study introduces a novel multimodal food recognition framework that effectively combines visual and textual modalities to enhance classification accuracy and robustness. The proposed approach employs a dynamic multimodal fusion strategy that adaptively integrates features from unimodal visual inputs and complementary textual metadata. This fusion mechanism is designed to maximize the use of informative content, while mitigating the adverse impact of missing or inconsistent modality data. The framework was rig…
Computer Science
Artificial Intelligence
Transformer
Machine Learning
Biochemistry
Physics
Quantum Mechanics
Chemistry
Voltage
Philosophy