Title:
|
Retrieval of multimedia objects by fusing multiple modalities
|
Author:
|
Gialampoukidis, Ilias; Moumtzidou, Anastasia; Tsikrika, Theodora; Vrochidis, Stefanos; Kompatsiaris, Ioannis
|
Abstract:
|
Comunicació presentada a: ICMR'16. International Conference on Multimedia Retrieval 2016, celebrat a Nova York del 6 al 9 de juny de 2016 |
Abstract:
|
Searching for multimedia objects with heterogeneous modal-
ities is critical for the construction of e ective multimedia retrieval systems. Towards this direction, we propose a framework for the multimodal fusion of visual and textual similarities, based on visual features, visual concepts and textual concepts. Our method is compared to the baseline method
that only fuses two modalities but integrates all early, late, linearly weighted, di usion and graph-based models in one unifying framework. Our framework integrates more than two modalities and high-level information, so as to retrieve multimedia objects enriched with high-level textual and vi-
sual concepts, in response to a multimodal query. The experimental comparison is done under the same memory complexity, in two multimedia collections in the multimedia retrieval task. The results have shown that we outperform the baseline method, in terms of Mean Average Precision. |
Abstract:
|
This work was partially supported by the European Commission by the projects MULTISENSOR (FP7-610411) and KRISTINA (H2020-645012). |
Subject(s):
|
-Recuperació de la informació -Informació -- Sistemes d'emmagatzematge i recuperació |
Rights:
|
© ACM, 2016. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval, (2016) http://doi.acm.org/10.1145/2911996.2912068 |
Document type:
|
Conference Object Article - Accepted version |
Published by:
|
ACM Association for Computer Machinery
|
Share:
|
|