|
Títol:
|
Demonstration of an open source framework for qualitative evaluation of CBIR systems
|
|
Autor/a:
|
Gomez Duran, Paula; Mohedano, Eva; McGuinness, Kevin; Giró Nieto, Xavier; O'Connor, Noel
|
|
Altres autors:
|
Universitat Politècnica de Catalunya. Departament de Teoria del Senyal i Comunicacions; Universitat Politècnica de Catalunya. GPI - Grup de Processament d'Imatge i Vídeo |
|
Abstract:
|
Evaluating image retrieval systems in a quantitative way, for example by computing measures like mean average precision, allows for objective comparisons with a ground-truth. However, in cases where ground-truth is not available, the only alternative is to collect feedback from a user. Thus, qualitative assessments become important to better understand how the system works. Visualizing the results could be, in some scenarios, the only way to evaluate the results obtained and also the only opportunity to identify that a system is failing. This necessitates developing a User Interface (UI) for a Content Based Image Retrieval (CBIR) system that allows visualization of results and improvement via capturing user relevance feedback. A well-designed UI facilitates understanding of the performance of the system, both in cases where it works well and perhaps more importantly those which highlight the need for improvement. Our open-source system implements three components to facilitate researchers to quickly develop these capabilities for their retrieval engine. We present: a web-based user interface to visualize retrieval results and collect user annotations; a server that simplifies connection with any underlying CBIR system; and a server that manages the search engine data. |
|
Abstract:
|
Peer Reviewed |
|
Matèries:
|
-Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial::Sistemes experts
-Àrees temàtiques de la UPC::Enginyeria de la telecomunicació::Processament del senyal::Processament de la imatge i del senyal vídeo
-Image processing--Digital techniques
-Digital video
-Artificial intelligence
-retrieval
-deep learning
-open source
-user interface
-visual search
-content-based image retrieval
-Imatges -- Processament -- Tècniques digitals
-Vídeo digital
-Intel·ligència artificial |
|
Drets:
|
|
|
Tipus de document:
|
Article - Versió publicada
Objecte de conferència |
|
Publicat per:
|
Association for Computing Machinery (ACM)
|
|
Compartir:
|
|
