|
Title:
|
Towards intelligent data analysis : the metadata challenge
|
|
Author:
|
Bilalli, Besim; Abelló Gamazo, Alberto; Aluja Banet, Tomàs; Wrembel, Robert
|
|
Other authors:
|
Universitat Politècnica de Catalunya. Departament d'Enginyeria de Serveis i Sistemes d'Informació; Universitat Politècnica de Catalunya. Departament d'Estadística i Investigació Operativa; Universitat Politècnica de Catalunya. MPI - Modelització i Processament de la Informació; Universitat Politècnica de Catalunya. LIAM - Laboratori de Modelització i Anàlisi de la Informació |
|
Abstract:
|
Once analyzed correctly, data can yield substantial benefits. The process of analyzing the data and transforming it into knowledge is known as Knowledge Discovery in Databases (KDD). The plethora and subtleties of algorithms in the different steps of KDD, render it challenging. An effective user support is of crucial importance, even more now, when the analysis is performed on Big Data. Metadata is the necessary component to drive the user support. In this paper we study the metadata required to provide user support on every stage of the KDD process. We show that intelligent systems addressing the problem of user assistance in KDD are incomplete in this regard. They do not use the whole potential of metadata to enable assistance during the whole process. We present a comprehensive classification of all the metadata required to provide user support. Furthermore, we present our implementation of a metadata repository for storing and managing this metadata and explain its benefits in a real Big Data analytics project. |
|
Abstract:
|
Peer Reviewed |
|
Subject(s):
|
-Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació
-Metadata
-Data mining
-Big data
-Data mining
-Digital storage
-Intelligent systems
-Internet
-Internet of things – Metadata
-Data analytics
-Intelligent data analysis
-Knowledge discovery in database
-Metadata repositories
-User assistance
-User support
-Whole process
-Metadades
-Mineria de dades
-Macrodades |
|
Rights:
|
|
|
Document type:
|
Article - Published version
Conference Object |
|
Share:
|
|
