|
Título:
|
Speeding up distributed MapReduce applications using hardware accelerators
|
|
Autor/a:
|
Becerra Fontal, Yolanda; Beltran Querol, Vicenç; Carrera Pérez, David; González Tallada, Marc; Torres Viñals, Jordi; Ayguadé Parra, Eduard
|
|
Otros autores:
|
Universitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors; Universitat Politècnica de Catalunya. CAP - Grup de Computació d'Altes Prestacions |
|
Abstract:
|
In an attempt to increase the performance/cost ratio, large compute clusters are becoming heterogeneous at multiple levels: from asymmetric processors, to different system architectures, operating systems and networks. Exploiting the intrinsic multi-level parallelism present in such a complex execution environment has become a challenging task using traditional
parallel and distributed programming models. As a result, an increasing need for novel approaches to exploiting parallelism
has arisen in these environments. MapReduce is a data-driven programming model originally proposed by Google back in
2004 as a flexible alternative to the existing models, specially devoted to hiding the complexity of both developing and running
massively distributed applications in large compute clusters. In some recent works, the MapReduce model has been also used
to exploit parallelism in other non-distributed environments, such as multi-cores, heterogeneous processors and GPUs. In
this paper we introduce a novel approach for exploiting the heterogeneity of a Cell BE cluster linking an existing MapReduce
runtime implementation for distributed clusters and one runtime to exploit the parallelism of the Cell BE nodes. The novel
contribution of this work is the design and evaluation of a MapReduce execution environment that effectively exploits the
parallelism existing at both the Cell BE cluster level and the heterogeneous processors level. |
|
Abstract:
|
This work is partially supported by the Ministry of Science and Technology of Spain and the European Union (FEDER funds) under contract TIN2007-60625, the European Commission in the context of the FP7 HiPEAC Network of Excellence (contract no. IST-004408) and the FP7 PRACE Partnership for Advanced Computing in Europe (contract no. RI-211528), and the MareIncognito project under the BSC-IBM collaboration agreement. |
|
Abstract:
|
We thank Atrapalo.com for the datasets, feedback, and domain knowledge for this study. We also acknowledge Aubrey Rembert who developed and offered support on the knowledge-based miner. This work is partially
supported by the Ministry of Science and Technology of Spain under contract TIN2012-34557. |
|
Abstract:
|
Peer Reviewed |
|
Materia(s):
|
-Àrees temàtiques de la UPC::Informàtica::Hardware
-Microprocessors
-Hardware accelerators
-MapReduce
-Cell BE
-Multi-core processors
-Microprocessadors |
|
Derechos:
|
|
|
Tipo de documento:
|
Artículo - Versión publicada
Objeto de conferencia |
|
Compartir:
|
|
