|
Title:
|
Optimizing computation-communication overlap in asynchronous task-based programs
|
|
Author:
|
Castillo, Emilio; Jain, Nikhil; Casas, Marc; Moreto Planas, Miquel; Schulz, Martin; Beivide Palacio, Julio Ramon; Valero Cortés, Mateo; Bhatele, Abhinav
|
|
Other authors:
|
Universitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors; Universitat Politècnica de Catalunya. CAP - Grup de Computació d'Altes Prestacions |
|
Abstract:
|
Asynchronous task-based programming models are gaining popularity to address the programmability and performance challenges in high performance computing. One of the main attractions of these models and runtimes is their potential to automatically expose and exploit overlap of computation with communication. However, we find that inefficient interactions between these programming models and the underlying messaging layer (in most cases, MPI) limit the achievable computation-communication overlap and negatively impact the performance of parallel programs. We address this challenge by exposing and exploiting information about MPI internals in a task-based runtime system to make better task-creation and scheduling decisions. In particular, we present two mechanisms for exchanging information between MPI and a task-based runtime, and analyze their trade-offs. Further, we present a detailed evaluation of the proposed mechanisms implemented in MPI and a task-based runtime. We show performance improvements of up to 16.3% and 34.5% for proxy applications with point-to-point and collective communication, respectively. |
|
Abstract:
|
Peer Reviewed |
|
Subject(s):
|
-Àrees temàtiques de la UPC::Informàtica::Arquitectura de computadors::Arquitectures paral·leles
-High performance computing
-Parallel programming (Computer science)
-Parallel processing (Electronic computers)
-Task-based programming model
-Computation-communication overlap
-Mpi
-Càlcul intensiu (Informàtica)
-Programació en paral·lel (Informàtica)
-Processament en paral·lel (Ordinadors) |
|
Rights:
|
|
|
Document type:
|
Article - Submitted version
Conference Object |
|
Published by:
|
Association for Computing Machinery (ACM)
|
|
Share:
|
|
