NUMA-Aware Strategies for the Heterogeneous Execution of SPMV on Modern Supercomputers

14th WCCM-ECCOMAS Congress 2020

The sparse matrix-vector product is a widespread operation amongst the scientific computing community. It represents the dominant computational cost in many large-scale simulations relying on iterative methods, and its performance is sensitive to the sparse pattern, the storage format and kernel implementation, and the target computing architecture. In this work, we are devoted to the efficient execution of the sparse matrix-vector product on (potentially hybrid) modern supercomputers with non-uniform memory access configurations. A hierarchical parallel implementation is proposed to minimise the number of processes participating in distributed-memory parallelisation. As a result, a single process per computing node is enough to engage all its hardware and ensure efficient memory access on manycore platforms. The benefits of this approach have been demonstrated on up to 9,600 cores of MareNostrum 4 supercomputer, at Barcelona Supercomputing Center.

Document data

How to cite

Diff selection: Mark the radio boxes of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.

Document information

Published on 11/03/21
Submitted on 11/03/21


Volume 1400 - Software, High Performance Computing, 2021
DOI: 10.23967/wccm-eccomas.2020.223
Licence: CC BY-NC-SA license

Categories

Engineering, Mechanical

Mechanics

Document Score
0

Views 40
Recommendations 0