A flexible parallel runtime for large scale block-based matrix multiplication

Abstract

Block-based matrix multiplication plays an important role in statics computing. It is hard to make large scale matrix multiplication in data statistics and analysis. A flexible parallel runtime for large scale block-based matrix is proposed in this paper. With MapReduce framework, four parallel matrix multiplication methods have been discussed. Three methods use the HDFS to be the storage and one method utilizes the Cloud storage to be the storage. The parallel runtime will determine to use the appropriate block-based matrix multiplication. Experiments have been made to test the proposed flexible parallel runtime with large scale randomly generated data and public matrix collection. The results have shown that the proposed runtime has a good effect to select the best matrix multiplication strategy. © 2012 Springer-Verlag Berlin Heidelberg.