This effort is still a "work in progress". Please feel free to add comments. BRBut please make them stand out by bolding or underlining them. – Edward J. Yoon
Why sparse matrices?
- Many classes of problems result in matrices with a large number of zeros
- A sparse matrix is a special class of matrix that allows only the non-zero terms to be stored
- Reduction in the storage requirements for sparse matrices
- Significant speed improvement as many calculations involving zero elements are neglected
Storage of sparse matrices
I choosed HBase(sparse matrix storage) to reduce storage and complexity.
- Hama use column-oriented storage of matrices (HBase) , and so compressed column format is a natural choice of sparse storage
- Hama forces the elements of each column to be stored in increasing order of their row index