- work in progress.
NOTE: All evaluation include the load time and save time on HDFS/Hbase.
Hama 0.19
Matrix Multiplication
Node | Size | Density | Blocking Job | Multiplication |
5 | 5,000 * 5,000 | 100% | 21mins, 32sec | 13mins, 17sec |
Node | Size | Density | Blocking Job | Multiplication |
10 | 5,000 * 5,000 | 100% | 13mins, 31sec | 5mins, 25sec |
Matrix Transpose
Node | Size | Density | Running for |
5 | 5,000 * 5,000 | 100% | 19mins, 48sec |
Node | Size | Density | Running for |
10 | 5,000 * 5,000 | 100% | 12mins, 24sec |
Matrix Norm
Node | Type | Size | Density | Running for |
5 | One | 5,000 * 5,000 | 100% | 9mins, 32sec |
5 | Infinity | 5,000 * 5,000 | 100% | 8mins, 11sec |
5 | Maxvalue | 5,000 * 5,000 | 100% | 8mins, 58sec |
5 | Frobenius | 5,000 * 5,000 | 100% | 8mins, 42sec |
Node | Type | Size | Density | Running for |
10 | One | 5,000 * 5,000 | 100% | 2mins, 35sec |
10 | Infinity | 5,000 * 5,000 | 100% | 2mins, 19sec |
10 | Maxvalue | 5,000 * 5,000 | 100% | 2mins, 22sec |
10 | Frobenius | 5,000 * 5,000 | 100% | 2mins, 25sec |
Benchmarks
- Dense matrix add
- Dense matrix multiply
- Dense LU factorization
- Transpose
- Matrix tridiagonalization, for eigenvalue computations of symmetric matrices.
Version | Operation | Cluster Size | Rows | Columns | Total Maps | Total Reduces | Time (seconds) | Bytes Written |
Trunk 712655 | Addition | 2 node | 1,000 | 1,000 | 2 | 2 | 17 seconds | 66,326,104 |
Trunk 712655 | SIMDMult | 2 node | 300 | 300 | 2 | 2 | x | x |
Trunk 712655 | SIMDMult | 2 node | 200 | 200 | 10 | 1 | 41 seconds | 1,277,170,348 |
Trunk 712655 | SIMDMult | 2 node | 300 | 300 | 60 | 2 | 315 seconds | 7,070,789,092 |
|
|
|
|
|
|
|
|
|
Trunk 712658 | SIMDMult | 2 node | 300 | 300 | 2 | 2 | 181 seconds | 5,929,512 |
Trunk 712658 | SIMDMult | 2 node | 200 | 200 | 10 | 1 | 72 seconds | 4,931,106 |
Trunk 712658 | SIMDMult | 2 node | 300 | 300 | 60 | 2 | 267 seconds | 16,507,848 |
Dependencies Information :
- Hadoop 0.18.2
- Hbase 0.18.1
Hardware Information :
...