Random Communication Benchmark
4 racks
- 1024 VM nodes (1024 cores)
- 10G network
Hama 0.4
- Work in progress
1 rack
- 16 nodes (256 cores)
- 10G network
Hama 0.4 (r.1163903)
- 48 Tasks (16 tasks per node)
- frequently hangs
Size of each message |
Messages per superstep |
Number of supersteps |
Job runtime |
16 bytes |
1000 |
16 |
16.094 seconds |
16 bytes |
1000 |
32 |
27.748 seconds |
16 bytes |
1000 |
64 |
48.89 seconds |
16 bytes |
1000 |
128 |
84.88 seconds |
16 bytes |
1000 |
256 |
156.773 seconds |
16 bytes |
1000 |
512 |
307.129 seconds |
- 16 Tasks (1 task per node)
Hama 0.3
Improved compared with 0.2-incubating.
Size of each message |
Messages per superstep |
Number of supersteps |
0.2-incubating |
0.3-incubating |
16 bytes |
1000 |
512 |
507.837 seconds |
486.838 seconds |
16 bytes |
1000 |
1024 |
979.198 seconds |
874.016 seconds |
Hama 0.2
Test 1 (many small messages vs. few large messages)
Size of each message |
Messages per superstep |
Number of supersteps |
Job runtime |
500 bytes |
100 |
16 |
7.461 seconds |
500 bytes |
100 |
32 |
9.397 seconds |
500 bytes |
100 |
64 |
14.341 seconds |
500 bytes |
100 |
128 |
26.394 seconds |
500 bytes |
100 |
256 |
43.411 seconds |
500 bytes |
100 |
512 |
84.489 seconds |
500 bytes |
100 |
1024 |
156.581 seconds |
500 bytes |
100 |
2048 |
308.671 seconds |
Size of each message |
Messages per superstep |
Number of supersteps |
Job runtime |
10 kb |
5 |
16 |
13.679 seconds |
10 kb |
5 |
32 |
23.427 seconds |
10 kb |
5 |
64 |
46.398 seconds |
10 kb |
5 |
128 |
86.476 seconds |
10 kb |
5 |
256 |
171.511 seconds |
10 kb |
5 |
512 |
339.608 seconds |
10 kb |
5 |
1024 |
675.994 seconds |
10 kb |
5 |
2048 |
1872.939 seconds |
Test 2
Size of each message |
Messages per superstep |
Number of supersteps |
Job runtime |
16 bytes |
1000 |
16 |
20.365 seconds |
16 bytes |
1000 |
32 |
36.386 seconds |
16 bytes |
1000 |
64 |
67.404 seconds |
16 bytes |
1000 |
128 |
126.503 seconds |
16 bytes |
1000 |
256 |
251.602 seconds |
16 bytes |
1000 |
512 |
507.837 seconds |
16 bytes |
1000 |
1024 |
979.198 seconds |
16 bytes |
1000 |
2048 |
2030.187 seconds |