...
I ran the "random communication benchmark" on one whole rack:
- 16 nodes (256 cores)
- 1G/10G network
Test 1 (many small messages vs. few large messages)
...
Size of each message | Number of send and receive | Number of supersteps | Job runtime |
10 kb | 5 | 16 | 13.679 seconds |
10 kb | 5 | 32 | 23.427 seconds |
10 kb | 5 | 64 | 46.398 seconds |
10 kb | 5 | 128 | 86.476 seconds |
10 kb | 5 | 256 | 171.511 seconds |
10 kb | 5 | 512 | 339.608 seconds |
10 kb | 5 | 1024 | 675.994 seconds |
10 kb | 5 | 2048 | 1872.939 seconds |
Test 2
Size of each message | Number of send and receive | Number of supersteps | Job runtime |
16 bytes | 1000 | 16 | 20.365 seconds |
16 bytes | 1000 | 32 | 36.386 seconds |
16 bytes | 1000 | 64 | 67.404 seconds |
16 bytes | 1000 | 128 | 126.503 seconds |
16 bytes | 1000 | 256 | 251.602 seconds |
16 bytes | 1000 | 512 | 507.837 seconds |
16 bytes | 1000 | 1024 | 979.198 seconds |
16 bytes | 1000 | 2048 | 2030.187 seconds |