View Source

Random Communication Benchmark

4 racks

1024 VM nodes (1024 cores)
10G network

Hama 0.4

Work in progress

1 rack

16 nodes (256 cores)
10G network

Hama 0.4 (r.1177507)

160 Tasks (10 tasks per node)

Size of each message	Messages per superstep	Number of supersteps	Job runtime
16 bytes	10,000	32	63.875 seconds
16 bytes	20,000	32	81.76 seconds
16 bytes	30,000	32	102.879 seconds
16 bytes	40,000	32	117.783 seconds
16 bytes	50,000	32	129.778 seconds
16 bytes	60,000	32	147.876 seconds
16 bytes	70,000	32	156.896 seconds
16 bytes	80,000	32	184.609 seconds
16 bytes	90,000	32	187.035 seconds
16 bytes	100,000	32	199.027 seconds

16 Tasks (1 task per node)

Hama 0.3

Improved compared with 0.2-incubating.

Size of each message	Messages per superstep	Number of supersteps	0.2-incubating	0.3-incubating
16 bytes	1000	512	507.837 seconds	486.838 seconds
16 bytes	1000	1024	979.198 seconds	874.016 seconds

Hama 0.2

Test 1 (many small messages vs. few large messages)

Size of each message	Messages per superstep	Number of supersteps	Job runtime
500 bytes	100	16	7.461 seconds
500 bytes	100	32	9.397 seconds
500 bytes	100	64	14.341 seconds
500 bytes	100	128	26.394 seconds
500 bytes	100	256	43.411 seconds
500 bytes	100	512	84.489 seconds
500 bytes	100	1024	156.581 seconds
500 bytes	100	2048	308.671 seconds

Size of each message	Messages per superstep	Number of supersteps	Job runtime
10 kb	5	16	13.679 seconds
10 kb	5	32	23.427 seconds
10 kb	5	64	46.398 seconds
10 kb	5	128	86.476 seconds
10 kb	5	256	171.511 seconds
10 kb	5	512	339.608 seconds
10 kb	5	1024	675.994 seconds
10 kb	5	2048	1872.939 seconds

Test 2

Size of each message	Messages per superstep	Number of supersteps	Job runtime
16 bytes	1000	16	20.365 seconds
16 bytes	1000	32	36.386 seconds
16 bytes	1000	64	67.404 seconds
16 bytes	1000	128	126.503 seconds
16 bytes	1000	256	251.602 seconds
16 bytes	1000	512	507.837 seconds
16 bytes	1000	1024	979.198 seconds
16 bytes	1000	2048	2030.187 seconds