Benchmarks

Created by Edward J. Yoon, last modified on Sep 08, 2011

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Random Communication Benchmark

4 racks

1024 VM nodes (1024 cores)
10G network

Hama 0.4

Work in progress

1 rack

16 nodes (256 cores)
10G network

Hama 0.4 (r.1163903)

48 Tasks (16 tasks per node)
frequently hangs

Size of each message	Messages per superstep	Number of supersteps	Job runtime
16 bytes	1000	16	16.094 seconds
16 bytes	1000	32	27.748 seconds
16 bytes	1000	64	48.89 seconds
16 bytes	1000	128	84.88 seconds
16 bytes	1000	256	156.773 seconds
16 bytes	1000	512	307.129 seconds

16 Tasks (1 task per node)

Hama 0.3

Improved compared with 0.2-incubating.

Size of each message	Messages per superstep	Number of supersteps	0.2-incubating	0.3-incubating
16 bytes	1000	512	507.837 seconds	486.838 seconds
16 bytes	1000	1024	979.198 seconds	874.016 seconds

Hama 0.2

Test 1 (many small messages vs. few large messages)

Size of each message	Messages per superstep	Number of supersteps	Job runtime
500 bytes	100	16	7.461 seconds
500 bytes	100	32	9.397 seconds
500 bytes	100	64	14.341 seconds
500 bytes	100	128	26.394 seconds
500 bytes	100	256	43.411 seconds
500 bytes	100	512	84.489 seconds
500 bytes	100	1024	156.581 seconds
500 bytes	100	2048	308.671 seconds

Size of each message	Messages per superstep	Number of supersteps	Job runtime
10 kb	5	16	13.679 seconds
10 kb	5	32	23.427 seconds
10 kb	5	64	46.398 seconds
10 kb	5	128	86.476 seconds
10 kb	5	256	171.511 seconds
10 kb	5	512	339.608 seconds
10 kb	5	1024	675.994 seconds
10 kb	5	2048	1872.939 seconds

Test 2

Size of each message	Messages per superstep	Number of supersteps	Job runtime
16 bytes	1000	16	20.365 seconds
16 bytes	1000	32	36.386 seconds
16 bytes	1000	64	67.404 seconds
16 bytes	1000	128	126.503 seconds
16 bytes	1000	256	251.602 seconds
16 bytes	1000	512	507.837 seconds
16 bytes	1000	1024	979.198 seconds
16 bytes	1000	2048	2030.187 seconds

No labels