Quickly Launch A Hama Cluster In Cloud Using Whirr
The following commands install Whirr and start a 5 node Hama cluster on Amazon EC2 in 5 minutes or less.
| No Format |
|---|
% curl -O http://www.apache.org/dist/incubator/whirr/whirr-0.6.0-incubating/whirr-0.6.0-incubating.tar.gz % tar zxf whirr-0.6.0-incubating.tar.gz; cd whirr-0.6.0-incubating % export AWS_ACCESS_KEY_ID=YOUR_ID % export AWS_SECRET_ACCESS_KEY=YOUR_SECKEY % ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa_whirr // Launch a Hama cluster on EC2 % bin/whirr launch-cluster --config recipes/hama-ec2.properties --private -key-file ~/.ssh/id_rsa_whirr |
Upon success you should see imokechoed to the console, indicating that ZooKeeper is running.
You can shut down the cluster with
| No Format |
|---|
... Namenode web UI available at http://ec2-184-73-29-237.compute-1.amazonaws.com:50070 Jobtracker web UI available at http://ec2-184-73-29-237.compute-1.amazonaws.com:50030 Wrote Hadoop site file /home/edward/.whirr/hama/hadoop-site.xml Wrote Hadoop proxy script /home/edward/.whirr/hama/hadoop-proxy.sh Completed configuration of hama BSPMaster web UI available at http://ec2-184-73-29-237.compute-1.amazonaws.com:40013 Wrote Hama site file /home/edward/.whirr/hama/hama-site.xml Wrote Hama proxy script /home/edward/.whirr/hama/hama-proxy.sh Wrote instances file /home/edward/.whirr/hama/instances Started cluster of 6 instances ... // Destroy % bin/whirr destroy-cluster --config recipes/hama-ec2.properties |
The various options are explained in more detail in the Whirr website