Validating the Real-time Performance of Hbase

I've done some very simple benchmarks that seeks to find out if hbase is suitable for real time data serving.

All benchmarks run with hadoop 0.15.1, 3 datanodes and regionservers. One of them served as master (not ideal, I know). 894621 values were put in the table column retrieved. One separate machine acted as the client, it picked a random key known to be in the dataset and requested that.

The results are very similar to just reading values from a MapFile on the HDFS, suggesting that the performance bottlenecks are not in HBase itself. Not sure why the requests / second graph is so jumpy.

http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-250sl-duration.gif
X-axis: time. Y-axis: duration per request in ms.
50 request threads, waiting 250 ms between each hit.

http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-250sl-reqs.gif
X-axis: time. Y-axis: requests/second
50 request threads, waiting 250 ms between each hit.

http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-125sl-duration.gif
X-axis: time. Y-axis: duration per request in ms.
50 request threads, waiting 125 ms between each hit.

http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-125sl-reqs.gif
X-axis: time. Y-axis: requests/second
50 request threads, waiting 125 ms between each hit.

http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-80sl-duration.gif
X-axis: time. Y-axis: duration per request in ms.
50 request threads, waiting 80 ms between each hit.

http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-80sl-reqs.gif
X-axis: time. Y-axis: requests/second
50 request threads, waiting 80 ms between each hit.

Hbase/HbaseRTDS (last edited 2009-09-20 23:53:57 by localhost)