Differences between revisions 9 and 10
Revision 9 as of 2009-09-20 23:53:57
Size: 2397
Editor: localhost
Comment: converted to 1.6 markup
Revision 10 as of 2015-10-22 21:31:34
Size: 187
Editor: Misty
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
<<TableOfContents(3)>>
----
= Validating the Real-time Performance of Hbase =

I've done some very simple benchmarks that seeks to find out if hbase is suitable for real time data serving.

All benchmarks run with hadoop 0.15.1, 3 datanodes and regionservers. One of them served as master (not ideal, I know).
894621 values were put in the table column retrieved. One separate machine acted as the client, it picked a random key known to be in the dataset and requested that.

The results are very similar to just reading values from a MapFile on the HDFS, suggesting that the performance bottlenecks are not in HBase itself.
Not sure why the requests / second graph is so jumpy.

[[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-250sl-duration.gif]]<<BR>>
X-axis: time. Y-axis: duration per request in ms.<<BR>>
50 request threads, waiting 250 ms between each hit.

[[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-250sl-reqs.gif]]<<BR>>
X-axis: time. Y-axis: requests/second<<BR>>
50 request threads, waiting 250 ms between each hit.

[[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-125sl-duration.gif]]<<BR>>
X-axis: time. Y-axis: duration per request in ms.<<BR>>
50 request threads, waiting 125 ms between each hit.

[[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-125sl-reqs.gif]]<<BR>>
X-axis: time. Y-axis: requests/second<<BR>>
50 request threads, waiting 125 ms between each hit.

[[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-80sl-duration.gif]]<<BR>>
X-axis: time. Y-axis: duration per request in ms.<<BR>>
50 request threads, waiting 80 ms between each hit.

[[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-80sl-reqs.gif]]<<BR>>
X-axis: time. Y-axis: requests/second<<BR>>
50 request threads, waiting 80 ms between each hit.
The HBase Wiki is in the process of being decommissioned. The info that used to be on this page has moved to http://hbase.apache.org/book.html#performance. Please update your bookmarks.

The HBase Wiki is in the process of being decommissioned. The info that used to be on this page has moved to http://hbase.apache.org/book.html#performance. Please update your bookmarks.

Hbase/HbaseRTDS (last edited 2015-10-22 21:31:34 by Misty)