Differences between revisions 8 and 9
Revision 8 as of 2007-12-29 09:01:07
Size: 2385
Editor: udanax
Comment:
Revision 9 as of 2009-09-20 23:53:57
Size: 2397
Editor: localhost
Comment: converted to 1.6 markup
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
[[TableOfContents(3)]] <<TableOfContents(3)>>
Line 13: Line 13:
[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-250sl-duration.gif][[BR]]
X-axis: time. Y-axis: duration per request in ms.[[BR]]
[[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-250sl-duration.gif]]<<BR>>
X-axis: time. Y-axis: duration per request in ms.<<BR>>
Line 17: Line 17:
[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-250sl-reqs.gif][[BR]]
X-axis: time. Y-axis: requests/second[[BR]]
[[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-250sl-reqs.gif]]<<BR>>
X-axis: time. Y-axis: requests/second<<BR>>
Line 21: Line 21:
[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-125sl-duration.gif][[BR]]
X-axis: time. Y-axis: duration per request in ms.[[BR]]
[[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-125sl-duration.gif]]<<BR>>
X-axis: time. Y-axis: duration per request in ms.<<BR>>
Line 25: Line 25:
[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-125sl-reqs.gif][[BR]]
X-axis: time. Y-axis: requests/second[[BR]]
[[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-125sl-reqs.gif]]<<BR>>
X-axis: time. Y-axis: requests/second<<BR>>
Line 29: Line 29:
[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-80sl-duration.gif][[BR]]
X-axis: time. Y-axis: duration per request in ms.[[BR]]
[[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-80sl-duration.gif]]<<BR>>
X-axis: time. Y-axis: duration per request in ms.<<BR>>
Line 33: Line 33:
[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-80sl-reqs.gif][[BR]]
X-axis: time. Y-axis: requests/second[[BR]]
[[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-80sl-reqs.gif]]<<BR>>
X-axis: time. Y-axis: requests/second<<BR>>


Validating the Real-time Performance of Hbase

I've done some very simple benchmarks that seeks to find out if hbase is suitable for real time data serving.

All benchmarks run with hadoop 0.15.1, 3 datanodes and regionservers. One of them served as master (not ideal, I know). 894621 values were put in the table column retrieved. One separate machine acted as the client, it picked a random key known to be in the dataset and requested that.

The results are very similar to just reading values from a MapFile on the HDFS, suggesting that the performance bottlenecks are not in HBase itself. Not sure why the requests / second graph is so jumpy.

http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-250sl-duration.gif
X-axis: time. Y-axis: duration per request in ms.
50 request threads, waiting 250 ms between each hit.

http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-250sl-reqs.gif
X-axis: time. Y-axis: requests/second
50 request threads, waiting 250 ms between each hit.

http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-125sl-duration.gif
X-axis: time. Y-axis: duration per request in ms.
50 request threads, waiting 125 ms between each hit.

http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-125sl-reqs.gif
X-axis: time. Y-axis: requests/second
50 request threads, waiting 125 ms between each hit.

http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-80sl-duration.gif
X-axis: time. Y-axis: duration per request in ms.
50 request threads, waiting 80 ms between each hit.

http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-80sl-reqs.gif
X-axis: time. Y-axis: requests/second
50 request threads, waiting 80 ms between each hit.

Hbase/HbaseRTDS (last edited 2009-09-20 23:53:57 by localhost)