|
Size: 2385
Comment:
|
← Revision 9 as of 2009-09-20 23:53:57 ⇥
Size: 2397
Comment: converted to 1.6 markup
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| [[TableOfContents(3)]] | <<TableOfContents(3)>> |
| Line 13: | Line 13: |
| [http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-250sl-duration.gif][[BR]] X-axis: time. Y-axis: duration per request in ms.[[BR]] |
[[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-250sl-duration.gif]]<<BR>> X-axis: time. Y-axis: duration per request in ms.<<BR>> |
| Line 17: | Line 17: |
| [http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-250sl-reqs.gif][[BR]] X-axis: time. Y-axis: requests/second[[BR]] |
[[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-250sl-reqs.gif]]<<BR>> X-axis: time. Y-axis: requests/second<<BR>> |
| Line 21: | Line 21: |
| [http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-125sl-duration.gif][[BR]] X-axis: time. Y-axis: duration per request in ms.[[BR]] |
[[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-125sl-duration.gif]]<<BR>> X-axis: time. Y-axis: duration per request in ms.<<BR>> |
| Line 25: | Line 25: |
| [http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-125sl-reqs.gif][[BR]] X-axis: time. Y-axis: requests/second[[BR]] |
[[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-125sl-reqs.gif]]<<BR>> X-axis: time. Y-axis: requests/second<<BR>> |
| Line 29: | Line 29: |
| [http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-80sl-duration.gif][[BR]] X-axis: time. Y-axis: duration per request in ms.[[BR]] |
[[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-80sl-duration.gif]]<<BR>> X-axis: time. Y-axis: duration per request in ms.<<BR>> |
| Line 33: | Line 33: |
| [http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-80sl-reqs.gif][[BR]] X-axis: time. Y-axis: requests/second[[BR]] |
[[http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-80sl-reqs.gif]]<<BR>> X-axis: time. Y-axis: requests/second<<BR>> |
Validating the Real-time Performance of Hbase
I've done some very simple benchmarks that seeks to find out if hbase is suitable for real time data serving.
All benchmarks run with hadoop 0.15.1, 3 datanodes and regionservers. One of them served as master (not ideal, I know). 894621 values were put in the table column retrieved. One separate machine acted as the client, it picked a random key known to be in the dataset and requested that.
The results are very similar to just reading values from a MapFile on the HDFS, suggesting that the performance bottlenecks are not in HBase itself. Not sure why the requests / second graph is so jumpy.
http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-250sl-duration.gif
X-axis: time. Y-axis: duration per request in ms.
50 request threads, waiting 250 ms between each hit.
HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-250sl-duration.gif){kind=link}
http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-250sl-reqs.gif
X-axis: time. Y-axis: requests/second
50 request threads, waiting 250 ms between each hit.
HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-250sl-reqs.gif){kind=link}
http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-125sl-duration.gif
X-axis: time. Y-axis: duration per request in ms.
50 request threads, waiting 125 ms between each hit.
HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-125sl-duration.gif){kind=link}
http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-125sl-reqs.gif
X-axis: time. Y-axis: requests/second
50 request threads, waiting 125 ms between each hit.
HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-125sl-reqs.gif){kind=link}
http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-80sl-duration.gif
X-axis: time. Y-axis: duration per request in ms.
50 request threads, waiting 80 ms between each hit.
HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-80sl-duration.gif){kind=link}
http://wiki.apache.org/lucene-hadoop-data/attachments/Hbase(2f)HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-80sl-reqs.gif
X-axis: time. Y-axis: requests/second
50 request threads, waiting 80 ms between each hit.
HbaseRTDS/attachments/C__Documents%20and%20Settings_Administrator_Desktop_hbase-3n-50t-80sl-reqs.gif){kind=link}