Hbase

HBase: Bigtable-like structured storage for Hadoop HDFS

Just as Google's Bigtable leverages the distributed data storage provided by the Google File System, HBase provides Bigtable-like capabilities on top of Hadoop Core. Data is organized into tables, rows and columns. An Iterator-like interface is available for scanning through a row range (and of course there is the ability to retrieve a column value for a specific key). Any particular column may have multiple versions for the same row key.

General Information

• HBase Home Page -- hbase.org

• HBase Architecture -- (updated 2008/09/05)

• FAQ and Troubleshooting

• Support:

  • HBase Mailing Lists See also the Hadoop Mailing Lists

  • HBase IRC Channel

• HBase news, presentations, articles, and twitter.

• PoweredBy, a list of sites and applications powered by HBase

• SupportingProjects

Administrators / Setup Guides and config

• Getting Started

• HBase and Performance

  • Performance Tuning

  • Tools for evaluating HBase performance and scalability

    • There are setup instructions and a JMeter Test Plan in HADOOP-2625

• Using LZO Compression

• Rolling Restart of HBase

• Migrating between HBase versions

  • Migration from one version of HBase to another

  • API changes

  • Design of the Migration system

• Scripts for HBase on EC2

User Developer Documentation

• HBase API Docs

• HBase Shell -- Based on Ruby's IRB

  • JRuby interface to HBase -- obsoleted by the new (J)IRB shell

• HBase non-java access

  • Jython interface to HBase

  • Groovy DSL for HBase

  • REST gateway specification for HBase

  • Thrift gateway specification for HBase

  • Ruby client for Hbase's REST API

• Using HBase with Hadoop MapReduce -- Obsoleted by HBase MapReduce Package Summary

• Using HBase with Cascading

Developer Documentation

• Roadmaps -- TODO: Update!

• How to contribute

• How to build HBase under Eclipse

• How to test HBase

• How to commit

• How to release

• How to rate the priority of your issues in JIRA

• The HBase/Bigtable Data Model

Design Documents

• HRegionServer locking

• Column caching

• HBase Design Overview (Under Construction)

• Glossary (Under Construction)

Obsolete/Stale

• Discussion of new file format -- hfile has become the new store file format in hbase

• HBase/Zookeeper integration documentation -- integrated

• Using Bloom Filters -- removed in 0.20.x, to be reinstated in 0.21.x

• Unofficial Blog

• How to download and run hbase in about 10 Minutes.

• A performance evaluation of HBase