HBase: Bigtable-like structured storage for Hadoop HDFS

Just as Google's Bigtable leverages the distributed data storage provided by the Google File System, HBase provides Bigtable-like capabilities on top of Hadoop Core.

General Information

• HBase Home Page -- hbase.org

• HBase Architecture -- last updated 2008/09/05 (its old -- in need of a rewrite). See also this description of the HBase Storage Architecture by Lars George.

• Support:

  • HBase Mailing Lists

  • HBase IRC Channel

  • FAQ and Troubleshooting

• HBase news, presentations, articles, and twitter.

• PoweredBy, a list of sites and applications powered by HBase

• SupportingProjects

• Profiling: The HBase project uses JProfiler thanks to a generous donation by ej-technologies.

Administrators / Setup Guides and configuration

• Getting Started

• Packaged versions of HBase

• HBase and Performance

  • Performance Tuning

  • Tools for evaluating HBase performance and scalability

  • Using LZO Compression

• How to setup multiple HBase Masters for higher availability

• Rolling Restart of HBase

• Migrating between HBase versions

  • Migration from one version of HBase to another

  • Design of the Migration system

• Scripts for HBase on EC2

• Stargate REST Connector

User / Developer Documentation

• HBase API Docs, in particular the Java client API

• HBase Shell -- Based on Ruby's IRB

  • HBase-Runner: Clojure REPL interface to HBase

• HBase non-java access
  • languages talking to the JVM:

    • Jython interface to HBase

    • Groovy DSL for HBase

    • Scala interface to HBase

  • languages with a custom protocol:

    • REST gateway specification for HBase -- obsoleted by Stargate REST Connector

    • Thrift gateway specification for HBase

• Using HBase with Hadoop MapReduce. There is also a backwards compatible API for use with the corresponding backwards compatible MapReduce API still available in Hadoop 0.20: Using HBase with deprecated Hadoop MapReduce APIs

• Using HBase with Cascading

• Ivy and HBase

Developer Documentation

• Roadmaps

• How to contribute

• How to test HBase

• How to commit

• How to release

• How to rate the priority of your issues in JIRA

Design Documents

• HRegionServer locking

• Glossary (Under Construction)

• 0.21 Design

  • HBase Master Rewrite

Obsolete/Stale

• Discussion of new file format -- hfile has become the new store file format in hbase

• HBase/Zookeeper integration documentation -- integrated

• Using Bloom Filters -- removed in 0.20.x, to be reinstated in 0.21.x

• How to download and run hbase in about 10 Minutes.

• A performance evaluation of HBase

• JRuby interface to HBase -- obsoleted by the new (J)IRB shell

• Using HBase with Hadoop MapReduce -- Obsoleted by HBase MapReduce Package Summary

• There are setup instructions and a JMeter Test Plan in HADOOP-2625

• Ruby client for Hbase's REST API

• The HBase/Bigtable Data Model

• How to build HBase under Eclipse

• API changes

• Column caching

• HBase Design Overview (Under Construction)