HBase 0.21 Roadmap

Original 0.21 roadmap was done back in 08/2009. HBase is still not out as of this writing on 04/2010 hence we have a Stale 0.21 Roadmap that we need to update, the Current 0.21 Roadmap

Current 0.21 Roadmap

The 0.21 RoadMap, Hackathon3 draft.

  • HBase 0.21 will run on Hadoop 0.20 and Hadoop 0.21.
  • Pile in to help get HDFS performance and hbase-needed features committed: HDFS-895, etc. What else?

What else?

Original (Stale)0.21 Roadmap

Here is the old HBase 0.21 list, made for the timeframe of approximately August-September of 2009. It was drafted at Hackathon2 at StumbleUpon in 08/2009. Its since obsoleted by the above, moved aside on 04/17/2010.

Some of the below had detail added later: HBase Hackathon 2 Wrap-Up: Day One.

  • Data integrity
    • Insure that proper append() support in HDFS actually closes the WAL last block write hole Still not done in 04/2010 but should be a version in 0.20.5 – Stack
    • HBase-FSCK HBASE-7 – Suggest making this a blocker for 0.21. Still not done in 04/2010 – Stack
  • Master rewrite / Move more state management to ZooKeeper Still not done in 04/2010, design outline available at Master Rewrite Design – Stack
    • Host HTD and HCD in ZK with copies in META only for cold boot scenarios HBASE-1730
    • Region assignment via ZK primitives
    • HRS load state sharing
  • Replication HBASE-1295 Version in test now – Stack
  • Unit test speed up by order of magnitude HBASE-410 HBASE-1556 Partial revamp, much more to do to make hbase easier to test – Stack
  • New RPC (Avro? Thrift?) HBASE-794 – for speed improvements and to get away from having to manually set 'handlers'. Still not done in 04/2010, Avro doesn't yet have an RPC we'd want to move to (better serialization is nice an' all but its the transport we're interested in...) – Stack
  • C/C++ client API HBASE-1015 Still not done in 04/2010, and desire has slipped – Stack
  • New UI webapp – Currently if master transistion, UI transitions with master. If 5 masters, where's my UI after master failover? Still not done in 04/2010 – Stack
  • Uploader that writes the filesystem rather than the HBase API HBASE-48 – Is whats there sufficient? Done for single-family case – Stack
  • Distributed log splitting HBASE-1364 Still not done in 04/2010 – Stack
  • Pool of commit loggers in each HRegionServer HBASE-1416 Still not done in 04/2010 and of less import – Stack
  • Refactor HRS HBASE-1406 Still not done in 04/2010 – Stack
  • Intra-row scanning HBASE-1537 Done – Stack
  • Bloom filters revisit HBASE-1200 Still not done in 04/2010, currently under active dev – Stack
  • Update thrift IDL to match new, rich hbase API HBASE-1744 Still not done in 04/2010, currently under active dev – Stack
  • Stargate Roadmap
  • No labels