Differences between revisions 4 and 5
Revision 4 as of 2010-09-24 01:56:32
Size: 1015
Comment:
Revision 5 as of 2014-02-21 04:14:22
Size: 1117
Comment: Updated broken links, java api is now part of the hadoop api so I linked to the fs (filesystem) package.
Deletions are marked like this. Additions are marked like this.
Line 2: Line 2:
Hadoop Distributed File System (HDFS) is designed to reliably store very large files across machines in a large cluster. It is inspired by the [[http://labs.google.com/papers/gfs.html|GoogleFileSystem]]. Hadoop Distributed File System (HDFS) is designed to reliably store very large files across machines in a large cluster. It is inspired by the [[http://research.google.com/archive/gfs.html|GoogleFileSystem]].
Line 5: Line 5:
  * [[DFS_requirements]]. Summarizes the requirements Hadoop DFS should be targeted for, and outlines further development steps towards achieving this requirements.
  * [[http://hadoop.apache.org/hdfs/docs/current/|Documentation]]
    * [[http://hadoop.apache.org/hdfs/docs/current/api/|HDFS Java API]]
    * [[http://hadoop.apache.org/hdfs/docs/current/hdfs_design.html|HDFS Architecture Guide]] - a brief description of the design and architecture.
    * [[Hadoop_Upgrade]]. Describes a step-by-step procedure for manual transition of Hadoop cluster to a newer software version, and outlines enhancements intended to make the upgrade simple and safe.
  * [[FAQ]] (look for the questions starting with HDFS.)
  * [[HDFS_Publications]]
 * [[DFS_requirements]]. Summarizes the requirements Hadoop DFS should be targeted for, and outlines further development steps towards achieving this requirements.
 * [[http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HdfsUserGuide.html|Documentation]]
  * [[http://hadoop.apache.org/docs/current/api/org/apache/hadoop/fs/package-summary.html|HDFS Java API]]
  * [[http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HdfsDesign.html|HDFS Architecture Guide]] - a brief description of the design and architecture.
  * [[Hadoop_Upgrade]]. Describes a step-by-step procedure for manual transition of Hadoop cluster to a newer software version, and outlines enhancements intended to make the upgrade simple and safe.
 * [[FAQ]] (look for the questions starting with HDFS.)
 * [[HDFS_Publications]]

Hadoop Distributed File System

Hadoop Distributed File System (HDFS) is designed to reliably store very large files across machines in a large cluster. It is inspired by the GoogleFileSystem.

General Information

  • DFS_requirements. Summarizes the requirements Hadoop DFS should be targeted for, and outlines further development steps towards achieving this requirements.

  • Documentation

    • HDFS Java API

    • HDFS Architecture Guide - a brief description of the design and architecture.

    • Hadoop_Upgrade. Describes a step-by-step procedure for manual transition of Hadoop cluster to a newer software version, and outlines enhancements intended to make the upgrade simple and safe.

  • FAQ (look for the questions starting with HDFS.)

  • HDFS_Publications

HDFS (last edited 2014-02-21 04:14:22 by SteveKallestad)