Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migration of unmigrated content due to installation of a new plugin

...

JobInProgress contains two sets of TaskInProgress instances:

  • Wiki Markup
    TaskInProgress maps\[\], an array holding one tip per split

  • Wiki Markup
    TaskInProgress reduces\[\], an array holding one tip per partition
    \\

Method initTask() fills out those tips. initTask also creates:

  • Wiki Markup
    hostMaps\[\], which cotains a mapping from a host to file split
         id's that the host is holding on DFS.
    \\

Wiki Markup
JobInProgress also offers two methods for creating a !Task instance to run, out of maps\[\] and reduces\[\]:

...

InputFormat is an interface for instantiating file splits and the readers for map task.

  • Wiki Markup
    FileSplit\[\] getSplits(), creates an array of FileSplit for the
         job. A FileSplit is a span of a given file.

  • RecordReader getRecordReader(), creates a reader for a given split.

...