Page History

...

• Listen on peer host:port
• Initialize IO
  • Input
    • Split class
    • Restore split data from BSPTask.split
  • Output Dir
  • Reinitialize Writer
• Initialize Messaging service (HamaMessageManagerImpl.java)
• Initialize Barrier Sync service

BSPPeerImpl

• Task
  • TaskAttemptID
  • partition
  • splitClass
  • split: ByteWritable
  • superstep
• MessageManager
  • AbstractMessageManager
    • a list of message event listener: MessageEventListener
    • local queue: MessageQueue/ MemoryQueue
    • local queue for next iteration: MessageQueue/ SynchronizedQueue
    • maxCachedConnections: default 100
    • compressor: SnappyCompressor
    • out going message manager: OutgoingMessageManager/ OutgoingPOJOMessageBundle
  • HamaMessageManagerImpl
    • remote listening
    • LRUCache
• IO
  • init input
    • instantiate and restore InputSplit through split class
    • read next record or pair: TrackedRecordReader
    • output dir: "bsp.output.dir" - tmp-${currentTimeMillis}/part-${partition}
    • collector: OutputCollector encapsulates writer (default TextOutputFormat).