Page History

...

GroomServer is a process whose main responsibility is to manage bsp tasks. In addition to task management, GroomServer collaborates with BSPMaster so that job execution can be done correctly. Some works Works that GroomServer performs in communicating with BSPMaster include:

1. Check local disk:
   1. Check local disk if writable.
   2. Delete files under local dir (bsp.local.dir)
2. Clear state table:

   1. Wiki Markup
      Clean up tasks (Map\[TaskAttemptID \-> TaskInProgress\])

   2. Wiki Markup
      Initialize job (Map\[BSPJobID \-> RunningJob\])

   3. Wiki Markup
      Cleanup running tasks (Map\[TaskAttemptID \-> TaskInProgress\])

   4. Configure max tasks, default to 3.
3. Start http server: An embedded http service.
4. Start task report server: Communication between GroomServer and spawned child task. See TaskRunner.BspChildRunner
5. Start worker server: RPC service listens to master's direction.
6. Register to BSPMaster: Enroll itself to BSPMaster with GroomServerStatus.
7. Start message dispatcher (Instructor): (TODO: refactor needed)
8. Start monitor service: A process export metrics, task status, etc. information.
   

...