...
- Maintaining its own state.
- Maintaining groom server status.
- Maintaining supersteps and other counters in a cluster.
- Maintaining job progress information jobs and tasks.
- Scheduling Jobs and assigning tasks to groom servers
- Distributing execution classes and configuration across groom servers.
- Providing users with the cluster control interface (web and console based).
...
Communication and Synchronization Process
Each BSPTask BSP task has a set of private outgoing and incoming queues. So,
...
Outgoing Message Manager and Incoming Queue.
Outgoing Message Manager collects the message to be sent
...
, serializes it, compresses it and puts it in a bundles. At barrier synchronization phase, each BSP task exchanges the bundles, deserializes it, decompresses it and puts it into the Incoming Queue.
System Diagram
- BSPMaster starts up
- GroomServer starts up
- ZooKeeper cluster starts up
- GroomServer dynamically registers itself to BSPMaster
- GroomServer forks/ manages BSPPeer(s)
- BSPPeers communicate/ perform barrier synchronization through ZooKeeper cluster.
...