ml.shifu.guagua.master

Class SyncMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>

java.lang.Object

ml.shifu.guagua.BasicCoordinator<MASTER_RESULT,WORKER_RESULT>

ml.shifu.guagua.master.AbstractMasterCoordinator<MASTER_RESULT,WORKER_RESULT>

ml.shifu.guagua.master.SyncMasterCoordinator<MASTER_RESULT,WORKER_RESULT>

Type Parameters:

MASTER_RESULT - master result for computation in each iteration.

WORKER_RESULT - worker result for computation in each iteration.

All Implemented Interfaces:

MasterInterceptor<MASTER_RESULT,WORKER_RESULT>, org.apache.zookeeper.Watcher

public class SyncMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
extends AbstractMasterCoordinator<MASTER_RESULT,WORKER_RESULT>

SyncMasterCoordinator is used to as a barrier for each iteration.

For each iteration, SyncMasterCoordinator will wait until all workers are done.

To start a new iteration, SyncMasterCoordinator will write a znode for each iteration like '/_guagua/job_201312041304_189025/master/{currentIteration}' with with MasterComputable MASTER_RESULT, WORKER_RESULT as its data. This is like a signal to notify workers.

Workers are waiting on current master znode, if got current master znode, it will start another iteration

Nested Class Summary

Nested classes/interfaces inherited from class ml.shifu.guagua.master.AbstractMasterCoordinator

AbstractMasterCoordinator.FailOverCommand, AbstractMasterCoordinator.MasterElectionCommand

Nested classes/interfaces inherited from class ml.shifu.guagua.BasicCoordinator

BasicCoordinator.BasicCoordinatorCommand, BasicCoordinator.CoordinatorCommand, BasicCoordinator.GetSplitBytes, BasicCoordinator.RetryCoordinatorCommand, BasicCoordinator.SaveResultToZookeeper

Nested classes/interfaces inherited from interface org.apache.zookeeper.Watcher

org.apache.zookeeper.Watcher.Event

Field Summary

Fields inherited from class ml.shifu.guagua.BasicCoordinator

WAIT_SLOT_MILLS

Constructor Summary

Constructors

Constructor and Description
SyncMasterCoordinator()

Method Summary

Modifier and Type	Method and Description
void	preApplication(MasterContext<MASTER_RESULT,WORKER_RESULT> context) The hook point before any computation logic.
void	preIteration(MasterContext<MASTER_RESULT,WORKER_RESULT> context) The hook point before computation of each iteration.

Methods inherited from class ml.shifu.guagua.master.AbstractMasterCoordinator

getMyBid, isAllWorkersHalt, postApplication, postIteration, setMasterResult, setMyBid, setWorkerResults, updateMasterHaltStatus

Methods inherited from class ml.shifu.guagua.BasicCoordinator

checkAndSetZooKeeper, close, getAppNode, getBaseMasterElectionNode, getBytesFromZNode, getCurrentMasterNode, getCurrentMasterSplitNode, getCurrentWorkerNode, getCurrentWorkerSplitNode, getLastMasterNode, getLastWorkerNode, getMasterBaseNode, getMasterElectionNode, getMasterNode, getMasterSerializer, getRootNode, getSleepTime, getWorkerBaseNode, getWorkerBaseNode, getWorkerNode, getWorkerSerializer, getZkConnLatch, getZooKeeper, initialize, isFixedTime, process, setBytesToZNode, setFixedTime, setMasterSerializer, setSleepTime, setWorkerSerializer, setZooKeeper, startHeartbeat, stopHeartBeat

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SyncMasterCoordinator

public SyncMasterCoordinator()

Method Detail

preApplication

public void preApplication(MasterContext<MASTER_RESULT,WORKER_RESULT> context)

Description copied from interface: MasterInterceptor

The hook point before any computation logic.

Parameters:

context - the master context instance which includes worker results and other useful parameters.

preIteration

public void preIteration(MasterContext<MASTER_RESULT,WORKER_RESULT> context)

Description copied from interface: MasterInterceptor

The hook point before computation of each iteration.

Parameters:

context - the master context instance which includes worker results and other useful parameters.