ml.shifu.guagua.worker

Class SyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>

java.lang.Object

ml.shifu.guagua.BasicCoordinator<MASTER_RESULT,WORKER_RESULT>

ml.shifu.guagua.worker.AbstractWorkerCoordinator<MASTER_RESULT,WORKER_RESULT>

ml.shifu.guagua.worker.SyncWorkerCoordinator<MASTER_RESULT,WORKER_RESULT>

Type Parameters:

MASTER_RESULT - master result for computation in each iteration.

WORKER_RESULT - worker result for computation in each iteration.

All Implemented Interfaces:

WorkerInterceptor<MASTER_RESULT,WORKER_RESULT>, org.apache.zookeeper.Watcher

public class SyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
extends AbstractWorkerCoordinator<MASTER_RESULT,WORKER_RESULT>

SyncWorkerCoordinator is used to as a worker barrier for each iteration.

For each iteration, SyncWorkerCoordinator will wait until master's signal.

To start a new iteration, SyncMasterCoordinator will write a znode for each iteration like '/_guagua/job_201312041304_189025/master/{currentIteration}' with with MasterComputable result as its data. SyncWorkerCoordinator is trying to detect whether it exists, if yes, to start a new iteration.

Worker result will be written into each worker iteration znode for master to get.

Nested Class Summary

Nested classes/interfaces inherited from class ml.shifu.guagua.worker.AbstractWorkerCoordinator

AbstractWorkerCoordinator.FailOverCoordinatorCommand

Nested classes/interfaces inherited from class ml.shifu.guagua.BasicCoordinator

BasicCoordinator.BasicCoordinatorCommand, BasicCoordinator.CoordinatorCommand, BasicCoordinator.GetSplitBytes, BasicCoordinator.RetryCoordinatorCommand, BasicCoordinator.SaveResultToZookeeper

Nested classes/interfaces inherited from interface org.apache.zookeeper.Watcher

org.apache.zookeeper.Watcher.Event

Field Summary

Fields inherited from class ml.shifu.guagua.BasicCoordinator

WAIT_SLOT_MILLS

Constructor Summary

Constructors

Constructor and Description
SyncWorkerCoordinator()

Method Summary

Modifier and Type	Method and Description
void	postIteration(WorkerContext<MASTER_RESULT,WORKER_RESULT> context) The hook point after computation of each iteration.
void	preApplication(WorkerContext<MASTER_RESULT,WORKER_RESULT> context) The hook point before any computation logic.

Methods inherited from class ml.shifu.guagua.worker.AbstractWorkerCoordinator

postApplication, preIteration, setMasterResult

Methods inherited from class ml.shifu.guagua.BasicCoordinator

checkAndSetZooKeeper, close, getAppNode, getBaseMasterElectionNode, getBytesFromZNode, getCurrentMasterNode, getCurrentMasterSplitNode, getCurrentWorkerNode, getCurrentWorkerSplitNode, getLastMasterNode, getLastWorkerNode, getMasterBaseNode, getMasterElectionNode, getMasterNode, getMasterSerializer, getRootNode, getSleepTime, getWorkerBaseNode, getWorkerBaseNode, getWorkerNode, getWorkerSerializer, getZkConnLatch, getZooKeeper, initialize, isFixedTime, process, setBytesToZNode, setFixedTime, setMasterSerializer, setSleepTime, setWorkerSerializer, setZooKeeper, startHeartbeat, stopHeartBeat

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SyncWorkerCoordinator

public SyncWorkerCoordinator()

Method Detail

preApplication

public void preApplication(WorkerContext<MASTER_RESULT,WORKER_RESULT> context)

Description copied from interface: WorkerInterceptor

The hook point before any computation logic.

Parameters:

context - the worker context instance which includes master result and other useful parameters.

postIteration

public void postIteration(WorkerContext<MASTER_RESULT,WORKER_RESULT> context)

Description copied from interface: WorkerInterceptor

The hook point after computation of each iteration.

Parameters:

context - the worker context instance which includes master result and other useful parameters.