ml.shifu.guagua.worker
类 SyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
java.lang.Object
ml.shifu.guagua.BasicCoordinator<MASTER_RESULT,WORKER_RESULT>
ml.shifu.guagua.worker.AbstractWorkerCoordinator<MASTER_RESULT,WORKER_RESULT>
ml.shifu.guagua.worker.SyncWorkerCoordinator<MASTER_RESULT,WORKER_RESULT>
- 类型参数:
MASTER_RESULT - master result for computation in each iteration.WORKER_RESULT - worker result for computation in each iteration.
- 所有已实现的接口:
- WorkerInterceptor<MASTER_RESULT,WORKER_RESULT>, org.apache.zookeeper.Watcher
public class SyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
- extends AbstractWorkerCoordinator<MASTER_RESULT,WORKER_RESULT>
SyncWorkerCoordinator is used to as a worker barrier for each iteration.
For each iteration, SyncWorkerCoordinator will wait until master's signal.
To start a new iteration, SyncMasterCoordinator will write a znode for each iteration like
'/_guagua/job_201312041304_189025/master/{currentIteration}' with with MasterComputable result as its data.
SyncWorkerCoordinator is trying to detect whether it exists, if yes, to start a new iteration.
Worker result will be written into each worker iteration znode for master to get.
| 从接口 org.apache.zookeeper.Watcher 继承的嵌套类/接口 |
org.apache.zookeeper.Watcher.Event |
| 从类 ml.shifu.guagua.BasicCoordinator 继承的方法 |
checkAndSetZooKeeper, closeZooKeeper, getAppNode, getBaseMasterElectionNode, getBytesFromZNode, getCurrentMasterNode, getCurrentMasterSplitNode, getCurrentWorkerNode, getCurrentWorkerSplitNode, getLastMasterNode, getLastWorkerNode, getMasterBaseNode, getMasterElectionNode, getMasterNode, getMasterSerializer, getRootNode, getSleepTime, getWorkerBaseNode, getWorkerBaseNode, getWorkerNode, getWorkerSerializer, getZkConnLatch, getZooKeeper, initialize, isFixedTime, process, setBytesToZNode, setFixedTime, setMasterSerializer, setSleepTime, setWorkerSerializer, setZooKeeper, startHeartbeat, stopHeartBeat |
| 从类 java.lang.Object 继承的方法 |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
SyncWorkerCoordinator
public SyncWorkerCoordinator()
preApplication
public void preApplication(WorkerContext<MASTER_RESULT,WORKER_RESULT> context)
- 从接口
WorkerInterceptor 复制的描述
- The hook point before any computation logic.
- 参数:
context - the worker context instance which includes master result and other useful parameters.
postIteration
public void postIteration(WorkerContext<MASTER_RESULT,WORKER_RESULT> context)
- 从接口
WorkerInterceptor 复制的描述
- The hook point after computation of each iteration.
- 参数:
context - the worker context instance which includes master result and other useful parameters.
Copyright © 2014. All Rights Reserved.