ml.shifu.guagua.worker
类 AsyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
java.lang.Object
ml.shifu.guagua.BasicCoordinator<MASTER_RESULT,WORKER_RESULT>
ml.shifu.guagua.worker.AbstractWorkerCoordinator<MASTER_RESULT,WORKER_RESULT>
ml.shifu.guagua.worker.AsyncWorkerCoordinator<MASTER_RESULT,WORKER_RESULT>
- 类型参数:
MASTER_RESULT - master result for computation in each iteration.WORKER_RESULT - worker result for computation in each iteration.
- 所有已实现的接口:
- WorkerInterceptor<MASTER_RESULT,WORKER_RESULT>, org.apache.zookeeper.Watcher
public class AsyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
- extends AbstractWorkerCoordinator<MASTER_RESULT,WORKER_RESULT>
AsyncWorkerCoordinator is used to as a worker barrier for each iteration.
For each iteration, AsyncWorkerCoordinator will wait until master's signal.
To start a new iteration, SyncMasterCoordinator will write a znode for each iteration like
'/_guagua/job_201312041304_189025/master/{currentIteration}' with with MasterComputable result as its data.
AsyncWorkerCoordinator is trying to detect whether it exists, if yes, to start a new iteration.
Worker result will be written into each worker iteration znode for master to get.
| 从接口 org.apache.zookeeper.Watcher 继承的嵌套类/接口 |
org.apache.zookeeper.Watcher.Event |
| 从类 ml.shifu.guagua.BasicCoordinator 继承的方法 |
checkAndSetZooKeeper, closeZooKeeper, getAppNode, getBaseMasterElectionNode, getBytesFromZNode, getCurrentMasterNode, getCurrentMasterSplitNode, getCurrentWorkerNode, getCurrentWorkerSplitNode, getLastMasterNode, getLastWorkerNode, getMasterBaseNode, getMasterElectionNode, getMasterNode, getMasterSerializer, getRootNode, getSleepTime, getWorkerBaseNode, getWorkerBaseNode, getWorkerNode, getWorkerSerializer, getZkConnLatch, getZooKeeper, initialize, isFixedTime, setBytesToZNode, setFixedTime, setMasterSerializer, setSleepTime, setWorkerSerializer, setZooKeeper, startHeartbeat, stopHeartBeat |
| 从类 java.lang.Object 继承的方法 |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
masterInitLock
protected ProgressLock masterInitLock
- Lock is used to check register info from master.
masterIterationLock
protected ProgressLock masterIterationLock
- Lock is used to check iteration info from master.
AsyncWorkerCoordinator
public AsyncWorkerCoordinator()
process
public void process(org.apache.zookeeper.WatchedEvent event)
- 指定者:
- 接口
org.apache.zookeeper.Watcher 中的 process - 覆盖:
- 类
BasicCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> 中的 process
getCurrentIteration
public int getCurrentIteration()
setCurrentIteration
public void setCurrentIteration(int currentIteration)
getAppId
public String getAppId()
setAppId
public void setAppId(String appId)
preApplication
public void preApplication(WorkerContext<MASTER_RESULT,WORKER_RESULT> context)
- 从接口
WorkerInterceptor 复制的描述
- The hook point before any computation logic.
- 参数:
context - the worker context instance which includes master result and other useful parameters.
preIteration
public void preIteration(WorkerContext<MASTER_RESULT,WORKER_RESULT> context)
- 从接口
WorkerInterceptor 复制的描述
- The hook point before computation of each iteration.
- 指定者:
- 接口
WorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> 中的 preIteration - 覆盖:
- 类
AbstractWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> 中的 preIteration
- 参数:
context - the worker context instance which includes master result and other useful parameters.
postIteration
public void postIteration(WorkerContext<MASTER_RESULT,WORKER_RESULT> context)
- 从接口
WorkerInterceptor 复制的描述
- The hook point after computation of each iteration.
- 参数:
context - the worker context instance which includes master result and other useful parameters.
Copyright © 2015. All Rights Reserved.