ml.shifu.guagua.worker

Class AbstractWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>

java.lang.Object

ml.shifu.guagua.BasicCoordinator<MASTER_RESULT,WORKER_RESULT>

ml.shifu.guagua.worker.AbstractWorkerCoordinator<MASTER_RESULT,WORKER_RESULT>

Type Parameters:

MASTER_RESULT - master result for computation in each iteration.

WORKER_RESULT - worker result for computation in each iteration.

All Implemented Interfaces:

WorkerInterceptor<MASTER_RESULT,WORKER_RESULT>, org.apache.zookeeper.Watcher

Direct Known Subclasses:

AsyncWorkerCoordinator, NettyWorkerCoordinator, SyncWorkerCoordinator

public abstract class AbstractWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
extends BasicCoordinator<MASTER_RESULT,WORKER_RESULT>
implements WorkerInterceptor<MASTER_RESULT,WORKER_RESULT>

AbstractWorkerCoordinator has some common implementation for both async and sync worker coordinator.

Common functions include: znodes cleaning up, fail-over support and others.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected class	AbstractWorkerCoordinator.FailOverCoordinatorCommand

Nested classes/interfaces inherited from class ml.shifu.guagua.BasicCoordinator

BasicCoordinator.BasicCoordinatorCommand, BasicCoordinator.CoordinatorCommand, BasicCoordinator.GetSplitBytes, BasicCoordinator.RetryCoordinatorCommand, BasicCoordinator.SaveResultToZookeeper

Nested classes/interfaces inherited from interface org.apache.zookeeper.Watcher

org.apache.zookeeper.Watcher.Event

Field Summary

Fields inherited from class ml.shifu.guagua.BasicCoordinator

WAIT_SLOT_MILLS

Constructor Summary

Constructors

Constructor and Description
AbstractWorkerCoordinator()

Method Summary

Modifier and Type	Method and Description
void	postApplication(WorkerContext<MASTER_RESULT,WORKER_RESULT> context) The hook point after any computation logic.
void	preIteration(WorkerContext<MASTER_RESULT,WORKER_RESULT> context) The hook point before computation of each iteration.
protected void	setMasterResult(WorkerContext<MASTER_RESULT,WORKER_RESULT> context, String appMasterNode, String appMasterSplitNode)

Methods inherited from class ml.shifu.guagua.BasicCoordinator

checkAndSetZooKeeper, close, getAppNode, getBaseMasterElectionNode, getBytesFromZNode, getCurrentMasterNode, getCurrentMasterSplitNode, getCurrentWorkerNode, getCurrentWorkerSplitNode, getLastMasterNode, getLastWorkerNode, getMasterBaseNode, getMasterElectionNode, getMasterNode, getMasterSerializer, getRootNode, getSleepTime, getWorkerBaseNode, getWorkerBaseNode, getWorkerNode, getWorkerSerializer, getZkConnLatch, getZooKeeper, initialize, isFixedTime, process, setBytesToZNode, setFixedTime, setMasterSerializer, setSleepTime, setWorkerSerializer, setZooKeeper, startHeartbeat, stopHeartBeat

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface ml.shifu.guagua.worker.WorkerInterceptor

postIteration, preApplication

Constructor Detail

AbstractWorkerCoordinator

public AbstractWorkerCoordinator()

Method Detail

preIteration

public void preIteration(WorkerContext<MASTER_RESULT,WORKER_RESULT> context)

Description copied from interface: WorkerInterceptor

The hook point before computation of each iteration.

Specified by:

preIteration in interface WorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>

Parameters:

context - the worker context instance which includes master result and other useful parameters.

postApplication

public void postApplication(WorkerContext<MASTER_RESULT,WORKER_RESULT> context)

Description copied from interface: WorkerInterceptor

The hook point after any computation logic.

Specified by:

postApplication in interface WorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>

Parameters:

context - the worker context instance which includes master result and other useful parameters.

setMasterResult

protected void setMasterResult(WorkerContext<MASTER_RESULT,WORKER_RESULT> context,
                               String appMasterNode,
                               String appMasterSplitNode)
                        throws org.apache.zookeeper.KeeperException,
                               InterruptedException

Throws:

org.apache.zookeeper.KeeperException

InterruptedException