Package ml.shifu.guagua.worker

This package contains guagua worker implementation.

See: Description

Interface Summary

Interface	Description
WorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>	WorkerComputable defines worker computation for any guagua application.
WorkerContext.WorkerCompletionCallBack<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>	Define callback for completion of worker computation.
WorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>	WorkerInterceptor defines hook points for each guagua application.

Class Summary

Class	Description
AbstractCombineWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable>	A high-effective implementation to load data and do computation.
AbstractWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable>	Abstract WorkerComputable implementation to load data one by one and only in the very 1st iteration.
AbstractWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>	AbstractWorkerCoordinator has some common implementation for both async and sync worker coordinator.
AsyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>	AsyncWorkerCoordinator is used to as a worker barrier for each iteration.
BasicWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>	Empty WorkerInterceptor implementation for user to choose which function should be override.
GcWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>	GcWorkerInterceptor is used to log gc time of preXXXX of interceptors, worker computation and postXXXX of interceptors.
GuaguaWorkerService<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>	GuaguaWorkerService is the basic implementation as a worker for whole application process.
HookWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>	Common MasterComputable abstraction to define HookWorkerComputable.setup(WorkerContext) and HookWorkerComputable.cleanup(WorkerContext) hooks.
LocalWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>	LocalWorkerCoordinator is local coordinator implementation in one jvm instance.
MemoryStatsWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>	MemoryStatsWorkerInterceptor is used to print memory usage for each worker checkpoint.
NettyWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>	Worker coordinator coordinates master with Netty client channel.
SyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>	SyncWorkerCoordinator is used to as a worker barrier for each iteration.
TraceWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>	TraceWorkerInterceptor is used to trace whole application process.
WorkerComputableTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>	WorkerComputableTimer is used to print execution time for master computation function.
WorkerContext<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>	WorkerContext is a context to contain all useful info which can be used in worker computation.
WorkerTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>	WorkerTimer is used to log execution time of preXXXX of interceptors, worker computation and postXXXX of interceptors.

Package ml.shifu.guagua.worker Description

This package contains guagua worker implementation.

com.paypal.guagua.worker.GuaguaWorkerService is an implementation to do worker computation and worker interceptors.

Worker coordinator, memory profiler and timer such kind of useful interceptors are included in this package.