软件包 ml.shifu.guagua.worker

This package contains guagua worker implementation.

请参见:
          描述

接口摘要
WorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerComputable defines worker computation for any guagua application.
WorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerInterceptor defines hook points for each guagua application.
 

类摘要
AbstractCombineWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable> A high-effective implementation to load data and do computation.
AbstractWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable> Abstract WorkerComputable implementation to load data one by one and only in the very 1st iteration.
AbstractWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AbstractWorkerCoordinator has some common implementation for both async and sync worker coordinator.
AsyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AsyncWorkerCoordinator is used to as a worker barrier for each iteration.
BasicWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Empty WorkerInterceptor implementation for user to choose which function should be override.
GuaguaWorkerService<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> GuaguaWorkerService is the basic implementation as a worker for whole application process.
LocalWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> LocalWorkerCoordinator is local coordinator implementation in one jvm instance.
MemoryStatsWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MemoryStatsWorkerInterceptor is used to print memory usage for each worker checkpoint.
SyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> SyncWorkerCoordinator is used to as a worker barrier for each iteration.
TraceWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> TraceWorkerInterceptor is used to trace whole application process.
WorkerComputableTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerComputableTimer is used to print execution time for master computation function.
WorkerContext<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerContext is a context to contain all useful info which can be used in worker computation.
WorkerTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerTimer is used to log execution time of preXXXX of interceptors, worker computation and postXXXX of interceptors.
 

软件包 ml.shifu.guagua.worker 的描述

This package contains guagua worker implementation.

com.paypal.guagua.worker.GuaguaWorkerService is an implementation to do worker computation and worker interceptors.

Worker coordinator, memory profiler and timer such kind of useful interceptors are included in this package.



Copyright © 2014. All Rights Reserved.