软件包 ml.shifu.guagua.worker

This package contains guagua worker implementation.

请参见:
          描述

接口摘要
WorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Worker computation interface for an application.
WorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerInterceptor is a entry point for all services in worker implementation.
 

类摘要
AbstractWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable> Abstract implementation to load data one by one.
AbstractWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AbstractWorkerCoordinator has some common implementation for both async and sync worker coordinator.
AsyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AsyncWorkerCoordinator is used to as a worker barrier for each iteration.
BasicWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Empty WorkerInterceptor implementation for user to choose which function should be override.
GuaguaWorkerService<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> GuaguaWorkerService is the basic implementation as a worker for whole application process.
InternalWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> InternalWorkerCoordinator is local coordinator implementation on one jvm instance.
MemoryStatsWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MemoryStatsWorkerInterceptor is used to print memory usage for each worker checkpoint.
SyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> SyncWorkerCoordinator is used to as a worker barrier for each iteration.
TraceWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> TraceWorkerInterceptor is used to trace whole application process.
WorkerComputableTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerComputableTimer is used to get execution time for computation.
WorkerContext<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerContext is a context to contain all objects used in master computation.
WorkerTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerTimer is used to get execution time of the post intercepters and computation.
 

软件包 ml.shifu.guagua.worker 的描述

This package contains guagua worker implementation.

com.paypal.guagua.worker.GuaguaWorkerService is an implementation to do worker computation and worker intercepters.

Worker coordinator, memory profiler and timer such kind of useful intercepters are included in this package.



Copyright © 2014. All Rights Reserved.