接口 ml.shifu.guagua.io.Bytable
的使用

使用 Bytable 的软件包

ml.shifu.guagua	This package contains some common classes for both master and worker.
ml.shifu.guagua.io	This package contains guagua own io settings.
ml.shifu.guagua.master	This package contains guagua master implementation.
ml.shifu.guagua.unit	This package is used to run guagua master-workers in one jvm instance.
ml.shifu.guagua.worker	This package contains guagua worker implementation.

ml.shifu.guagua 中 Bytable 的使用

类型参数类型为 Bytable 的 ml.shifu.guagua 中的类

class	AsyncCoordinatorFactory<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Async coordinator factory to create async coordinators for master and workers.
class	AsyncCoordinatorFactory<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Async coordinator factory to create async coordinators for master and workers.
class	BasicCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> BasicCoordinator is a basic implementation for both SyncWorkerCoordinator and SyncMasterCoordinator: 1.
class	BasicCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> BasicCoordinator is a basic implementation for both SyncWorkerCoordinator and SyncMasterCoordinator: 1.
interface	CoordinatorFactory<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Coordinator factory to create sync or async coordinator.
interface	CoordinatorFactory<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Coordinator factory to create sync or async coordinator.
class	InMemoryCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> InMemoryCoordinator is a helper for in-memory master and worker coordination.
class	InMemoryCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> InMemoryCoordinator is a helper for in-memory master and worker coordination.
class	SyncCoordinatorFactory<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Sync coordinator factory to create sync coordinators for master and workers.
class	SyncCoordinatorFactory<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Sync coordinator factory to create sync coordinators for master and workers.

ml.shifu.guagua.io 中 Bytable 的使用

类型参数类型为 Bytable 的 ml.shifu.guagua.io 中的类

class	BytableSerializer<RESULT extends Bytable> BytableSerializer is used to write Bytable object to bytes and read bytes to Bytable object.
class	Bzip2BytableSerializer<RESULT extends Bytable> Bzip2BytableSerializer is using bzip2 compression algorithm for serialization.
interface	GuaguaRecordReader<KEY extends Bytable,VALUE extends Bytable> GuaguaRecordReader is used for consistent interface to iterate data through FileSplit provided.
interface	GuaguaRecordReader<KEY extends Bytable,VALUE extends Bytable> GuaguaRecordReader is used for consistent interface to iterate data through FileSplit provided.
class	GZIPBytableSerializer<RESULT extends Bytable> GZIPBytableSerializer is using gzip compression algorithm for serialization.
interface	Serializer<RESULT extends Bytable> Serializer is used to serialize Bytable object to bytes and de-serialize bytes to Bytable object.

实现 Bytable 的 ml.shifu.guagua.io 中的类

class

HaltBytable Abstract Bytable implementation to read and store halt status.

ml.shifu.guagua.master 中 Bytable 的使用

类型参数类型为 Bytable 的 ml.shifu.guagua.master 中的类

class	AbstractMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AbstractMasterCoordinator has some common implementation for both async and sync worker coordinator.
class	AbstractMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AbstractMasterCoordinator has some common implementation for both async and sync worker coordinator.
class	AsyncMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AsyncMasterCoordinator is used to as a barrier for each iteration.
class	AsyncMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AsyncMasterCoordinator is used to as a barrier for each iteration.
class	BasicMasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Empty MasterInterceptor implementation for user to choose which function should be override.
class	BasicMasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Empty MasterInterceptor implementation for user to choose which function should be override.
class	GuaguaMasterService<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> GuaguaMasterService is the basic implementation as a master for whole guagua application process.
class	GuaguaMasterService<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> GuaguaMasterService is the basic implementation as a master for whole guagua application process.
class	LocalMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> LocalMasterCoordinator is local coordinator implementation in one jvm instance.
class	LocalMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> LocalMasterCoordinator is local coordinator implementation in one jvm instance.
interface	MasterComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MasterComputable defines master computation for any guagua application.
interface	MasterComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MasterComputable defines master computation for any guagua application.
class	MasterComputableTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MasterComputableTimer is used to print execution time for master computation.
class	MasterComputableTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MasterComputableTimer is used to print execution time for master computation.
class	MasterContext<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MasterContext is a context object which contains all useful info used in master computation.
class	MasterContext<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MasterContext is a context object which contains all useful info used in master computation.
interface	MasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MasterInterceptor defines hook points for each guagua application.
interface	MasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MasterInterceptor defines hook points for each guagua application.
class	MasterTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MasterTimer is used to log execution time of preXXXX of interceptors, master computation and postXXXX of interceptors.
class	MasterTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MasterTimer is used to log execution time of preXXXX of interceptors, master computation and postXXXX of interceptors.
class	MemoryStatsMasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MemoryStatsMasterInterceptor is used to print memory usage for each master checkpoint.
class	MemoryStatsMasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MemoryStatsMasterInterceptor is used to print memory usage for each master checkpoint.
class	SyncMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> SyncMasterCoordinator is used to as a barrier for each iteration.
class	SyncMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> SyncMasterCoordinator is used to as a barrier for each iteration.
class	TraceMasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> TraceMasterInterceptor is used to trace whole application for master.
class	TraceMasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> TraceMasterInterceptor is used to trace whole application for master.

ml.shifu.guagua.unit 中 Bytable 的使用

类型参数类型为 Bytable 的 ml.shifu.guagua.unit 中的类

class	GuaguaUnitDriver<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> GuaguaUnitDriver is a helper class to run master, worker and intercepters in one jvm instance.
class	GuaguaUnitDriver<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> GuaguaUnitDriver is a helper class to run master, worker and intercepters in one jvm instance.

ml.shifu.guagua.worker 中 Bytable 的使用

类型参数类型为 Bytable 的 ml.shifu.guagua.worker 中的类

class	AbstractWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable> Abstract WorkerComputable implementation to load data one by one and only in the very 1st iteration.
class	AbstractWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable> Abstract WorkerComputable implementation to load data one by one and only in the very 1st iteration.
class	AbstractWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable> Abstract WorkerComputable implementation to load data one by one and only in the very 1st iteration.
class	AbstractWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable> Abstract WorkerComputable implementation to load data one by one and only in the very 1st iteration.
class	AbstractWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AbstractWorkerCoordinator has some common implementation for both async and sync worker coordinator.
class	AbstractWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AbstractWorkerCoordinator has some common implementation for both async and sync worker coordinator.
class	AsyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AsyncWorkerCoordinator is used to as a worker barrier for each iteration.
class	AsyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AsyncWorkerCoordinator is used to as a worker barrier for each iteration.
class	BasicWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Empty WorkerInterceptor implementation for user to choose which function should be override.
class	BasicWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Empty WorkerInterceptor implementation for user to choose which function should be override.
class	GuaguaWorkerService<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> GuaguaWorkerService is the basic implementation as a worker for whole application process.
class	GuaguaWorkerService<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> GuaguaWorkerService is the basic implementation as a worker for whole application process.
class	LocalWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> LocalWorkerCoordinator is local coordinator implementation in one jvm instance.
class	LocalWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> LocalWorkerCoordinator is local coordinator implementation in one jvm instance.
class	MemoryStatsWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MemoryStatsWorkerInterceptor is used to print memory usage for each worker checkpoint.
class	MemoryStatsWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MemoryStatsWorkerInterceptor is used to print memory usage for each worker checkpoint.
class	SyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> SyncWorkerCoordinator is used to as a worker barrier for each iteration.
class	SyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> SyncWorkerCoordinator is used to as a worker barrier for each iteration.
class	TraceWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> TraceWorkerInterceptor is used to trace whole application process.
class	TraceWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> TraceWorkerInterceptor is used to trace whole application process.
interface	WorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerComputable defines worker computation for any guagua application.
interface	WorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerComputable defines worker computation for any guagua application.
class	WorkerComputableTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerComputableTimer is used to print execution time for master computation function.
class	WorkerComputableTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerComputableTimer is used to print execution time for master computation function.
class	WorkerContext<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerContext is a context to contain all useful info which can be used in worker computation.
class	WorkerContext<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerContext is a context to contain all useful info which can be used in worker computation.
interface	WorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerInterceptor defines hook points for each guagua application.
interface	WorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerInterceptor defines hook points for each guagua application.
class	WorkerTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerTimer is used to log execution time of preXXXX of interceptors, worker computation and postXXXX of interceptors.
class	WorkerTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerTimer is used to log execution time of preXXXX of interceptors, worker computation and postXXXX of interceptors.