接口 ml.shifu.guagua.io.Bytable
的使用

使用 Bytable 的软件包

ml.shifu.guagua	This package contains some common classes for both master and worker.
ml.shifu.guagua.io	This package contains our own io settings for guagua.
ml.shifu.guagua.master	This package contains guagua master implementation.
ml.shifu.guagua.unit	This package is used to run guagua master-workers in one jvm instance.
ml.shifu.guagua.worker	This package contains guagua worker implementation.

ml.shifu.guagua 中 Bytable 的使用

类型参数类型为 Bytable 的 ml.shifu.guagua 中的类

class	AsyncCoordinatorFactory<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Async coordinator factory to create async coordinators for master and workers.
class	AsyncCoordinatorFactory<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Async coordinator factory to create async coordinators for master and workers.
class	BasicCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> BasicCoordinator is a basic implementation for both SyncWorkerCoordinator and SyncMasterCoordinator: 1.
class	BasicCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> BasicCoordinator is a basic implementation for both SyncWorkerCoordinator and SyncMasterCoordinator: 1.
interface	CoordinatorFactory<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Coordinator factory to create sync or async coordinator.
interface	CoordinatorFactory<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Coordinator factory to create sync or async coordinator.
class	MemoryCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MemoryCoordinator is helper for in-memory master and worker coordination.
class	MemoryCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MemoryCoordinator is helper for in-memory master and worker coordination.
class	SyncCoordinatorFactory<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Sync coordinator factory to create sync coordinators for master and workers.
class	SyncCoordinatorFactory<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Sync coordinator factory to create sync coordinators for master and workers.

ml.shifu.guagua.io 中 Bytable 的使用

类型参数类型为 Bytable 的 ml.shifu.guagua.io 中的类

class	BytableSerializer<RESULT extends Bytable> BytableSerializer is usingwrite(java.io.DataOutput) and readFields(java.io.DataInput) to serialize object to bytes and de-serialize bytes to object.
class	Bzip2BytableSerializer<RESULT extends Bytable> Bzip2BytableSerializer is usingwrite(java.io.DataOutput) and readFields(java.io.DataInput) to serialize object to bytes and de-serialize bytes to object.
interface	GuaguaRecordReader<KEY extends Bytable,VALUE extends Bytable> GuaguaRecordReader is used for consistent interface to iterate data through FileSplit provided.
interface	GuaguaRecordReader<KEY extends Bytable,VALUE extends Bytable> GuaguaRecordReader is used for consistent interface to iterate data through FileSplit provided.
class	GZIPBytableSerializer<RESULT extends Bytable> GZIPBytableSerializer is usingwrite(java.io.DataOutput) and readFields(java.io.DataInput) to serialize object to bytes and de-serialize bytes to object.
interface	Serializer<RESULT extends Bytable> Serializer is used to serialize object to bytes and de-serialize bytes to object A CONTRACT here: To make sure halt status in Bytable can be serialized or de-serialized.

实现 Bytable 的 ml.shifu.guagua.io 中的类

class

HaltBytable Abstract Bytable implementation to read and store halt status.

ml.shifu.guagua.master 中 Bytable 的使用

类型参数类型为 Bytable 的 ml.shifu.guagua.master 中的类

class	AbstractMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AbstractMasterCoordinator has some common implementation for both async and sync worker coordinator.
class	AbstractMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AbstractMasterCoordinator has some common implementation for both async and sync worker coordinator.
class	AsyncMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AsyncMasterCoordinator is used to as a barrier for each iteration.
class	AsyncMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AsyncMasterCoordinator is used to as a barrier for each iteration.
class	BasicMasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Empty MasterIntercepter implementation for user to choose which function should be override.
class	BasicMasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Empty MasterIntercepter implementation for user to choose which function should be override.
class	GuaguaMasterService<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> GuaguaMasterService is the basic implementation as a master to coordinator all workers' work in each iteration.
class	GuaguaMasterService<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> GuaguaMasterService is the basic implementation as a master to coordinator all workers' work in each iteration.
class	InternalMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> InternalMasterCoordinator is local coordinator implementation in one jvm instance.
class	InternalMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> InternalMasterCoordinator is local coordinator implementation in one jvm instance.
interface	MasterComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Master computation for an application.
interface	MasterComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Master computation for an application.
class	MasterComputableTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MasterComputableTimer is used to get execution time for mastercomputation.
class	MasterComputableTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MasterComputableTimer is used to get execution time for mastercomputation.
class	MasterContext<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MasterContext is a context to contain all objects used in master computation.
class	MasterContext<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MasterContext is a context to contain all objects used in master computation.
interface	MasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MasterInterceptor is a entry point for all service in master implementation.
interface	MasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MasterInterceptor is a entry point for all service in master implementation.
class	MasterTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MasterTimer is used to get execution time of the post intercepters and master computation.
class	MasterTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MasterTimer is used to get execution time of the post intercepters and master computation.
class	MemoryStatsMasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MemoryStatsMasterInterceptor is used to print memory usage for each master checkpoint.
class	MemoryStatsMasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MemoryStatsMasterInterceptor is used to print memory usage for each master checkpoint.
class	SyncMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> SyncMasterCoordinator is used to as a barrier for each iteration.
class	SyncMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> SyncMasterCoordinator is used to as a barrier for each iteration.
class	TraceMasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> TraceMasterInterceptor is used to trace whole application for master.
class	TraceMasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> TraceMasterInterceptor is used to trace whole application for master.

ml.shifu.guagua.unit 中 Bytable 的使用

类型参数类型为 Bytable 的 ml.shifu.guagua.unit 中的类

class	GuaguaUnitDriver<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> GuaguaUnitDriver is a helper class to run master, worker and intercepters in one jvm instance.
class	GuaguaUnitDriver<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> GuaguaUnitDriver is a helper class to run master, worker and intercepters in one jvm instance.

ml.shifu.guagua.worker 中 Bytable 的使用

类型参数类型为 Bytable 的 ml.shifu.guagua.worker 中的类

class	AbstractWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable> Abstract implementation to load data one by one.
class	AbstractWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable> Abstract implementation to load data one by one.
class	AbstractWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable> Abstract implementation to load data one by one.
class	AbstractWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable> Abstract implementation to load data one by one.
class	AbstractWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AbstractWorkerCoordinator has some common implementation for both async and sync worker coordinator.
class	AbstractWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AbstractWorkerCoordinator has some common implementation for both async and sync worker coordinator.
class	AsyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AsyncWorkerCoordinator is used to as a worker barrier for each iteration.
class	AsyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> AsyncWorkerCoordinator is used to as a worker barrier for each iteration.
class	BasicWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Empty WorkerInterceptor implementation for user to choose which function should be override.
class	BasicWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Empty WorkerInterceptor implementation for user to choose which function should be override.
class	GuaguaWorkerService<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> GuaguaWorkerService is the basic implementation as a worker for whole application process.
class	GuaguaWorkerService<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> GuaguaWorkerService is the basic implementation as a worker for whole application process.
class	InternalWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> InternalWorkerCoordinator is local coordinator implementation on one jvm instance.
class	InternalWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> InternalWorkerCoordinator is local coordinator implementation on one jvm instance.
class	MemoryStatsWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MemoryStatsWorkerInterceptor is used to print memory usage for each worker checkpoint.
class	MemoryStatsWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> MemoryStatsWorkerInterceptor is used to print memory usage for each worker checkpoint.
class	SyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> SyncWorkerCoordinator is used to as a worker barrier for each iteration.
class	SyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> SyncWorkerCoordinator is used to as a worker barrier for each iteration.
class	TraceWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> TraceWorkerInterceptor is used to trace whole application process.
class	TraceWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> TraceWorkerInterceptor is used to trace whole application process.
interface	WorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Worker computation interface for an application.
interface	WorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> Worker computation interface for an application.
class	WorkerComputableTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerComputableTimer is used to get execution time for computation.
class	WorkerComputableTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerComputableTimer is used to get execution time for computation.
class	WorkerContext<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerContext is a context to contain all objects used in master computation.
class	WorkerContext<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerContext is a context to contain all objects used in master computation.
interface	WorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerInterceptor is a entry point for all services in worker implementation.
interface	WorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerInterceptor is a entry point for all services in worker implementation.
class	WorkerTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerTimer is used to get execution time of the post intercepters and computation.
class	WorkerTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable> WorkerTimer is used to get execution time of the post intercepters and computation.