| Package | Description |
|---|---|
| ml.shifu.guagua |
This package contains some common classes for both master and worker.
|
| ml.shifu.guagua.io |
This package contains guagua own io settings.
|
| ml.shifu.guagua.master |
This package contains guagua master implementation.
|
| ml.shifu.guagua.unit |
This package is used to run guagua master-workers in one jvm instance.
|
| ml.shifu.guagua.util |
This package contains some useful utility functions to help guagua-core.
|
| ml.shifu.guagua.worker |
This package contains guagua worker implementation.
|
| Modifier and Type | Class and Description |
|---|---|
class |
AsyncCoordinatorFactory<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
Async coordinator factory to create async coordinators for master and workers.
|
class |
AsyncCoordinatorFactory<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
Async coordinator factory to create async coordinators for master and workers.
|
class |
BasicCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
BasicCoordinator is a basic implementation for both SyncWorkerCoordinator and SyncMasterCoordinator:
1. |
class |
BasicCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
BasicCoordinator is a basic implementation for both SyncWorkerCoordinator and SyncMasterCoordinator:
1. |
interface |
CoordinatorFactory<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
Coordinator factory to create sync or async coordinator.
|
interface |
CoordinatorFactory<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
Coordinator factory to create sync or async coordinator.
|
class |
InMemoryCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
InMemoryCoordinator is a helper for in-memory master and worker coordination. |
class |
InMemoryCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
InMemoryCoordinator is a helper for in-memory master and worker coordination. |
class |
SyncCoordinatorFactory<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
Sync coordinator factory to create sync coordinators for master and workers.
|
class |
SyncCoordinatorFactory<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
Sync coordinator factory to create sync coordinators for master and workers.
|
| Modifier and Type | Class and Description |
|---|---|
class |
BytableSerializer<RESULT extends Bytable>
|
class |
Bzip2BytableSerializer<RESULT extends Bytable>
Bzip2BytableSerializer is using bzip2 compression algorithm for serialization. |
interface |
GuaguaRecordReader<KEY extends Bytable,VALUE extends Bytable>
GuaguaRecordReader is used for consistent interface to iterate data through FileSplit provided. |
interface |
GuaguaRecordReader<KEY extends Bytable,VALUE extends Bytable>
GuaguaRecordReader is used for consistent interface to iterate data through FileSplit provided. |
class |
GZIPBytableSerializer<RESULT extends Bytable>
GZIPBytableSerializer is using gzip compression algorithm for serialization. |
interface |
Serializer<RESULT extends Bytable>
|
| Modifier and Type | Class and Description |
|---|---|
class |
BytableWrapper
A
Bytable wrapper to wrap some useful information to netty server and client communication. |
class |
HaltBytable
Abstract
Bytable implementation to read and store halt status. |
| Modifier and Type | Class and Description |
|---|---|
class |
AbstractMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
AbstractMasterCoordinator has some common implementation for both async and sync worker coordinator. |
class |
AbstractMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
AbstractMasterCoordinator has some common implementation for both async and sync worker coordinator. |
class |
AsyncMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
AsyncMasterCoordinator is used to as a barrier for each iteration. |
class |
AsyncMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
AsyncMasterCoordinator is used to as a barrier for each iteration. |
class |
BasicMasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
Empty
MasterInterceptor implementation for user to choose which function should be override. |
class |
BasicMasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
Empty
MasterInterceptor implementation for user to choose which function should be override. |
class |
GuaguaMasterService<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
GuaguaMasterService is the basic implementation as a master for whole guagua application process. |
class |
GuaguaMasterService<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
GuaguaMasterService is the basic implementation as a master for whole guagua application process. |
class |
LocalMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
LocalMasterCoordinator is local coordinator implementation in one jvm instance. |
class |
LocalMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
LocalMasterCoordinator is local coordinator implementation in one jvm instance. |
interface |
MasterComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
MasterComputable defines master computation for any guagua application. |
interface |
MasterComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
MasterComputable defines master computation for any guagua application. |
class |
MasterComputableTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
MasterComputableTimer is used to print execution time for master computation. |
class |
MasterComputableTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
MasterComputableTimer is used to print execution time for master computation. |
class |
MasterContext<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
MasterContext is a context object which contains all useful info used in master computation. |
class |
MasterContext<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
MasterContext is a context object which contains all useful info used in master computation. |
interface |
MasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
MasterInterceptor defines hook points for each guagua application. |
interface |
MasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
MasterInterceptor defines hook points for each guagua application. |
class |
MasterTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
MasterTimer is used to log execution time of preXXXX of interceptors, master computation and postXXXX of
interceptors. |
class |
MasterTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
MasterTimer is used to log execution time of preXXXX of interceptors, master computation and postXXXX of
interceptors. |
class |
MemoryStatsMasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
MemoryStatsMasterInterceptor is used to print memory usage for each master checkpoint. |
class |
MemoryStatsMasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
MemoryStatsMasterInterceptor is used to print memory usage for each master checkpoint. |
class |
NettyMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
A master coordinator to coordinate with workers through Netty server.
|
class |
NettyMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
A master coordinator to coordinate with workers through Netty server.
|
class |
SyncMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
SyncMasterCoordinator is used to as a barrier for each iteration. |
class |
SyncMasterCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
SyncMasterCoordinator is used to as a barrier for each iteration. |
class |
TraceMasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
TraceMasterInterceptor is used to trace whole application for master. |
class |
TraceMasterInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
TraceMasterInterceptor is used to trace whole application for master. |
| Modifier and Type | Class and Description |
|---|---|
class |
GuaguaUnitDriver<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
GuaguaUnitDriver is a helper class to run master, worker and intercepters in one jvm instance. |
class |
GuaguaUnitDriver<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
GuaguaUnitDriver is a helper class to run master, worker and intercepters in one jvm instance. |
| Modifier and Type | Class and Description |
|---|---|
class |
BytableDiskList<T extends Bytable>
A list wrapper to implement store
Bytable data into disk. |
class |
BytableMemoryDiskList<T extends Bytable>
A list to store
Bytable data firstly into memory then into disk if over threshold. |
| Modifier and Type | Class and Description |
|---|---|
class |
AbstractCombineWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable>
A high-effective implementation to load data and do computation.
|
class |
AbstractCombineWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable>
A high-effective implementation to load data and do computation.
|
class |
AbstractCombineWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable>
A high-effective implementation to load data and do computation.
|
class |
AbstractCombineWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable>
A high-effective implementation to load data and do computation.
|
class |
AbstractWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable>
Abstract
WorkerComputable implementation to load data one by one and only in the very 1st iteration. |
class |
AbstractWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable>
Abstract
WorkerComputable implementation to load data one by one and only in the very 1st iteration. |
class |
AbstractWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable>
Abstract
WorkerComputable implementation to load data one by one and only in the very 1st iteration. |
class |
AbstractWorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable,KEY extends Bytable,VALUE extends Bytable>
Abstract
WorkerComputable implementation to load data one by one and only in the very 1st iteration. |
class |
AbstractWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
AbstractWorkerCoordinator has some common implementation for both async and sync worker coordinator. |
class |
AbstractWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
AbstractWorkerCoordinator has some common implementation for both async and sync worker coordinator. |
class |
AsyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
AsyncWorkerCoordinator is used to as a worker barrier for each iteration. |
class |
AsyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
AsyncWorkerCoordinator is used to as a worker barrier for each iteration. |
class |
BasicWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
Empty
WorkerInterceptor implementation for user to choose which function should be override. |
class |
BasicWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
Empty
WorkerInterceptor implementation for user to choose which function should be override. |
class |
GuaguaWorkerService<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
GuaguaWorkerService is the basic implementation as a worker for whole application process. |
class |
GuaguaWorkerService<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
GuaguaWorkerService is the basic implementation as a worker for whole application process. |
class |
LocalWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
LocalWorkerCoordinator is local coordinator implementation in one jvm instance. |
class |
LocalWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
LocalWorkerCoordinator is local coordinator implementation in one jvm instance. |
class |
MemoryStatsWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
MemoryStatsWorkerInterceptor is used to print memory usage for each worker checkpoint. |
class |
MemoryStatsWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
MemoryStatsWorkerInterceptor is used to print memory usage for each worker checkpoint. |
class |
NettyWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
Worker coordinator coordinates master with Netty client channel.
|
class |
NettyWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
Worker coordinator coordinates master with Netty client channel.
|
class |
SyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
SyncWorkerCoordinator is used to as a worker barrier for each iteration. |
class |
SyncWorkerCoordinator<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
SyncWorkerCoordinator is used to as a worker barrier for each iteration. |
class |
TraceWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
TraceWorkerInterceptor is used to trace whole application process. |
class |
TraceWorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
TraceWorkerInterceptor is used to trace whole application process. |
interface |
WorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
WorkerComputable defines worker computation for any guagua application. |
interface |
WorkerComputable<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
WorkerComputable defines worker computation for any guagua application. |
class |
WorkerComputableTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
WorkerComputableTimer is used to print execution time for master computation function. |
class |
WorkerComputableTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
WorkerComputableTimer is used to print execution time for master computation function. |
class |
WorkerContext<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
WorkerContext is a context to contain all useful info which can be used in worker computation. |
class |
WorkerContext<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
WorkerContext is a context to contain all useful info which can be used in worker computation. |
interface |
WorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
WorkerInterceptor defines hook points for each guagua application. |
interface |
WorkerInterceptor<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
WorkerInterceptor defines hook points for each guagua application. |
class |
WorkerTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
WorkerTimer is used to log execution time of preXXXX of interceptors, worker computation and postXXXX of
interceptors. |
class |
WorkerTimer<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>
WorkerTimer is used to log execution time of preXXXX of interceptors, worker computation and postXXXX of
interceptors. |
Copyright © 2015. All Rights Reserved.