Package ml.shifu.guagua.hadoop
Common related Hadoop components. All components depends on hadoop common and hadoop hdfs.
-
Class Summary Class Description GuaguaMRUnitDriver<MASTER_RESULT extends ml.shifu.guagua.io.Bytable,WORKER_RESULT extends ml.shifu.guagua.io.Bytable> GuaguaMRUnitDriveris used to run in-memory guagua application by using hadoop MapReduce splits.ZooKeeperMasterInterceptor<MASTER_RESULT extends ml.shifu.guagua.io.Bytable,WORKER_RESULT extends ml.shifu.guagua.io.Bytable> To start zookeeper instance in cluster environment.ZooKeeperWorkerInterceptor<MASTER_RESULT extends ml.shifu.guagua.io.Bytable,WORKER_RESULT extends ml.shifu.guagua.io.Bytable> Follow withZooKeeperMasterInterceptor,ZooKeeperWorkerInterceptoris used to read zookeeper server info from hdfs file.