软件包 ml.shifu.guagua.yarn

This package contains all the guagua-yarn implementation which is used to launch guagua master workers job on YARN framework.

请参见：
描述

类摘要

GuaguaAppMaster	GuaguaAppMaster is application master to launch master and worker tasks.
GuaguaInputSplit	InputSplit implementation in guagua.
GuaguaIterationStatus	GuaguaIterationStatus is used to send iteration status from master and worker to Guagua application master.
GuaguaLineRecordReader	Copy from LineRecordReader to avoid using Mapreduce-related interfaces.
GuaguaOptionsParser	GuaguaOptionsParser is a utility to parse command line arguments generic to the Hadoop framework.
GuaguaSplitWriter	The class that is used by the Job clients to write splits (both the meta and the raw bytes parts)
GuaguaWritableAdapter<W extends Writable>	GuaguaWritableAdapter is used to adapt hadoop io to Bytable interface.
GuaguaWritableSerializer<RESULT extends Bytable>	GuaguaWritableSerializer is to provide the functionality to support use hadoop writable interface.
GuaguaYarnClient	GuaguaYarnClient is used to submit master-workers computation app on yarn cluster.
GuaguaYarnConstants	Constants in guagua yarn.
GuaguaYarnTask<MASTER_RESULT extends Bytable,WORKER_RESULT extends Bytable>	GuaguaYarnTask is a entry point to run both master and workers.
GuaguaYarnTask.ClientHandler	ClientHandeler used to update progress to RPC server (AppMaster).

软件包 ml.shifu.guagua.yarn 的描述

This package contains all the guagua-yarn implementation which is used to launch guagua master workers job on YARN framework.

com.paypal.guagua.yarn.GuaguaYarnClient is the entry point to trigger a guagua job by invoking its main method.

com.paypal.guagua.yarn.GuaguaAppMaster is served as an application master implementation for YARM.

com.paypal.guagua.yarn.GuaguaYarnTask is used to lanuch master and worker containers on hadoop YARN framework.