Package ml.shifu.guagua.mapreduce

This package contains guagua-mapreduce implementation details based one only mapper hadoop job.

com.paypal.guagua.mapreduce.GuaguaMapReduceClient is the entry point to trigger a guagua job by invoking its main method.

com.paypal.guagua.mapreduce.GuaguaMRUnitDriver is a class for unit test, it will run guagua master-workers in one jvm instance. See SumTest in guagua-mapreduce-examples project for details.

Hadoop input format and output format customization for guagua is in com.paypal.guagua.mapreduce.GuaguaInputFormat com.paypal.guagua.mapreduce.GuaguaOutputFormat and other related classes.

Class Summary

Class	Description
GuaguaInputFormat	GuaguaInputFormat is used to determine how many mappers in guagua MapReduce job.
GuaguaInputSplit	Deprecated. use GuaguaInputSplit
GuaguaLineRecordReader	Deprecated. use GuaguaLineRecordReader
GuaguaMapper<MASTER_RESULT extends ml.shifu.guagua.io.Bytable,WORKER_RESULT extends ml.shifu.guagua.io.Bytable>	GuaguaMapper is the Hadoop Mapper implementation for both guagua master and guagua workers.
GuaguaMapReduceClient	GuaguaMapReduceClient is the entry point for guagua mapreduce implementation application.
GuaguaMapReduceConstants	Constants in guagua mapreduce.
GuaguaMRRecordReader	GuaguaMRRecordReader is used as a mock for mapreduce reader interface, not real reading data.
GuaguaMRUnitDriver<MASTER_RESULT extends ml.shifu.guagua.io.Bytable,WORKER_RESULT extends ml.shifu.guagua.io.Bytable>	Deprecated. use GuaguaMRUnitDriver
GuaguaOptionsParser	Deprecated. use GuaguaOptionsParser
GuaguaOutputCommitter	This output committer doesn't do anything, meant for the case where output isn't desired, or as a base for not using FileOutputCommitter.
GuaguaOutputFormat	This is for internal use only.
GuaguaRecordWriter	We don't use GuaguaRecordWriter but hadoop MapReduce needs it.
GuaguaSequenceAsBinaryRecordReader	Deprecated. use GuaguaSequenceAsBinaryRecordReader
GuaguaSequenceAsTextRecordReader	Deprecated. use GuaguaSequenceAsTextRecordReader
GuaguaSequenceRecordReader<KEY extends org.apache.hadoop.io.Writable,VALUE extends org.apache.hadoop.io.Writable>	Deprecated. use GuaguaSequenceRecordReader
GuaguaWritableAdapter<W extends org.apache.hadoop.io.Writable>	Deprecated. use GuaguaWritableAdapter
GuaguaWritableSerializer<RESULT extends ml.shifu.guagua.io.Bytable>	Deprecated. use GuaguaWritableSerializer

Exception Summary

Exception	Description
GuaguaFailTaskRuntimeException	FailTaskRuntimeException which is used to fail hadoop mapper task.