Package ml.shifu.guagua.mapreduce

This package contains guagua-mapreduce implementation details based one only mapper hadoop job.

See: Description

Class Summary

Class	Description
GuaguaInputFormat	GuaguaInputFormat is used to determine how many mappers in guagua MapReduce job.
GuaguaInputSplit	Deprecated use GuaguaInputSplit
GuaguaLineRecordReader	Deprecated use GuaguaLineRecordReader
GuaguaMapper<MASTER_RESULT extends ml.shifu.guagua.io.Bytable,WORKER_RESULT extends ml.shifu.guagua.io.Bytable>	GuaguaMapper is the Hadoop Mapper implementation for both guagua master and guagua workers.
GuaguaMapReduceClient	GuaguaMapReduceClient is the entry point for guagua mapreduce implementation application.
GuaguaMapReduceConstants	Constants in guagua mapreduce.
GuaguaMRRecordReader	GuaguaMRRecordReader is used as a mock for mapreduce reader interface, not real reading data.
GuaguaMRUnitDriver<MASTER_RESULT extends ml.shifu.guagua.io.Bytable,WORKER_RESULT extends ml.shifu.guagua.io.Bytable>	Deprecated use ml.shifu.guagua.hadoop.io.GuaguaMRUnitDriver
GuaguaOptionsParser	Deprecated use GuaguaOptionsParser
GuaguaOutputCommitter	This output committer doesn't do anything, meant for the case where output isn't desired, or as a base for not using FileOutputCommitter.
GuaguaOutputFormat	This is for internal use only.
GuaguaRecordWriter	We don't use GuaguaRecordWriter but hadoop MapReduce needs it.
GuaguaSequenceAsBinaryRecordReader	Deprecated use GuaguaSequenceAsBinaryRecordReader
GuaguaSequenceAsTextRecordReader	Deprecated use GuaguaSequenceAsTextRecordReader
GuaguaSequenceRecordReader<KEY extends org.apache.hadoop.io.Writable,VALUE extends org.apache.hadoop.io.Writable>	Deprecated use GuaguaSequenceRecordReader
GuaguaWritableAdapter<W extends org.apache.hadoop.io.Writable>	Deprecated use GuaguaWritableAdapter
GuaguaWritableSerializer<RESULT extends ml.shifu.guagua.io.Bytable>	Deprecated use GuaguaWritableSerializer

Exception Summary

Exception	Description
GuaguaFailTaskRuntimeException	FailTaskRuntimeException which is used to fail hadoop mapper task.

Package ml.shifu.guagua.mapreduce Description

This package contains guagua-mapreduce implementation details based one only mapper hadoop job.

com.paypal.guagua.mapreduce.GuaguaMapReduceClient is the entry point to trigger a guagua job by invoking its main method.

com.paypal.guagua.mapreduce.GuaguaMRUnitDriver is a class for unit test, it will run guagua master-workers in one jvm instance. See SumTest in guagua-mapreduce-examples project for details.

Hadoop input format and output format customization for guagua is in com.paypal.guagua.mapreduce.GuaguaInputFormat and com.paypal.guagua.mapreduce.GuaguaOutputFormat and other related classes.