Package ml.shifu.guagua.io

This package contains guagua own io settings.

See: Description

Interface Summary

Interface	Description
Bytable	Bytable defines master and worker results.
Combinable<RESULT extends Bytable>	Combinable is to combine Bytable results together to save memory in master computation.
GuaguaRecordReader<KEY extends Bytable,VALUE extends Bytable>	GuaguaRecordReader is used for consistent interface to iterate data through FileSplit provided.
Serializer<RESULT extends Bytable>	Serializer is used to serialize Bytable object to bytes and de-serialize bytes to Bytable object.

Class Summary

Class	Description
BytableSerializer<RESULT extends Bytable>	BytableSerializer is used to write Bytable object to bytes and read bytes to Bytable object.
BytableWrapper	A Bytable wrapper to wrap some useful information to netty server and client communication.
Bzip2BytableSerializer<RESULT extends Bytable>	Bzip2BytableSerializer is using bzip2 compression algorithm for serialization.
GuaguaFileSplit	GuaguaFileSplit is used for WorkerComputable to read data.
GZIPBytableSerializer<RESULT extends Bytable>	GZIPBytableSerializer is using gzip compression algorithm for serialization.
HaltBytable	Abstract Bytable implementation to read and store halt status.
NettyBytableDecoder	A decoder to decode bytes array to Bytable object.
NettyBytableEncoder	A encoder to encode Bytable instance to coded bytes array for netty pipeline.

Package ml.shifu.guagua.io Description

This package contains guagua own io settings.

com.paypal.guagua.io.Bytable is a copy from Hadoop Writable, the reason is that guagua doesn't want to depend on Hadoop platform since guagua is designed to support all kinds of computation platform. Check GuaguaWritableAdapter in guagua-mapreduce to see how to use Hadoop Writable with guagua com.paypal.guagua.io.Bytable.

Compressed serialzer like com.paypal.guagua.io.GZIPBytableSerializer is used to support gz format. And com.paypal.guagua.io.Bzip2BytableSerializer is for bz2 format.