软件包 ml.shifu.guagua.io

This package contains guagua own io settings.

请参见：
描述

接口摘要

Bytable	Bytable defines master and worker results.
GuaguaRecordReader<KEY extends Bytable,VALUE extends Bytable>	GuaguaRecordReader is used for consistent interface to iterate data through FileSplit provided.
Serializer<RESULT extends Bytable>	Serializer is used to serialize Bytable object to bytes and de-serialize bytes to Bytable object.

类摘要

BytableSerializer<RESULT extends Bytable>	BytableSerializer is used to write Bytable object to bytes and read bytes to Bytable object.
BytableWrapper	A Bytable wrapper to wrap some useful information to netty server and client communication.
Bzip2BytableSerializer<RESULT extends Bytable>	Bzip2BytableSerializer is using bzip2 compression algorithm for serialization.
GuaguaFileSplit	GuaguaFileSplit is used for WorkerComputable to read data.
GZIPBytableSerializer<RESULT extends Bytable>	GZIPBytableSerializer is using gzip compression algorithm for serialization.
HaltBytable	Abstract Bytable implementation to read and store halt status.
NettyBytableDecoder	A decoder to decode bytes array to Bytable object.
NettyBytableEncoder	A encoder to encode Bytable instance to coded bytes array for netty pipeline.

软件包 ml.shifu.guagua.io 的描述

This package contains guagua own io settings.

com.paypal.guagua.io.Bytable is a copy from Hadoop Writable, the reason is that guagua doesn't want to depend on Hadoop platform since guagua is designed to support all kinds of computation platform. Check GuaguaWritableAdapter in guagua-mapreduce to see how to use Hadoop Writable with guagua com.paypal.guagua.io.Bytable.

Compressed serialzer like com.paypal.guagua.io.GZIPBytableSerializer is used to support gz format. And com.paypal.guagua.io.Bzip2BytableSerializer is for bz2 format.