ml.shifu.guagua.hadoop.io

Class GuaguaSequenceAsBinaryRecordReader

java.lang.Object

ml.shifu.guagua.hadoop.io.GuaguaSequenceAsBinaryRecordReader

All Implemented Interfaces:

GuaguaRecordReader<GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>>

public class GuaguaSequenceAsBinaryRecordReader
extends Object
implements GuaguaRecordReader<GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>>

A reader read HDFS sequence file key by key. The sequence key and value types are both BytesWritable.

Copy some code from SequenceFileAsBinaryInputFormat but to support GuaguaRecordReader interface.

If use default constructor, user should also call initialize(GuaguaFileSplit) like in below:

 this.setRecordReader(new GuaguaSequenceAsBinaryRecordReader());
 this.getRecordReader().initialize(fileSplit);
 

or directly use other constructors:

 this.setRecordReader(new GuaguaSequenceAsBinaryRecordReader(fileSplit));
 

Constructor Summary

Constructors

Constructor and Description
GuaguaSequenceAsBinaryRecordReader()
GuaguaSequenceAsBinaryRecordReader(org.apache.hadoop.conf.Configuration conf, GuaguaFileSplit split)
GuaguaSequenceAsBinaryRecordReader(GuaguaFileSplit split)

Method Summary

Methods

Modifier and Type	Method and Description
void	close()
GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>	getCurrentKey()
GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>	getCurrentValue()
float	getProgress() Return the progress within the input split
void	initialize(GuaguaFileSplit split)
boolean	nextKeyValue()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GuaguaSequenceAsBinaryRecordReader

public GuaguaSequenceAsBinaryRecordReader()

GuaguaSequenceAsBinaryRecordReader

public GuaguaSequenceAsBinaryRecordReader(GuaguaFileSplit split)
                                   throws IOException

Throws:

IOException

GuaguaSequenceAsBinaryRecordReader

public GuaguaSequenceAsBinaryRecordReader(org.apache.hadoop.conf.Configuration conf,
                                  GuaguaFileSplit split)
                                   throws IOException

Throws:

IOException

Method Detail

getProgress

public float getProgress()
                  throws IOException

Return the progress within the input split

Returns:

0.0 to 1.0 of the input byte range

Throws:

IOException

initialize

public void initialize(GuaguaFileSplit split)
                throws IOException

Specified by:

initialize in interface GuaguaRecordReader<GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>>

Throws:

IOException

nextKeyValue

public boolean nextKeyValue()
                     throws IOException

Specified by:

nextKeyValue in interface GuaguaRecordReader<GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>>

Throws:

IOException

getCurrentKey

public GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable> getCurrentKey()

Specified by:

getCurrentKey in interface GuaguaRecordReader<GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>>

getCurrentValue

public GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable> getCurrentValue()

Specified by:

getCurrentValue in interface GuaguaRecordReader<GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>>

close

public void close()
           throws IOException

Specified by:

close in interface GuaguaRecordReader<GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>>

Throws:

IOException