ml.shifu.guagua.yarn
类 GuaguaSequenceAsBinaryRecordReader

java.lang.Object
  继承者 ml.shifu.guagua.yarn.GuaguaSequenceAsBinaryRecordReader
所有已实现的接口:
GuaguaRecordReader<GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>>

public class GuaguaSequenceAsBinaryRecordReader
extends Object
implements GuaguaRecordReader<GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>>

A reader read HDFS sequence file key by key. The sequence key and value types are both BytesWritable.

Copy some code from SequenceFileAsBinaryInputFormat but to support GuaguaRecordReader interface.

If use default constructor, user should also call initialize(GuaguaFileSplit) like in below:

 this.setRecordReader(new GuaguaSequenceAsBinaryRecordReader());
 this.getRecordReader().initialize(fileSplit);
 
or directly use other constructors:
 this.setRecordReader(new GuaguaSequenceAsBinaryRecordReader(fileSplit));
 


构造方法摘要
GuaguaSequenceAsBinaryRecordReader()
           
GuaguaSequenceAsBinaryRecordReader(org.apache.hadoop.conf.Configuration conf, GuaguaFileSplit split)
           
GuaguaSequenceAsBinaryRecordReader(GuaguaFileSplit split)
           
 
方法摘要
 void close()
           
 GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable> getCurrentKey()
           
 GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable> getCurrentValue()
           
 float getProgress()
          Return the progress within the input split
 void initialize(GuaguaFileSplit split)
           
 boolean nextKeyValue()
           
 
从类 java.lang.Object 继承的方法
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

构造方法详细信息

GuaguaSequenceAsBinaryRecordReader

public GuaguaSequenceAsBinaryRecordReader()

GuaguaSequenceAsBinaryRecordReader

public GuaguaSequenceAsBinaryRecordReader(GuaguaFileSplit split)
                                   throws IOException
抛出:
IOException

GuaguaSequenceAsBinaryRecordReader

public GuaguaSequenceAsBinaryRecordReader(org.apache.hadoop.conf.Configuration conf,
                                          GuaguaFileSplit split)
                                   throws IOException
抛出:
IOException
方法详细信息

getProgress

public float getProgress()
                  throws IOException
Return the progress within the input split

返回:
0.0 to 1.0 of the input byte range
抛出:
IOException

initialize

public void initialize(GuaguaFileSplit split)
                throws IOException
指定者:
接口 GuaguaRecordReader<GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>> 中的 initialize
抛出:
IOException

nextKeyValue

public boolean nextKeyValue()
                     throws IOException
指定者:
接口 GuaguaRecordReader<GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>> 中的 nextKeyValue
抛出:
IOException

getCurrentKey

public GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable> getCurrentKey()
指定者:
接口 GuaguaRecordReader<GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>> 中的 getCurrentKey

getCurrentValue

public GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable> getCurrentValue()
指定者:
接口 GuaguaRecordReader<GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>> 中的 getCurrentValue

close

public void close()
           throws IOException
指定者:
接口 GuaguaRecordReader<GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.BytesWritable>> 中的 close
抛出:
IOException


Copyright © 2014. All Rights Reserved.