ml.shifu.guagua.yarn.example.sum
类 SumSequenceFileWorker

java.lang.Object
  继承者 ml.shifu.guagua.worker.AbstractWorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>>
      继承者 ml.shifu.guagua.yarn.example.sum.SumSequenceFileWorker
所有已实现的接口:
ml.shifu.guagua.worker.WorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>>

public class SumSequenceFileWorker
extends ml.shifu.guagua.worker.AbstractWorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>>

SumSequenceFileWorker is used to accumulate the sum value for each sequence value.

Each value should be number but type is Text.

The master's sum value will be added to current iteration.


构造方法摘要
SumSequenceFileWorker()
           
 
方法摘要
 GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable> doCompute(ml.shifu.guagua.worker.WorkerContext<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>> workerContext)
           
 void init(ml.shifu.guagua.worker.WorkerContext<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>> workerContext)
           
 void initRecordReader(ml.shifu.guagua.io.GuaguaFileSplit fileSplit)
           
 void load(GuaguaWritableAdapter<org.apache.hadoop.io.Text> currentKey, GuaguaWritableAdapter<org.apache.hadoop.io.Text> currentValue, ml.shifu.guagua.worker.WorkerContext<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>> workerContext)
           
 
从类 ml.shifu.guagua.worker.AbstractWorkerComputable 继承的方法
compute, getRecordReader, postLoad, preLoad, setRecordReader
 
从类 java.lang.Object 继承的方法
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

构造方法详细信息

SumSequenceFileWorker

public SumSequenceFileWorker()
方法详细信息

init

public void init(ml.shifu.guagua.worker.WorkerContext<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>> workerContext)
指定者:
ml.shifu.guagua.worker.AbstractWorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>> 中的 init

doCompute

public GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable> doCompute(ml.shifu.guagua.worker.WorkerContext<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>> workerContext)
指定者:
ml.shifu.guagua.worker.AbstractWorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>> 中的 doCompute

load

public void load(GuaguaWritableAdapter<org.apache.hadoop.io.Text> currentKey,
                 GuaguaWritableAdapter<org.apache.hadoop.io.Text> currentValue,
                 ml.shifu.guagua.worker.WorkerContext<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>> workerContext)
指定者:
ml.shifu.guagua.worker.AbstractWorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>> 中的 load

initRecordReader

public void initRecordReader(ml.shifu.guagua.io.GuaguaFileSplit fileSplit)
                      throws IOException
指定者:
ml.shifu.guagua.worker.AbstractWorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>> 中的 initRecordReader
抛出:
IOException


Copyright © 2015. All Rights Reserved.