ml.shifu.guagua.yarn.example.sum
类 SumSequenceFileWorker
java.lang.Object
ml.shifu.guagua.worker.AbstractWorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>>
ml.shifu.guagua.yarn.example.sum.SumSequenceFileWorker
- 所有已实现的接口:
- ml.shifu.guagua.worker.WorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>>
public class SumSequenceFileWorker
- extends ml.shifu.guagua.worker.AbstractWorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>>
SumSequenceFileWorker is used to accumulate the sum value for each sequence value.
Each value should be number but type is Text.
The master's sum value will be added to current iteration.
| 从类 ml.shifu.guagua.worker.AbstractWorkerComputable 继承的方法 |
compute, getRecordReader, postLoad, preLoad, setRecordReader |
| 从类 java.lang.Object 继承的方法 |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
SumSequenceFileWorker
public SumSequenceFileWorker()
init
public void init(ml.shifu.guagua.worker.WorkerContext<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>> workerContext)
- 指定者:
- 类
ml.shifu.guagua.worker.AbstractWorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>> 中的 init
doCompute
public GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable> doCompute(ml.shifu.guagua.worker.WorkerContext<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>> workerContext)
- 指定者:
- 类
ml.shifu.guagua.worker.AbstractWorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>> 中的 doCompute
load
public void load(GuaguaWritableAdapter<org.apache.hadoop.io.Text> currentKey,
GuaguaWritableAdapter<org.apache.hadoop.io.Text> currentValue,
ml.shifu.guagua.worker.WorkerContext<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>> workerContext)
- 指定者:
- 类
ml.shifu.guagua.worker.AbstractWorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>> 中的 load
initRecordReader
public void initRecordReader(ml.shifu.guagua.io.GuaguaFileSplit fileSplit)
throws IOException
- 指定者:
- 类
ml.shifu.guagua.worker.AbstractWorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>> 中的 initRecordReader
- 抛出:
IOException
Copyright © 2014. All Rights Reserved.