ml.shifu.guagua.example.sum
类 SumSequenceFileWorker
java.lang.Object
ml.shifu.guagua.worker.AbstractWorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>>
ml.shifu.guagua.example.sum.SumSequenceFileWorker
- 所有已实现的接口:
- ml.shifu.guagua.worker.WorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>>
public class SumSequenceFileWorker
- extends ml.shifu.guagua.worker.AbstractWorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>>
SumSequenceFileWorker is used to accumulate the sum value for each line.
Each line of input should be number.
The master's sum value will be added to current iteration.
| 从类 ml.shifu.guagua.worker.AbstractWorkerComputable 继承的方法 |
compute, getRecordReader, postLoad, preLoad, setRecordReader |
| 从类 java.lang.Object 继承的方法 |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
SumSequenceFileWorker
public SumSequenceFileWorker()
init
public void init(ml.shifu.guagua.worker.WorkerContext<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>> workerContext)
- 指定者:
- 类
ml.shifu.guagua.worker.AbstractWorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>> 中的 init
doCompute
public GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable> doCompute(ml.shifu.guagua.worker.WorkerContext<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>> workerContext)
- 指定者:
- 类
ml.shifu.guagua.worker.AbstractWorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>> 中的 doCompute
load
public void load(GuaguaWritableAdapter<org.apache.hadoop.io.Text> currentKey,
GuaguaWritableAdapter<org.apache.hadoop.io.Text> currentValue,
ml.shifu.guagua.worker.WorkerContext<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>> workerContext)
- 指定者:
- 类
ml.shifu.guagua.worker.AbstractWorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>> 中的 load
initRecordReader
public void initRecordReader(ml.shifu.guagua.io.GuaguaFileSplit fileSplit)
throws IOException
- 指定者:
- 类
ml.shifu.guagua.worker.AbstractWorkerComputable<GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>> 中的 initRecordReader
- 抛出:
IOException
Copyright © 2015. All Rights Reserved.