ml.shifu.guagua.example.lnr
类 LinearRegressionWorker

java.lang.Object
  ml.shifu.guagua.worker.AbstractWorkerComputable<LinearRegressionParams,LinearRegressionParams,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>>
      ml.shifu.guagua.example.lnr.LinearRegressionWorker

所有已实现的接口：

ml.shifu.guagua.worker.WorkerComputable<LinearRegressionParams,LinearRegressionParams>

public class LinearRegressionWorker
extends ml.shifu.guagua.worker.AbstractWorkerComputable<LinearRegressionParams,LinearRegressionParams,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>>

LinearRegressionWorker defines logic to accumulate local linear regression gradients.

At first iteration, wait for master to use the consistent initiating model.

At other iterations, workers include:

• 1. Update local model by using global model from last step..
• 2. Accumulate gradients by using local worker input data.
• 3. Send new local gradients to master by returning parameters.

WARNING: Input data should be normalized before, or you will get a very bad model.

构造方法摘要

LinearRegressionWorker()

方法摘要

LinearRegressionParams	doCompute(ml.shifu.guagua.worker.WorkerContext<LinearRegressionParams,LinearRegressionParams> context)
void	init(ml.shifu.guagua.worker.WorkerContext<LinearRegressionParams,LinearRegressionParams> context)
void	initRecordReader(ml.shifu.guagua.io.GuaguaFileSplit fileSplit)
void	load(GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable> currentKey, GuaguaWritableAdapter<org.apache.hadoop.io.Text> currentValue, ml.shifu.guagua.worker.WorkerContext<LinearRegressionParams,LinearRegressionParams> context)
protected void	postLoad(ml.shifu.guagua.worker.WorkerContext<LinearRegressionParams,LinearRegressionParams> context)

从类 ml.shifu.guagua.worker.AbstractWorkerComputable 继承的方法

compute, getRecordReader, preLoad, setRecordReader

从类 java.lang.Object 继承的方法

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造方法详细信息

LinearRegressionWorker

public LinearRegressionWorker()

方法详细信息

initRecordReader

public void initRecordReader(ml.shifu.guagua.io.GuaguaFileSplit fileSplit)
                      throws IOException

指定者：

类 ml.shifu.guagua.worker.AbstractWorkerComputable<LinearRegressionParams,LinearRegressionParams,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>> 中的 initRecordReader

抛出：

IOException

init

public void init(ml.shifu.guagua.worker.WorkerContext<LinearRegressionParams,LinearRegressionParams> context)

指定者：

类 ml.shifu.guagua.worker.AbstractWorkerComputable<LinearRegressionParams,LinearRegressionParams,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>> 中的 init

doCompute

public LinearRegressionParams doCompute(ml.shifu.guagua.worker.WorkerContext<LinearRegressionParams,LinearRegressionParams> context)

指定者：

类 ml.shifu.guagua.worker.AbstractWorkerComputable<LinearRegressionParams,LinearRegressionParams,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>> 中的 doCompute

postLoad

protected void postLoad(ml.shifu.guagua.worker.WorkerContext<LinearRegressionParams,LinearRegressionParams> context)

覆盖：

类 ml.shifu.guagua.worker.AbstractWorkerComputable<LinearRegressionParams,LinearRegressionParams,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>> 中的 postLoad

load

public void load(GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable> currentKey,
                 GuaguaWritableAdapter<org.apache.hadoop.io.Text> currentValue,
                 ml.shifu.guagua.worker.WorkerContext<LinearRegressionParams,LinearRegressionParams> context)

指定者：

类 ml.shifu.guagua.worker.AbstractWorkerComputable<LinearRegressionParams,LinearRegressionParams,GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,GuaguaWritableAdapter<org.apache.hadoop.io.Text>> 中的 load