Package ml.shifu.guagua.example.lr

Class LogisticRegressionWorker

java.lang.Object

ml.shifu.guagua.worker.AbstractWorkerComputable<LogisticRegressionParams,LogisticRegressionParams,ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter<org.apache.hadoop.io.Text>>

ml.shifu.guagua.example.lr.LogisticRegressionWorker

All Implemented Interfaces:

ml.shifu.guagua.worker.WorkerComputable<LogisticRegressionParams,LogisticRegressionParams>

public class LogisticRegressionWorker
extends ml.shifu.guagua.worker.AbstractWorkerComputable<LogisticRegressionParams,LogisticRegressionParams,ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter<org.apache.hadoop.io.Text>>

LogisticRegressionWorker defines logic to accumulate local logistic regression gradients.

At first iteration, wait for master to use the consistent initiated model.

At other iterations, workers include:

• 1. Update local model by using global model from last step..
• 2. Accumulate gradients by using local worker input data.
• 3. Send new local gradients to master by returning parameters.

Constructor Summary

Constructors

Constructor	Description
LogisticRegressionWorker()

Method Summary

Modifier and Type	Method	Description
LogisticRegressionParams	doCompute(ml.shifu.guagua.worker.WorkerContext<LogisticRegressionParams,LogisticRegressionParams> context)
void	init(ml.shifu.guagua.worker.WorkerContext<LogisticRegressionParams,LogisticRegressionParams> context)
void	initRecordReader(ml.shifu.guagua.io.GuaguaFileSplit fileSplit)
void	load(ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable> currentKey, ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter<org.apache.hadoop.io.Text> currentValue, ml.shifu.guagua.worker.WorkerContext<LogisticRegressionParams,LogisticRegressionParams> context)
protected void	postLoad(ml.shifu.guagua.worker.WorkerContext<LogisticRegressionParams,LogisticRegressionParams> context)

Methods inherited from class ml.shifu.guagua.worker.AbstractWorkerComputable

compute, getRecordReader, preLoad, setRecordReader

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LogisticRegressionWorker

public LogisticRegressionWorker()

Method Detail

initRecordReader

public void initRecordReader(ml.shifu.guagua.io.GuaguaFileSplit fileSplit)
                      throws IOException

Specified by:

initRecordReader in class ml.shifu.guagua.worker.AbstractWorkerComputable<LogisticRegressionParams,LogisticRegressionParams,ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter<org.apache.hadoop.io.Text>>

Throws:

IOException

init

public void init(ml.shifu.guagua.worker.WorkerContext<LogisticRegressionParams,LogisticRegressionParams> context)

Specified by:

init in class ml.shifu.guagua.worker.AbstractWorkerComputable<LogisticRegressionParams,LogisticRegressionParams,ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter<org.apache.hadoop.io.Text>>

doCompute

public LogisticRegressionParams doCompute(ml.shifu.guagua.worker.WorkerContext<LogisticRegressionParams,LogisticRegressionParams> context)

Specified by:

doCompute in class ml.shifu.guagua.worker.AbstractWorkerComputable<LogisticRegressionParams,LogisticRegressionParams,ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter<org.apache.hadoop.io.Text>>

postLoad

protected void postLoad(ml.shifu.guagua.worker.WorkerContext<LogisticRegressionParams,LogisticRegressionParams> context)

Overrides:

postLoad in class ml.shifu.guagua.worker.AbstractWorkerComputable<LogisticRegressionParams,LogisticRegressionParams,ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter<org.apache.hadoop.io.Text>>

load

public void load(ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable> currentKey,
                 ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter<org.apache.hadoop.io.Text> currentValue,
                 ml.shifu.guagua.worker.WorkerContext<LogisticRegressionParams,LogisticRegressionParams> context)

Specified by:

load in class ml.shifu.guagua.worker.AbstractWorkerComputable<LogisticRegressionParams,LogisticRegressionParams,ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter<org.apache.hadoop.io.LongWritable>,ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter<org.apache.hadoop.io.Text>>