A B C D G I L M N P Q R S T W

A

accumulateGradients(double[]) - Method in class ml.shifu.guagua.yarn.example.nn.meta.NNParams

accumulateTrainSize(long) - Method in class ml.shifu.guagua.yarn.example.nn.meta.NNParams

B

BACK_PROPAGATION - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

C

calculateWeights(double[], double[]) - Method in class ml.shifu.guagua.yarn.example.nn.Weight

compute(MasterContext<NNParams, NNParams>) - Method in class ml.shifu.guagua.yarn.example.nn.NNMaster

compute(MasterContext<GuaguaWritableAdapter<LongWritable>, GuaguaWritableAdapter<LongWritable>>) - Method in class ml.shifu.guagua.yarn.example.sum.SumMaster

D

DEFAULT_INITIAL_UPDATE - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

The starting update for a delta.

DELTA_MIN - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

The minimum delta value for a weight matrix value.

doCompute(WorkerContext<NNParams, NNParams>) - Method in class ml.shifu.guagua.yarn.example.nn.NNWorker

doCompute(WorkerContext<GuaguaWritableAdapter<LongWritable>, GuaguaWritableAdapter<LongWritable>>) - Method in class ml.shifu.guagua.yarn.example.sum.SumSequenceFileWorker

doCompute(WorkerContext<GuaguaWritableAdapter<LongWritable>, GuaguaWritableAdapter<LongWritable>>) - Method in class ml.shifu.guagua.yarn.example.sum.SumWorker

doReadFields(DataInput) - Method in class ml.shifu.guagua.yarn.example.nn.meta.NNParams

doWrite(DataOutput) - Method in class ml.shifu.guagua.yarn.example.nn.meta.NNParams

G

generateNetwork(int, int, int) - Static method in class ml.shifu.guagua.yarn.example.nn.NNUtils

Generate basic NN network object

getError() - Method in class ml.shifu.guagua.yarn.example.nn.Gradient

getErrorCalculation() - Method in class ml.shifu.guagua.yarn.example.nn.Gradient

getGradients() - Method in class ml.shifu.guagua.yarn.example.nn.Gradient

getGradients() - Method in class ml.shifu.guagua.yarn.example.nn.meta.NNParams

getLayerDelta() - Method in class ml.shifu.guagua.yarn.example.nn.Gradient

getNetwork() - Method in class ml.shifu.guagua.yarn.example.nn.Gradient

getTestError() - Method in class ml.shifu.guagua.yarn.example.nn.meta.NNParams

getTestingData() - Method in class ml.shifu.guagua.yarn.example.nn.NNWorker

getTrainError() - Method in class ml.shifu.guagua.yarn.example.nn.meta.NNParams

getTrainingData() - Method in class ml.shifu.guagua.yarn.example.nn.NNWorker

getTrainSize() - Method in class ml.shifu.guagua.yarn.example.nn.meta.NNParams

getWeights() - Method in class ml.shifu.guagua.yarn.example.nn.Gradient

getWeights() - Method in class ml.shifu.guagua.yarn.example.nn.meta.NNParams

Gradient - Class in ml.shifu.guagua.yarn.example.nn

Gradient is copied from Encog framework.

Gradient(FlatNetwork, MLDataSet, double[], ErrorFunction) - Constructor for class ml.shifu.guagua.yarn.example.nn.Gradient

Construct a gradient worker.

GUAGUA_NN_ALGORITHM - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

GUAGUA_NN_DEFAULT_ALGORITHM - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

GUAGUA_NN_DEFAULT_HIDDEN_NODES - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

GUAGUA_NN_DEFAULT_INPUT_NODES - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

GUAGUA_NN_DEFAULT_LEARNING_RATE - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

GUAGUA_NN_DEFAULT_OUTPUT_NODES - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

GUAGUA_NN_DEFAULT_THREAD_COUNT - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

GUAGUA_NN_HIDDEN_NODES - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

GUAGUA_NN_INPUT_NODES - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

GUAGUA_NN_LEARNING_RATE - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

GUAGUA_NN_OUTPUT - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

GUAGUA_NN_OUTPUT_NODES - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

GUAGUA_NN_THREAD_COUNT - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

I

init(WorkerContext<NNParams, NNParams>) - Method in class ml.shifu.guagua.yarn.example.nn.NNWorker

init(WorkerContext<GuaguaWritableAdapter<LongWritable>, GuaguaWritableAdapter<LongWritable>>) - Method in class ml.shifu.guagua.yarn.example.sum.SumSequenceFileWorker

init(WorkerContext<GuaguaWritableAdapter<LongWritable>, GuaguaWritableAdapter<LongWritable>>) - Method in class ml.shifu.guagua.yarn.example.sum.SumWorker

initRecordReader(GuaguaFileSplit) - Method in class ml.shifu.guagua.yarn.example.nn.NNWorker

initRecordReader(GuaguaFileSplit) - Method in class ml.shifu.guagua.yarn.example.sum.SumSequenceFileWorker

initRecordReader(GuaguaFileSplit) - Method in class ml.shifu.guagua.yarn.example.sum.SumWorker

L

load(GuaguaWritableAdapter<LongWritable>, GuaguaWritableAdapter<Text>, WorkerContext<NNParams, NNParams>) - Method in class ml.shifu.guagua.yarn.example.nn.NNWorker

load(GuaguaWritableAdapter<Text>, GuaguaWritableAdapter<Text>, WorkerContext<GuaguaWritableAdapter<LongWritable>, GuaguaWritableAdapter<LongWritable>>) - Method in class ml.shifu.guagua.yarn.example.sum.SumSequenceFileWorker

load(GuaguaWritableAdapter<LongWritable>, GuaguaWritableAdapter<Text>, WorkerContext<GuaguaWritableAdapter<LongWritable>, GuaguaWritableAdapter<LongWritable>>) - Method in class ml.shifu.guagua.yarn.example.sum.SumWorker

M

MANHATTAN_PROPAGATION - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

ml.shifu.guagua.yarn.example.nn - package ml.shifu.guagua.yarn.example.nn

This package contains distributed neural network master and worker implementation.

ml.shifu.guagua.yarn.example.nn.meta - package ml.shifu.guagua.yarn.example.nn.meta

This package contains meta parameter object used in distributed neural network algorithm.

ml.shifu.guagua.yarn.example.sum - package ml.shifu.guagua.yarn.example.sum

This package contains simple sum example for all numbers in input.

N

NEGATIVE_ETA - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

The NEGATIVE ETA value.

NN_DEFAULT_COLUMN_SEPARATOR - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

NN_RECORD_SCALE - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

NN_TEST_SCALE - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

NNConstants - Class in ml.shifu.guagua.yarn.example.nn

Constants in guagua mapreduce.

NNMaster - Class in ml.shifu.guagua.yarn.example.nn

NNMaster is used to accumulate all workers NN parameters.

NNMaster() - Constructor for class ml.shifu.guagua.yarn.example.nn.NNMaster

NNOutput - Class in ml.shifu.guagua.yarn.example.nn

NNOutput is used to write the final model output to file system.

NNOutput() - Constructor for class ml.shifu.guagua.yarn.example.nn.NNOutput

NNParams - Class in ml.shifu.guagua.yarn.example.nn.meta

NNParams are used to save NN model info which can also be stored into ZooKeeper.

NNParams() - Constructor for class ml.shifu.guagua.yarn.example.nn.meta.NNParams

NNUtils - Class in ml.shifu.guagua.yarn.example.nn

Helper class for NN distributed training.

NNWorker - Class in ml.shifu.guagua.yarn.example.nn

NNWorker is used to compute NN model according to splits assigned.

NNWorker() - Constructor for class ml.shifu.guagua.yarn.example.nn.NNWorker

P

POSITIVE_ETA - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

The POSITIVE ETA value.

postApplication(MasterContext<NNParams, NNParams>) - Method in class ml.shifu.guagua.yarn.example.nn.NNOutput

postApplication(MasterContext<GuaguaWritableAdapter<LongWritable>, GuaguaWritableAdapter<LongWritable>>) - Method in class ml.shifu.guagua.yarn.example.sum.SumOutput

postLoad(WorkerContext<NNParams, NNParams>) - Method in class ml.shifu.guagua.yarn.example.nn.NNWorker

Q

QUICK_PROPAGATION - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

R

randomize(int, double[]) - Static method in class ml.shifu.guagua.yarn.example.nn.NNUtils

reset() - Method in class ml.shifu.guagua.yarn.example.nn.meta.NNParams

RESILIENTPROPAGATION - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

run() - Method in class ml.shifu.guagua.yarn.example.nn.Gradient

Perform the gradient calculation

S

SCALEDCONJUGATEGRADIENT - Static variable in class ml.shifu.guagua.yarn.example.nn.NNConstants

setGradients(double[]) - Method in class ml.shifu.guagua.yarn.example.nn.meta.NNParams

setParams(BasicNetwork) - Method in class ml.shifu.guagua.yarn.example.nn.Gradient

setTestError(double) - Method in class ml.shifu.guagua.yarn.example.nn.meta.NNParams

setTestingData(MLDataSet) - Method in class ml.shifu.guagua.yarn.example.nn.NNWorker

setTrainError(double) - Method in class ml.shifu.guagua.yarn.example.nn.meta.NNParams

setTrainingData(MLDataSet) - Method in class ml.shifu.guagua.yarn.example.nn.NNWorker

setTrainSize(long) - Method in class ml.shifu.guagua.yarn.example.nn.meta.NNParams

setWeights(double[]) - Method in class ml.shifu.guagua.yarn.example.nn.Gradient

setWeights(double[]) - Method in class ml.shifu.guagua.yarn.example.nn.meta.NNParams

sign(double) - Static method in class ml.shifu.guagua.yarn.example.nn.NNUtils

Determine the sign of the value.

SumMaster - Class in ml.shifu.guagua.yarn.example.sum

Sum all workers' results together.

SumMaster() - Constructor for class ml.shifu.guagua.yarn.example.sum.SumMaster

SumOutput - Class in ml.shifu.guagua.yarn.example.sum

SumOutput is used to write the final model output to file system.

SumOutput() - Constructor for class ml.shifu.guagua.yarn.example.sum.SumOutput

SumSequenceFileWorker - Class in ml.shifu.guagua.yarn.example.sum

SumSequenceFileWorker is used to accumulate the sum value for each sequence value.

SumSequenceFileWorker() - Constructor for class ml.shifu.guagua.yarn.example.sum.SumSequenceFileWorker

SumWorker - Class in ml.shifu.guagua.yarn.example.sum

SumWorker is used to compute the sum value for each line.

SumWorker() - Constructor for class ml.shifu.guagua.yarn.example.sum.SumWorker

T

toString() - Method in class ml.shifu.guagua.yarn.example.nn.meta.NNParams

W

Weight - Class in ml.shifu.guagua.yarn.example.nn

Weight is used to update NN weights according to propagation option.

Weight(int, double, double, String) - Constructor for class ml.shifu.guagua.yarn.example.nn.Weight

A B C D G I L M N P Q R S T W