MASTER_RESULT - master result for computation in each iteration.WORKER_RESULT - worker result for computation in each iteration.ml.shifu.guagua.hadoop.io.GuaguaMRUnitDriver@Deprecated public class GuaguaMRUnitDriver<MASTER_RESULT extends ml.shifu.guagua.io.Bytable,WORKER_RESULT extends ml.shifu.guagua.io.Bytable> extends ml.shifu.guagua.unit.GuaguaUnitDriver<MASTER_RESULT,WORKER_RESULT>
GuaguaMRUnitDriver is used to run in-memory guagua application by using hadoop MapReduce splits.in guagua-mapreduce-examples project.| Constructor and Description |
|---|
GuaguaMRUnitDriver(Properties props)
Deprecated.
A only constructor here for local in-memory guagua job.
|
| Modifier and Type | Method and Description |
|---|---|
List<ml.shifu.guagua.io.GuaguaFileSplit[]> |
generateWorkerSplits(String inputs)
Deprecated.
|
protected List<org.apache.hadoop.fs.FileStatus> |
listStatus(org.apache.hadoop.conf.Configuration conf,
String input)
Deprecated.
List input directories.
|
public GuaguaMRUnitDriver(Properties props)
props - set all the configurations like input, output and ..in guagua-mapreduce-examples project.public List<ml.shifu.guagua.io.GuaguaFileSplit[]> generateWorkerSplits(String inputs) throws IOException
generateWorkerSplits in class ml.shifu.guagua.unit.GuaguaUnitDriver<MASTER_RESULT extends ml.shifu.guagua.io.Bytable,WORKER_RESULT extends ml.shifu.guagua.io.Bytable>IOExceptionprotected List<org.apache.hadoop.fs.FileStatus> listStatus(org.apache.hadoop.conf.Configuration conf, String input) throws IOException
job - the job to list input paths forIOException - if zero items or any IOException for input files.Copyright © 2019. All Rights Reserved.