| Package | Description |
|---|---|
| ml.shifu.guagua |
This package contains some common classes for both master and worker.
|
| ml.shifu.guagua.io |
This package contains guagua own io settings.
|
| ml.shifu.guagua.master |
This package contains guagua master implementation.
|
| ml.shifu.guagua.worker |
This package contains guagua worker implementation.
|
| Modifier and Type | Method and Description |
|---|---|
void |
GuaguaService.setSplits(List<GuaguaFileSplit> splits)
Assign splits to each worker to make them load that data.
|
| Modifier and Type | Method and Description |
|---|---|
void |
GuaguaRecordReader.initialize(GuaguaFileSplit split)
Initialize file split for user to create relative reader instance.
|
| Modifier and Type | Method and Description |
|---|---|
void |
GuaguaMasterService.setSplits(List<GuaguaFileSplit> splits) |
| Modifier and Type | Method and Description |
|---|---|
List<GuaguaFileSplit> |
WorkerContext.getFileSplits() |
List<GuaguaFileSplit> |
GuaguaWorkerService.getSplits() |
| Modifier and Type | Method and Description |
|---|---|
abstract void |
AbstractWorkerComputable.initRecordReader(GuaguaFileSplit fileSplit)
Each
GuaguaFileSplit must be initialized before loading data. |
abstract void |
AbstractCombineWorkerComputable.initRecordReader(GuaguaFileSplit fileSplit)
Each
GuaguaFileSplit must be initialized before loading data. |
| Modifier and Type | Method and Description |
|---|---|
void |
GuaguaWorkerService.setSplits(List<GuaguaFileSplit> splits) |
| Constructor and Description |
|---|
WorkerContext(int totalIteration,
String appId,
Properties props,
String containerId,
List<GuaguaFileSplit> fileSplits,
String masterResultClassName,
String workerResultClassName) |
Copyright © 2018. All Rights Reserved.