Index (guagua-mapreduce 0.7.9 API)

A B C D E F G H I L M N P R S T W Z

A

abortTask(TaskAttemptContext) - Method in class ml.shifu.guagua.mapreduce.GuaguaOutputCommitter
addFileToClassPath(String, Configuration) - Static method in class ml.shifu.guagua.hadoop.util.HDPUtils: Add a hdfs file to classpath of one container.
addInputPath(Configuration, Path) - Static method in class ml.shifu.guagua.mapreduce.GuaguaMapReduceClient
addJob(String[]) - Method in class ml.shifu.guagua.mapreduce.GuaguaMapReduceClient: Add new job to JobControl instance.

B

bytesToObject(byte[], String) - Method in class ml.shifu.guagua.hadoop.io.GuaguaWritableSerializer: De-serialize from bytes to object.
bytesToObject(byte[], String) - Method in class ml.shifu.guagua.mapreduce.GuaguaWritableSerializer: Deprecated.

De-serialize from bytes to object.
BZ2 - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants

C

calculateProgress(Set<String>, JobControl, JobClient) - Method in class ml.shifu.guagua.mapreduce.GuaguaMapReduceClient: Compute the progress of the current job submitted through the JobControl object jc to the JobClient jobClient
checkOutputSpecs(JobContext) - Method in class ml.shifu.guagua.mapreduce.GuaguaOutputFormat
cleanup(Mapper<LongWritable, Text, Text, Text>.Context) - Method in class ml.shifu.guagua.mapreduce.GuaguaMapper
cleanupJob(JobContext) - Method in class ml.shifu.guagua.mapreduce.GuaguaOutputCommitter
close() - Method in class ml.shifu.guagua.hadoop.io.GuaguaLineRecordReader
close() - Method in class ml.shifu.guagua.hadoop.io.GuaguaSequenceRecordReader
close() - Method in class ml.shifu.guagua.mapreduce.GuaguaLineRecordReader: Deprecated.
close() - Method in class ml.shifu.guagua.mapreduce.GuaguaMRRecordReader
close(TaskAttemptContext) - Method in class ml.shifu.guagua.mapreduce.GuaguaRecordWriter
close() - Method in class ml.shifu.guagua.mapreduce.GuaguaSequenceRecordReader: Deprecated.
commitJob(JobContext) - Method in class ml.shifu.guagua.mapreduce.GuaguaOutputCommitter
commitTask(TaskAttemptContext) - Method in class ml.shifu.guagua.mapreduce.GuaguaOutputCommitter
createJob(String[]) - Method in class ml.shifu.guagua.mapreduce.GuaguaMapReduceClient: Create Hadoop job according to arguments from main.
createRecordReader(InputSplit, TaskAttemptContext) - Method in class ml.shifu.guagua.mapreduce.GuaguaInputFormat

D

DONE_WORKERS - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
doReadFields(DataInput) - Method in class ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter
doReadFields(DataInput) - Method in class ml.shifu.guagua.mapreduce.GuaguaWritableAdapter: Deprecated.
doWrite(DataOutput) - Method in class ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter
doWrite(DataOutput) - Method in class ml.shifu.guagua.mapreduce.GuaguaWritableAdapter: Deprecated.

E

equals(Object) - Method in class ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter
equals(Object) - Method in class ml.shifu.guagua.mapreduce.GuaguaWritableAdapter: Deprecated.

F

findContainingFile(String) - Static method in class ml.shifu.guagua.hadoop.util.HDPUtils: Find a real file that contains file name in class path.
findContainingJar(Class) - Static method in class ml.shifu.guagua.hadoop.util.HDPUtils

G

generateWorkerSplits(String) - Method in class ml.shifu.guagua.hadoop.GuaguaMRUnitDriver
generateWorkerSplits(String) - Method in class ml.shifu.guagua.mapreduce.GuaguaMRUnitDriver: Deprecated.
getCombineGuaguaSplits(List<InputSplit>, long) - Static method in class ml.shifu.guagua.mapreduce.GuaguaInputFormat
getCommandLine() - Method in class ml.shifu.guagua.hadoop.io.GuaguaOptionsParser: Returns the commons-cli CommandLine object to process the parsed arguments.
getCommandLine() - Method in class ml.shifu.guagua.mapreduce.GuaguaOptionsParser: Deprecated.

Returns the commons-cli CommandLine object to process the parsed arguments.
getConfiguration() - Method in class ml.shifu.guagua.hadoop.io.GuaguaOptionsParser: Get the modified configuration
getConfiguration() - Method in class ml.shifu.guagua.mapreduce.GuaguaOptionsParser: Deprecated.

Get the modified configuration
getCurrentKey() - Method in class ml.shifu.guagua.hadoop.io.GuaguaLineRecordReader
getCurrentKey() - Method in class ml.shifu.guagua.hadoop.io.GuaguaSequenceRecordReader
getCurrentKey() - Method in class ml.shifu.guagua.mapreduce.GuaguaLineRecordReader: Deprecated.
getCurrentKey() - Method in class ml.shifu.guagua.mapreduce.GuaguaMRRecordReader: This is a mock to hide Hadoop raw map iteration on map input key.
getCurrentKey() - Method in class ml.shifu.guagua.mapreduce.GuaguaSequenceRecordReader: Deprecated.
getCurrentValue() - Method in class ml.shifu.guagua.hadoop.io.GuaguaLineRecordReader
getCurrentValue() - Method in class ml.shifu.guagua.hadoop.io.GuaguaSequenceRecordReader
getCurrentValue() - Method in class ml.shifu.guagua.mapreduce.GuaguaLineRecordReader: Deprecated.
getCurrentValue() - Method in class ml.shifu.guagua.mapreduce.GuaguaMRRecordReader: This is a mock to hide Hadoop raw map iteration on map input value.
getCurrentValue() - Method in class ml.shifu.guagua.mapreduce.GuaguaSequenceRecordReader: Deprecated.
getExtensions() - Method in class ml.shifu.guagua.hadoop.io.GuaguaInputSplit
getFileSplits() - Method in class ml.shifu.guagua.hadoop.io.GuaguaInputSplit
getFileSplits() - Method in class ml.shifu.guagua.mapreduce.GuaguaInputSplit: Deprecated.
getFinalCombineGuaguaSplits(List<InputSplit>, long) - Method in class ml.shifu.guagua.mapreduce.GuaguaInputFormat: Copy from pig implementation, need to check this code logic.
getGuaguaService() - Method in class ml.shifu.guagua.mapreduce.GuaguaMapper
getGuaguaSplits(JobContext) - Method in class ml.shifu.guagua.mapreduce.GuaguaInputFormat: Generate the list of files and make them into FileSplits.
getHdpVersionForHDP224() - Static method in class ml.shifu.guagua.hadoop.util.HDPUtils: A ugly method to retrieve hdp version like 2.2.4.6633 from hadoop-hdfs jar name.
getLength() - Method in class ml.shifu.guagua.hadoop.io.GuaguaInputSplit: For master split, use Long.MAX_VALUE as its length to make it is the first task for Hadoop job.
getLength() - Method in class ml.shifu.guagua.mapreduce.GuaguaInputSplit: Deprecated.

For master split, use Long.MAX_VALUE as its length to make it is the first task for Hadoop job.
getLibJars(Configuration) - Static method in class ml.shifu.guagua.hadoop.io.GuaguaOptionsParser: If libjars are set in the conf, parse the libjars.
getLibJars(Configuration) - Static method in class ml.shifu.guagua.mapreduce.GuaguaOptionsParser: Deprecated.

If libjars are set in the conf, parse the libjars.
getLocations() - Method in class ml.shifu.guagua.hadoop.io.GuaguaInputSplit: Data locality functions, return all hosts for all file splits.
getLocations() - Method in class ml.shifu.guagua.mapreduce.GuaguaInputSplit: Deprecated.

Data locality functions, return all hosts for all file splits.
getOutputCommitter(TaskAttemptContext) - Method in class ml.shifu.guagua.mapreduce.GuaguaOutputFormat
getProgress() - Method in class ml.shifu.guagua.hadoop.io.GuaguaLineRecordReader: Get the progress within the split
getProgress() - Method in class ml.shifu.guagua.hadoop.io.GuaguaSequenceRecordReader: Return the progress within the input split
getProgress() - Method in class ml.shifu.guagua.mapreduce.GuaguaLineRecordReader: Deprecated.

Get the progress within the split
getProgress() - Method in class ml.shifu.guagua.mapreduce.GuaguaMRRecordReader: Each iteration context.nextKeyValue should be called, and currentIteration is updated, so the progress is updated.
getProgress() - Method in class ml.shifu.guagua.mapreduce.GuaguaSequenceRecordReader: Deprecated.

Return the progress within the input split
getRecordWriter(TaskAttemptContext) - Method in class ml.shifu.guagua.mapreduce.GuaguaOutputFormat
getRemainingArgs() - Method in class ml.shifu.guagua.hadoop.io.GuaguaOptionsParser: Returns an array of Strings containing only application-specific arguments.
getRemainingArgs() - Method in class ml.shifu.guagua.mapreduce.GuaguaOptionsParser: Deprecated.

Returns an array of Strings containing only application-specific arguments.
getSplits(JobContext) - Method in class ml.shifu.guagua.mapreduce.GuaguaInputFormat: Splitter building logic including master setting, also includes combining input feature like Pig.
getWritable() - Method in class ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter
getWritable() - Method in class ml.shifu.guagua.mapreduce.GuaguaWritableAdapter: Deprecated.
GUAGUA_PROGRESS_COUNTER_GROUP_NAME - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
GUAGUA_PROGRESS_COUNTER_NAME - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
GUAGUA_STATUS - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
GuaguaFailTaskRuntimeException - Exception in ml.shifu.guagua.mapreduce: FailTaskRuntimeException which is used to fail hadoop mapper task.
GuaguaFailTaskRuntimeException() - Constructor for exception ml.shifu.guagua.mapreduce.GuaguaFailTaskRuntimeException: Constructs a new fail task runtime exception with null as its detail message.
GuaguaFailTaskRuntimeException(String) - Constructor for exception ml.shifu.guagua.mapreduce.GuaguaFailTaskRuntimeException: Constructs a new fail task runtime exception with the specified detail message.
GuaguaFailTaskRuntimeException(String, Throwable) - Constructor for exception ml.shifu.guagua.mapreduce.GuaguaFailTaskRuntimeException: Constructs a new fail task runtime exception with the specified detail message and cause.
GuaguaFailTaskRuntimeException(Throwable) - Constructor for exception ml.shifu.guagua.mapreduce.GuaguaFailTaskRuntimeException: Constructs a new fail task runtime exception with the specified cause and a detail message of (cause==null ? null : cause.toString()) (which typically contains the class and detail message of cause).
GuaguaInputFormat - Class in ml.shifu.guagua.mapreduce: GuaguaInputFormat is used to determine how many mappers in guagua MapReduce job.
GuaguaInputFormat() - Constructor for class ml.shifu.guagua.mapreduce.GuaguaInputFormat
GuaguaInputSplit - Class in ml.shifu.guagua.hadoop.io: InputSplit implementation in guagua for Hadoop MapReduce job.
GuaguaInputSplit() - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaInputSplit: Default constructor without any setting.
GuaguaInputSplit(boolean, FileSplit...) - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaInputSplit: Constructor with GuaguaInputSplit.isMaster and GuaguaInputSplit.fileSplits settings.
GuaguaInputSplit(boolean, FileSplit) - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaInputSplit: Constructor with GuaguaInputSplit.isMaster and one FileSplit settings.
GuaguaInputSplit - Class in ml.shifu.guagua.mapreduce: Deprecated.
use GuaguaInputSplit
GuaguaInputSplit() - Constructor for class ml.shifu.guagua.mapreduce.GuaguaInputSplit: Deprecated.

Default constructor without any setting.
GuaguaInputSplit(boolean, FileSplit...) - Constructor for class ml.shifu.guagua.mapreduce.GuaguaInputSplit: Deprecated.

Constructor with GuaguaInputSplit.isMaster and GuaguaInputSplit.fileSplits settings.
GuaguaInputSplit(boolean, FileSplit) - Constructor for class ml.shifu.guagua.mapreduce.GuaguaInputSplit: Deprecated.

Constructor with GuaguaInputSplit.isMaster and one FileSplit settings.
GuaguaLineRecordReader - Class in ml.shifu.guagua.hadoop.io: A reader read HDFS file line by line.
GuaguaLineRecordReader() - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaLineRecordReader
GuaguaLineRecordReader(GuaguaFileSplit) - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaLineRecordReader
GuaguaLineRecordReader(Configuration, GuaguaFileSplit) - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaLineRecordReader
GuaguaLineRecordReader - Class in ml.shifu.guagua.mapreduce: Deprecated.
use GuaguaLineRecordReader
GuaguaLineRecordReader() - Constructor for class ml.shifu.guagua.mapreduce.GuaguaLineRecordReader: Deprecated.
GuaguaLineRecordReader(GuaguaFileSplit) - Constructor for class ml.shifu.guagua.mapreduce.GuaguaLineRecordReader: Deprecated.
GuaguaLineRecordReader(Configuration, GuaguaFileSplit) - Constructor for class ml.shifu.guagua.mapreduce.GuaguaLineRecordReader: Deprecated.
GuaguaMapper<MASTER_RESULT extends ml.shifu.guagua.io.Bytable,WORKER_RESULT extends ml.shifu.guagua.io.Bytable> - Class in ml.shifu.guagua.mapreduce: GuaguaMapper is the Hadoop Mapper implementation for both guagua master and guagua workers.
GuaguaMapper() - Constructor for class ml.shifu.guagua.mapreduce.GuaguaMapper
GuaguaMapReduceClient - Class in ml.shifu.guagua.mapreduce: GuaguaMapReduceClient is the entry point for guagua mapreduce implementation application.
GuaguaMapReduceClient() - Constructor for class ml.shifu.guagua.mapreduce.GuaguaMapReduceClient: Default constructor.
GuaguaMapReduceConstants - Class in ml.shifu.guagua.mapreduce: Constants in guagua mapreduce.
GuaguaMRRecordReader - Class in ml.shifu.guagua.mapreduce: GuaguaMRRecordReader is used as a mock for mapreduce reader interface, not real reading data.
GuaguaMRRecordReader() - Constructor for class ml.shifu.guagua.mapreduce.GuaguaMRRecordReader: Default constructor, GuaguaMRRecordReader.totalIterations is set to default 0.
GuaguaMRRecordReader(int) - Constructor for class ml.shifu.guagua.mapreduce.GuaguaMRRecordReader: Constructor with GuaguaMRRecordReader.totalIterations setting.
GuaguaMRUnitDriver<MASTER_RESULT extends ml.shifu.guagua.io.Bytable,WORKER_RESULT extends ml.shifu.guagua.io.Bytable> - Class in ml.shifu.guagua.hadoop: GuaguaMRUnitDriver is used to run in-memory guagua application by using hadoop MapReduce splits.
GuaguaMRUnitDriver(Properties) - Constructor for class ml.shifu.guagua.hadoop.GuaguaMRUnitDriver: A only constructor here for local in-memory guagua job.
GuaguaMRUnitDriver<MASTER_RESULT extends ml.shifu.guagua.io.Bytable,WORKER_RESULT extends ml.shifu.guagua.io.Bytable> - Class in ml.shifu.guagua.mapreduce: Deprecated.
use ml.shifu.guagua.hadoop.io.GuaguaMRUnitDriver
GuaguaMRUnitDriver(Properties) - Constructor for class ml.shifu.guagua.mapreduce.GuaguaMRUnitDriver: Deprecated.

A only constructor here for local in-memory guagua job.
GuaguaOptionsParser - Class in ml.shifu.guagua.hadoop.io: Copy from hadoop GenericOptionsParser and extend it.
GuaguaOptionsParser(Options, String[]) - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaOptionsParser: Create an options parser with the given options to parse the args.
GuaguaOptionsParser(String[]) - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaOptionsParser: Create an options parser to parse the args.
GuaguaOptionsParser(Configuration, String[]) - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaOptionsParser: Create a GuaguaOptionsParser to parse only the generic Hadoop arguments.
GuaguaOptionsParser(Configuration, Options, String[]) - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaOptionsParser: Create a GuaguaOptionsParser to parse given options as well as generic Hadoop options.
GuaguaOptionsParser - Class in ml.shifu.guagua.mapreduce: Deprecated.
use GuaguaOptionsParser
GuaguaOptionsParser(Options, String[]) - Constructor for class ml.shifu.guagua.mapreduce.GuaguaOptionsParser: Deprecated.

Create an options parser with the given options to parse the args.
GuaguaOptionsParser(String[]) - Constructor for class ml.shifu.guagua.mapreduce.GuaguaOptionsParser: Deprecated.

Create an options parser to parse the args.
GuaguaOptionsParser(Configuration, String[]) - Constructor for class ml.shifu.guagua.mapreduce.GuaguaOptionsParser: Deprecated.

Create a GuaguaOptionsParser to parse only the generic Hadoop arguments.
GuaguaOptionsParser(Configuration, Options, String[]) - Constructor for class ml.shifu.guagua.mapreduce.GuaguaOptionsParser: Deprecated.

Create a GuaguaOptionsParser to parse given options as well as generic Hadoop options.
GuaguaOutputCommitter - Class in ml.shifu.guagua.mapreduce: This output committer doesn't do anything, meant for the case where output isn't desired, or as a base for not using FileOutputCommitter.
GuaguaOutputCommitter() - Constructor for class ml.shifu.guagua.mapreduce.GuaguaOutputCommitter
GuaguaOutputFormat - Class in ml.shifu.guagua.mapreduce: This is for internal use only.
GuaguaOutputFormat() - Constructor for class ml.shifu.guagua.mapreduce.GuaguaOutputFormat
GuaguaRecordWriter - Class in ml.shifu.guagua.mapreduce: We don't use GuaguaRecordWriter but hadoop MapReduce needs it.
GuaguaRecordWriter() - Constructor for class ml.shifu.guagua.mapreduce.GuaguaRecordWriter
GuaguaSequenceAsBinaryRecordReader - Class in ml.shifu.guagua.hadoop.io: A reader read HDFS sequence file key by key.
GuaguaSequenceAsBinaryRecordReader() - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaSequenceAsBinaryRecordReader
GuaguaSequenceAsBinaryRecordReader(GuaguaFileSplit) - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaSequenceAsBinaryRecordReader
GuaguaSequenceAsBinaryRecordReader(Configuration, GuaguaFileSplit) - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaSequenceAsBinaryRecordReader
GuaguaSequenceAsBinaryRecordReader - Class in ml.shifu.guagua.mapreduce: Deprecated.
use GuaguaSequenceAsBinaryRecordReader
GuaguaSequenceAsBinaryRecordReader() - Constructor for class ml.shifu.guagua.mapreduce.GuaguaSequenceAsBinaryRecordReader: Deprecated.
GuaguaSequenceAsBinaryRecordReader(GuaguaFileSplit) - Constructor for class ml.shifu.guagua.mapreduce.GuaguaSequenceAsBinaryRecordReader: Deprecated.
GuaguaSequenceAsBinaryRecordReader(Configuration, GuaguaFileSplit) - Constructor for class ml.shifu.guagua.mapreduce.GuaguaSequenceAsBinaryRecordReader: Deprecated.
GuaguaSequenceAsTextRecordReader - Class in ml.shifu.guagua.hadoop.io: A reader read HDFS sequence file key by key.
GuaguaSequenceAsTextRecordReader() - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaSequenceAsTextRecordReader
GuaguaSequenceAsTextRecordReader(GuaguaFileSplit) - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaSequenceAsTextRecordReader
GuaguaSequenceAsTextRecordReader(Configuration, GuaguaFileSplit) - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaSequenceAsTextRecordReader
GuaguaSequenceAsTextRecordReader - Class in ml.shifu.guagua.mapreduce: Deprecated.
use GuaguaSequenceAsTextRecordReader
GuaguaSequenceAsTextRecordReader() - Constructor for class ml.shifu.guagua.mapreduce.GuaguaSequenceAsTextRecordReader: Deprecated.
GuaguaSequenceAsTextRecordReader(GuaguaFileSplit) - Constructor for class ml.shifu.guagua.mapreduce.GuaguaSequenceAsTextRecordReader: Deprecated.
GuaguaSequenceAsTextRecordReader(Configuration, GuaguaFileSplit) - Constructor for class ml.shifu.guagua.mapreduce.GuaguaSequenceAsTextRecordReader: Deprecated.
GuaguaSequenceRecordReader<KEY extends org.apache.hadoop.io.Writable,VALUE extends org.apache.hadoop.io.Writable> - Class in ml.shifu.guagua.hadoop.io: A reader read HDFS sequence file key by key.
GuaguaSequenceRecordReader(Class<? extends Writable>, Class<? extends Writable>) - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaSequenceRecordReader
GuaguaSequenceRecordReader(GuaguaFileSplit, Class<? extends Writable>, Class<? extends Writable>) - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaSequenceRecordReader
GuaguaSequenceRecordReader(Configuration, GuaguaFileSplit, Class<? extends Writable>, Class<? extends Writable>) - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaSequenceRecordReader
GuaguaSequenceRecordReader<KEY extends org.apache.hadoop.io.Writable,VALUE extends org.apache.hadoop.io.Writable> - Class in ml.shifu.guagua.mapreduce: Deprecated.
use GuaguaSequenceRecordReader
GuaguaSequenceRecordReader(Class<? extends Writable>, Class<? extends Writable>) - Constructor for class ml.shifu.guagua.mapreduce.GuaguaSequenceRecordReader: Deprecated.
GuaguaSequenceRecordReader(GuaguaFileSplit, Class<? extends Writable>, Class<? extends Writable>) - Constructor for class ml.shifu.guagua.mapreduce.GuaguaSequenceRecordReader: Deprecated.
GuaguaSequenceRecordReader(Configuration, GuaguaFileSplit, Class<? extends Writable>, Class<? extends Writable>) - Constructor for class ml.shifu.guagua.mapreduce.GuaguaSequenceRecordReader: Deprecated.
GuaguaWritableAdapter<W extends org.apache.hadoop.io.Writable> - Class in ml.shifu.guagua.hadoop.io: GuaguaWritableAdapter is used to adapt hadoop io to Bytable interface.
GuaguaWritableAdapter(W) - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter: Constructor with Hadoop Writable setting.
GuaguaWritableAdapter<W extends org.apache.hadoop.io.Writable> - Class in ml.shifu.guagua.mapreduce: Deprecated.
use GuaguaWritableAdapter
GuaguaWritableAdapter(W) - Constructor for class ml.shifu.guagua.mapreduce.GuaguaWritableAdapter: Deprecated.

Constructor with Hadoop Writable setting.
GuaguaWritableSerializer<RESULT extends ml.shifu.guagua.io.Bytable> - Class in ml.shifu.guagua.hadoop.io: GuaguaWritableSerializer is to provide the functionality to support use hadoop writable interface.
GuaguaWritableSerializer() - Constructor for class ml.shifu.guagua.hadoop.io.GuaguaWritableSerializer
GuaguaWritableSerializer<RESULT extends ml.shifu.guagua.io.Bytable> - Class in ml.shifu.guagua.mapreduce: Deprecated.
use GuaguaWritableSerializer
GuaguaWritableSerializer() - Constructor for class ml.shifu.guagua.mapreduce.GuaguaWritableSerializer: Deprecated.





H

HADOOP_SUCCESS - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
hashCode() - Method in class ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter
 
hashCode() - Method in class ml.shifu.guagua.mapreduce.GuaguaWritableAdapter

Deprecated.
 
HDPUtils - Class in ml.shifu.guagua.hadoop.util

For HortonWorks HDP 2.2.4 two issues not caomptible with other hadoop 2.x versions.

HDPUtils() - Constructor for class ml.shifu.guagua.hadoop.util.HDPUtils
 




I

initialize(GuaguaFileSplit) - Method in class ml.shifu.guagua.hadoop.io.GuaguaLineRecordReader
 
initialize(GuaguaFileSplit) - Method in class ml.shifu.guagua.hadoop.io.GuaguaSequenceRecordReader
 
initialize(GuaguaFileSplit) - Method in class ml.shifu.guagua.mapreduce.GuaguaLineRecordReader

Deprecated.
 
initialize(InputSplit, TaskAttemptContext) - Method in class ml.shifu.guagua.mapreduce.GuaguaMRRecordReader
 
initialize(GuaguaFileSplit) - Method in class ml.shifu.guagua.mapreduce.GuaguaSequenceRecordReader

Deprecated.
 
IO_SORT_MB - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
isMaster() - Method in class ml.shifu.guagua.hadoop.io.GuaguaInputSplit
 
isMaster() - Method in class ml.shifu.guagua.mapreduce.GuaguaInputSplit

Deprecated.
 
isMaster() - Method in class ml.shifu.guagua.mapreduce.GuaguaMapper
 
isPigOrHadoopMetaFile(Path) - Method in class ml.shifu.guagua.mapreduce.GuaguaInputFormat

Whether it is not pig or hadoop meta output file.

isSplitable(JobContext, Path) - Method in class ml.shifu.guagua.mapreduce.GuaguaInputFormat
 




L

listStatus(Configuration, String) - Method in class ml.shifu.guagua.hadoop.GuaguaMRUnitDriver

List input directories.

listStatus(Configuration, String) - Method in class ml.shifu.guagua.mapreduce.GuaguaMRUnitDriver

Deprecated.
List input directories.





M

main(String[]) - Static method in class ml.shifu.guagua.mapreduce.GuaguaMapReduceClient
 
MAPRED_CHILD_JAVA_OPTS - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
MAPRED_DEFAULT_CHILD_JAVA_OPTS - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
MAPRED_INPUT_DIR - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
MAPRED_JOB_ID - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
MAPRED_JOB_REDUCE_MEMORY_MB - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
MAPRED_MAP_MAX_ATTEMPTS - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
MAPRED_MAP_TASKS_SPECULATIVE_EXECUTION - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
MAPRED_MAX_SPLIT_SIZE - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
MAPRED_MIN_SPLIT_SIZE - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
MAPRED_REDUCE_TASKS_SPECULATIVE_EXECUTION - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
MAPRED_TASK_ID - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
MAPRED_TASK_PARTITION - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
MAPRED_TASK_TIMEOUT - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
MAPREDUCE_JOB_COUNTERS_LIMIT - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
MAPREDUCE_JOB_MAX_SPLIT_LOCATIONS - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
MAPREDUCE_MAP_SPECULATIVE - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
MAPREDUCE_REDUCE_SPECULATIVE - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
MAPREDUCE_TASK_TIMEOUT - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
MASTER_SUCCESS - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
ml.shifu.guagua.hadoop - package ml.shifu.guagua.hadoop

Common related Hadoop components.

ml.shifu.guagua.hadoop.io - package ml.shifu.guagua.hadoop.io

This package contains hadoop related common io classes.

ml.shifu.guagua.hadoop.util - package ml.shifu.guagua.hadoop.util

Hadoop related utility functions.

ml.shifu.guagua.mapreduce - package ml.shifu.guagua.mapreduce

This package contains guagua-mapreduce implementation details based one only mapper hadoop job.





N

needsTaskCommit(TaskAttemptContext) - Method in class ml.shifu.guagua.mapreduce.GuaguaOutputCommitter
 
nextKeyValue() - Method in class ml.shifu.guagua.hadoop.io.GuaguaLineRecordReader
 
nextKeyValue() - Method in class ml.shifu.guagua.hadoop.io.GuaguaSequenceRecordReader
 
nextKeyValue() - Method in class ml.shifu.guagua.mapreduce.GuaguaLineRecordReader

Deprecated.
 
nextKeyValue() - Method in class ml.shifu.guagua.mapreduce.GuaguaMRRecordReader

Update iteration number.

nextKeyValue() - Method in class ml.shifu.guagua.mapreduce.GuaguaSequenceRecordReader

Deprecated.
 
NUM_INPUT_FILES - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 




P

PIG_HEADER - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
PIG_SCHEMA - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 
postApplication(MasterContext<MASTER_RESULT, WORKER_RESULT>) - Method in class ml.shifu.guagua.hadoop.ZooKeeperMasterInterceptor
 
preApplication(MasterContext<MASTER_RESULT, WORKER_RESULT>) - Method in class ml.shifu.guagua.hadoop.ZooKeeperMasterInterceptor
 
preApplication(WorkerContext<MASTER_RESULT, WORKER_RESULT>) - Method in class ml.shifu.guagua.hadoop.ZooKeeperWorkerInterceptor
 
printGenericCommandUsage(PrintStream) - Static method in class ml.shifu.guagua.hadoop.io.GuaguaOptionsParser

Print the usage message for generic command-line options supported.

printGenericCommandUsage(PrintStream) - Static method in class ml.shifu.guagua.mapreduce.GuaguaOptionsParser

Deprecated.
Print the usage message for generic command-line options supported.

progressOfRunningJob(ControlledJob, JobClient) - Method in class ml.shifu.guagua.mapreduce.GuaguaMapReduceClient

Returns the progress of a Job j which is part of a submitted JobControl object.





R

readFields(DataInput) - Method in class ml.shifu.guagua.hadoop.io.GuaguaInputSplit
 
readFields(DataInput) - Method in class ml.shifu.guagua.mapreduce.GuaguaInputSplit

Deprecated.
 
run(Mapper<LongWritable, Text, Text, Text>.Context) - Method in class ml.shifu.guagua.mapreduce.GuaguaMapper

Run guagua service according GuaguaMapper.isMaster setting.

run() - Method in class ml.shifu.guagua.mapreduce.GuaguaMapReduceClient

Run all jobs added to JobControl.





S

setCurrentIteration(int) - Static method in class ml.shifu.guagua.mapreduce.GuaguaMRRecordReader

Should only be called in GuaguaMapper Progress callback.

setExtensions(Object[]) - Method in class ml.shifu.guagua.hadoop.io.GuaguaInputSplit
 
setFileSplits(FileSplit[]) - Method in class ml.shifu.guagua.hadoop.io.GuaguaInputSplit
 
setFileSplits(FileSplit[]) - Method in class ml.shifu.guagua.mapreduce.GuaguaInputSplit

Deprecated.
 
setGuaguaService(GuaguaService) - Method in class ml.shifu.guagua.mapreduce.GuaguaMapper
 
setMaster(boolean) - Method in class ml.shifu.guagua.hadoop.io.GuaguaInputSplit
 
setMaster(boolean) - Method in class ml.shifu.guagua.mapreduce.GuaguaInputSplit

Deprecated.
 
setMaster(boolean) - Method in class ml.shifu.guagua.mapreduce.GuaguaMapper
 
setup(Mapper<LongWritable, Text, Text, Text>.Context) - Method in class ml.shifu.guagua.mapreduce.GuaguaMapper
 
setupJob(JobContext) - Method in class ml.shifu.guagua.mapreduce.GuaguaOutputCommitter
 
setupTask(TaskAttemptContext) - Method in class ml.shifu.guagua.mapreduce.GuaguaOutputCommitter
 
setWritable(W) - Method in class ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter
 
setWritable(W) - Method in class ml.shifu.guagua.mapreduce.GuaguaWritableAdapter

Deprecated.
 
SPLIT_SLOP - Static variable in class ml.shifu.guagua.mapreduce.GuaguaMapReduceConstants
 




T

toFakedStateString(ControlledJob) - Method in class ml.shifu.guagua.mapreduce.GuaguaMapReduceClient
 
toString() - Method in class ml.shifu.guagua.hadoop.io.GuaguaInputSplit
 
toString() - Method in class ml.shifu.guagua.hadoop.io.GuaguaWritableAdapter
 
toString() - Method in class ml.shifu.guagua.mapreduce.GuaguaInputSplit

Deprecated.
 
toString() - Method in class ml.shifu.guagua.mapreduce.GuaguaWritableAdapter

Deprecated.
 




W

write(DataOutput) - Method in class ml.shifu.guagua.hadoop.io.GuaguaInputSplit
 
write(DataOutput) - Method in class ml.shifu.guagua.mapreduce.GuaguaInputSplit

Deprecated.
 
write(Text, Text) - Method in class ml.shifu.guagua.mapreduce.GuaguaRecordWriter
 




Z

ZooKeeperMasterInterceptor<MASTER_RESULT extends ml.shifu.guagua.io.Bytable,WORKER_RESULT extends ml.shifu.guagua.io.Bytable> - Class in ml.shifu.guagua.hadoop

To start zookeeper instance in cluster environment.

ZooKeeperMasterInterceptor() - Constructor for class ml.shifu.guagua.hadoop.ZooKeeperMasterInterceptor
 
ZooKeeperWorkerInterceptor<MASTER_RESULT extends ml.shifu.guagua.io.Bytable,WORKER_RESULT extends ml.shifu.guagua.io.Bytable> - Class in ml.shifu.guagua.hadoop

Follow with ZooKeeperMasterInterceptor, ZooKeeperWorkerInterceptor is used to read zookeeper server
 info from hdfs file.

ZooKeeperWorkerInterceptor() - Constructor for class ml.shifu.guagua.hadoop.ZooKeeperWorkerInterceptor
 

A B C D E F G H I L M N P R S T W Z