org.apache.hadoop.examples

Class MultiFileWordCount

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.hadoop.examples.MultiFileWordCount

All Implemented Interfaces:

Configurable, Tool

public class MultiFileWordCount
extends Configured
implements Tool

MultiFileWordCount is an example to demonstrate the usage of MultiFileInputFormat. This examples counts the occurrences of words in the text files under the given input directory.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	MultiFileWordCount.CombineFileLineRecordReader RecordReader is responsible from extracting records from a chunk of the CombineFileSplit.
static class	MultiFileWordCount.MapClass This Mapper is similar to the one in WordCount.TokenizerMapper.
static class	MultiFileWordCount.MyInputFormat To use CombineFileInputFormat, one should extend it, to return a (custom) RecordReader.
static class	MultiFileWordCount.WordOffset This record keeps <filename,offset> pairs.

Constructor Summary

Constructors

Constructor and Description
MultiFileWordCount()

Method Summary

Modifier and Type	Method and Description
static void	main(String[] args)
int	run(String[] args)

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Constructor Detail

MultiFileWordCount

public MultiFileWordCount()

Method Detail

run

public int run(String[] args)
        throws Exception

Specified by:

run in interface Tool

Throws:

Exception

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception