org.apache.hadoop.examples.terasort

Class TeraGen

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.hadoop.examples.terasort.TeraGen

All Implemented Interfaces:

Configurable, Tool

public class TeraGen
extends Configured
implements Tool

Generate the official GraySort input data set. The user specifies the number of rows and the output directory and this class runs a map/reduce program to generate the data. The format of the data is:

• (10 bytes key) (constant 2 bytes) (32 bytes rowid) (constant 4 bytes) (48 bytes filler) (constant 4 bytes)
• The rowid is the right justified row id as a hex number.

To run the program: bin/hadoop jar hadoop-*-examples.jar teragen 10000000000 in-dir

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TeraGen.Counters
static class	TeraGen.SortGenMapper The Mapper class that given a row number, will generate the appropriate output line.

Field Summary

Fields

Modifier and Type	Field and Description
static String	NUM_ROWS

Constructor Summary

Constructors

Constructor and Description
TeraGen()

Method Summary

Modifier and Type	Method and Description
static void	main(String[] args)
int	run(String[] args)

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Field Detail

NUM_ROWS

public static final String NUM_ROWS

See Also:

Constant Field Values

Constructor Detail

TeraGen

public TeraGen()

Method Detail

run

public int run(String[] args)
        throws IOException,
               InterruptedException,
               ClassNotFoundException

Specified by:

run in interface Tool

Parameters:

args - the cli arguments

Throws:

IOException

InterruptedException

ClassNotFoundException

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception