alluxio.job.transform

Class CompactConfig

java.lang.Object

alluxio.job.transform.CompactConfig

All Implemented Interfaces:

JobConfig, java.io.Serializable

@ThreadSafe
public final class CompactConfig
extends java.lang.Object
implements JobConfig

Configuration for a job to compact files directly under a directory. Files will be compacted into a certain number of files, if the number of existing files is less than the specified number, then no compaction happens, otherwise, assume we want to compact 100 files to 10 files, then every 10 files will be compacted into one file. The original order of rows is preserved.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
CompactConfig(PartitionInfo partitionInfo, java.lang.String input, java.lang.String output, java.lang.String databaseType, java.lang.Integer numFiles)

Method Summary

Modifier and Type	Method and Description
boolean	equals(java.lang.Object obj)
java.lang.String	getDatabaseType()
java.lang.String	getInput()
java.lang.String	getName()
int	getNumFiles()
java.lang.String	getOutput()
PartitionInfo	getPartitionInfo()
int	hashCode()
java.lang.String	toString()

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

CompactConfig

public CompactConfig(PartitionInfo partitionInfo,
                     java.lang.String input,
                     java.lang.String output,
                     java.lang.String databaseType,
                     java.lang.Integer numFiles)

Parameters:

partitionInfo - the partition info

input - the input directory

output - the output directory

databaseType - the type of database to write the compacted table to

numFiles - the number of files after compaction

Method Detail

getPartitionInfo

public PartitionInfo getPartitionInfo()

Returns:

the partition info

getInput

public java.lang.String getInput()

Returns:

the input directory

getOutput

public java.lang.String getOutput()

Returns:

the output directory

getDatabaseType

public java.lang.String getDatabaseType()

Returns:

the type of database to write the compacted table to

getNumFiles

public int getNumFiles()

Returns:

the number of files after compaction

equals

public boolean equals(java.lang.Object obj)

Overrides:

equals in class java.lang.Object

hashCode

public int hashCode()

Overrides:

hashCode in class java.lang.Object

toString

public java.lang.String toString()

Overrides:

toString in class java.lang.Object

getName

public java.lang.String getName()

Specified by:

getName in interface JobConfig

Returns:

the name of the job