alluxio.job.plan.transform

Class CompactConfig

java.lang.Object

alluxio.job.plan.transform.CompactConfig

All Implemented Interfaces:

JobConfig, PlanConfig, java.io.Serializable

@ThreadSafe
public final class CompactConfig
extends java.lang.Object
implements PlanConfig

Configuration for a job to compact files directly under a directory. Files will be compacted into a certain number of files, if the number of existing files is less than the specified number, then no compaction happens, otherwise, assume we want to compact 100 files to 10 files, then every 10 files will be compacted into one file. The original order of rows is preserved.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
CompactConfig(PartitionInfo partitionInfo, java.lang.String input, java.lang.String output, java.lang.String databaseType, java.lang.Integer maxNumFiles, java.lang.Long minFileSize)

Method Summary

Modifier and Type	Method and Description
boolean	equals(java.lang.Object obj)
java.lang.String	getDatabaseType()
java.lang.String	getInput()
int	getMaxNumFiles()
long	getMinFileSize()
java.lang.String	getName()
java.lang.String	getOutput()
PartitionInfo	getPartitionInfo()
int	hashCode()
java.lang.String	toString()

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

CompactConfig

public CompactConfig(PartitionInfo partitionInfo,
                     java.lang.String input,
                     java.lang.String output,
                     java.lang.String databaseType,
                     java.lang.Integer maxNumFiles,
                     java.lang.Long minFileSize)

Parameters:

partitionInfo - the partition info

input - the input directory

output - the output directory

databaseType - the type of database to write the compacted table to

maxNumFiles - the maximum number of files after compaction

minFileSize - the minimum file size for coalescing

Method Detail

getPartitionInfo

public PartitionInfo getPartitionInfo()

Returns:

the partition info

getInput

public java.lang.String getInput()

Returns:

the input directory

getOutput

public java.lang.String getOutput()

Returns:

the output directory

getDatabaseType

public java.lang.String getDatabaseType()

Returns:

the type of database to write the compacted table to

getMaxNumFiles

public int getMaxNumFiles()

Returns:

the number of files after compaction

getMinFileSize

public long getMinFileSize()

Returns:

the file size

equals

public boolean equals(java.lang.Object obj)

Overrides:

equals in class java.lang.Object

hashCode

public int hashCode()

Overrides:

hashCode in class java.lang.Object

toString

public java.lang.String toString()

Overrides:

toString in class java.lang.Object

getName

public java.lang.String getName()

Specified by:

getName in interface JobConfig

Returns:

the name of the job