Package org.gorpipe.gor.manager

Class BucketCreatorGorPipe<T extends org.gorpipe.gor.table.dictionary.DictionaryEntry>

java.lang.Object

org.gorpipe.gor.manager.BucketCreatorGorPipe<T>

All Implemented Interfaces:

BucketCreator<T>

public class BucketCreatorGorPipe<T extends org.gorpipe.gor.table.dictionary.DictionaryEntry>
extends Object
implements BucketCreator<T>

Helper class to create bucket file from bucket description.

Field Summary

Fields

Modifier and Type	Field	Description
static final int	DEFAULT_NUMBER_WORKERS

Constructor Summary

Constructors

Constructor	Description
BucketCreatorGorPipe()
BucketCreatorGorPipe(int workers)

Method Summary

Modifier and Type	Method	Description
void	createBucketsForBucketDir(org.gorpipe.gor.table.dictionary.BaseDictionaryTable<T> table, Map<String,List<T>> bucketsToCreate, URI absBucketDir)	Create bucket files for a single bucket dir.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

DEFAULT_NUMBER_WORKERS

public static final int DEFAULT_NUMBER_WORKERS

See Also:

• Constant Field Values

Constructor Details

BucketCreatorGorPipe

public BucketCreatorGorPipe()

BucketCreatorGorPipe

public BucketCreatorGorPipe(int workers)

Method Details

createBucketsForBucketDir

public void createBucketsForBucketDir(org.gorpipe.gor.table.dictionary.BaseDictionaryTable<T> table,
 Map<String,List<T>> bucketsToCreate,
 URI absBucketDir)
                               throws IOException

Description copied from interface: BucketCreator

Create bucket files for a single bucket dir. If there are multiple bucket dirs then this method will be called multiple times.

Specified by:

createBucketsForBucketDir in interface BucketCreator<T extends org.gorpipe.gor.table.dictionary.DictionaryEntry>

Parameters:

table - table to create bucket for. Should not change while running this could be a copy of the original table.

bucketsToCreate - map with bucket name to table entries, representing the buckets to be created.

absBucketDir - absolute path to the bucket dir, where bucket files should be put. It temp folders are to be used they should be created in this dir (for fast file move).

Throws:

IOException