Interface BucketCreator<T extends org.gorpipe.gor.table.dictionary.DictionaryEntry>

All Known Implementing Classes:
BucketCreatorGorPipe

public interface BucketCreator<T extends org.gorpipe.gor.table.dictionary.DictionaryEntry>
Helper class to create bucket files from bucket descriptions.
  • Method Summary

    Modifier and Type
    Method
    Description
    void
    createBucketsForBucketDir(org.gorpipe.gor.table.dictionary.BaseDictionaryTable<T> table, Map<String,List<T>> bucketsToCreate, URI absBucketDir)
    Create bucket files for a single bucket dir.
  • Method Details

    • createBucketsForBucketDir

      void createBucketsForBucketDir(org.gorpipe.gor.table.dictionary.BaseDictionaryTable<T> table, Map<String,List<T>> bucketsToCreate, URI absBucketDir) throws IOException
      Create bucket files for a single bucket dir. If there are multiple bucket dirs then this method will be called multiple times.
      Parameters:
      table - table to create bucket for. Should not change while running this could be a copy of the original table.
      bucketsToCreate - map with bucket name to table entries, representing the buckets to be created.
      absBucketDir - absolute path to the bucket dir, where bucket files should be put. It temp folders are to be used they should be created in this dir (for fast file move).
      Throws:
      IOException