org.calrissian.accumulorecipes.blobstore.ext.impl

Class HighSpeedIngestBlobStore

java.lang.Object

org.calrissian.accumulorecipes.blobstore.impl.AccumuloBlobStore

org.calrissian.accumulorecipes.blobstore.ext.impl.ExtendedAccumuloBlobStore

org.calrissian.accumulorecipes.blobstore.ext.impl.HighSpeedIngestBlobStore

All Implemented Interfaces:

BlobStore, ExtendedBlobStore

public class HighSpeedIngestBlobStore
extends ExtendedAccumuloBlobStore

This is an implementation of the blob store using a single large batch writer to the blob store. This allows for a larger amount of data to be written at once, but by using a single writer there is the possibility that data from several storage streams could be intermingled during a write. This means data flushed from one stream will actually flush data for all streams that are currently opened. In most instances this should not be a problem as the data will be written anyway.

Field Summary

Fields inherited from class org.calrissian.accumulorecipes.blobstore.impl.AccumuloBlobStore

connector, tableName

Constructor Summary

Constructors

Constructor and Description
HighSpeedIngestBlobStore(org.apache.accumulo.core.client.Connector connector)
HighSpeedIngestBlobStore(org.apache.accumulo.core.client.Connector connector, int bufferSize)
HighSpeedIngestBlobStore(org.apache.accumulo.core.client.Connector connector, String tableName, StoreConfig config)
HighSpeedIngestBlobStore(org.apache.accumulo.core.client.Connector connector, String tableName, StoreConfig config, int bufferSize)

Method Summary

Methods

Modifier and Type	Method and Description
protected org.apache.accumulo.core.client.BatchWriter	getWriter() Returns a new batch writer for the table.
void	shutdown() Will close all underlying resources

Methods inherited from class org.calrissian.accumulorecipes.blobstore.ext.impl.ExtendedAccumuloBlobStore

blobSize, configureTable, generateMutation, getProperties, store

Methods inherited from class org.calrissian.accumulorecipes.blobstore.impl.AccumuloBlobStore

generateRowId, generateWriteStream, get, store

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.calrissian.accumulorecipes.blobstore.BlobStore

get, store

Constructor Detail

HighSpeedIngestBlobStore

public HighSpeedIngestBlobStore(org.apache.accumulo.core.client.Connector connector)
                         throws org.apache.accumulo.core.client.TableExistsException,
                                org.apache.accumulo.core.client.AccumuloSecurityException,
                                org.apache.accumulo.core.client.AccumuloException,
                                org.apache.accumulo.core.client.TableNotFoundException

Throws:

org.apache.accumulo.core.client.TableExistsException

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.TableNotFoundException

HighSpeedIngestBlobStore

public HighSpeedIngestBlobStore(org.apache.accumulo.core.client.Connector connector,
                        String tableName,
                        StoreConfig config)
                         throws org.apache.accumulo.core.client.TableExistsException,
                                org.apache.accumulo.core.client.AccumuloSecurityException,
                                org.apache.accumulo.core.client.AccumuloException,
                                org.apache.accumulo.core.client.TableNotFoundException

Throws:

org.apache.accumulo.core.client.TableExistsException

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.TableNotFoundException

HighSpeedIngestBlobStore

public HighSpeedIngestBlobStore(org.apache.accumulo.core.client.Connector connector,
                        int bufferSize)
                         throws org.apache.accumulo.core.client.TableExistsException,
                                org.apache.accumulo.core.client.AccumuloSecurityException,
                                org.apache.accumulo.core.client.AccumuloException,
                                org.apache.accumulo.core.client.TableNotFoundException

Throws:

org.apache.accumulo.core.client.TableExistsException

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.TableNotFoundException

HighSpeedIngestBlobStore

public HighSpeedIngestBlobStore(org.apache.accumulo.core.client.Connector connector,
                        String tableName,
                        StoreConfig config,
                        int bufferSize)
                         throws org.apache.accumulo.core.client.TableExistsException,
                                org.apache.accumulo.core.client.AccumuloSecurityException,
                                org.apache.accumulo.core.client.AccumuloException,
                                org.apache.accumulo.core.client.TableNotFoundException

Throws:

org.apache.accumulo.core.client.TableExistsException

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.TableNotFoundException

Method Detail

shutdown

public void shutdown()
              throws org.apache.accumulo.core.client.MutationsRejectedException

Will close all underlying resources

Throws:

org.apache.accumulo.core.client.MutationsRejectedException

getWriter

protected org.apache.accumulo.core.client.BatchWriter getWriter()
                                                         throws org.apache.accumulo.core.client.TableNotFoundException

Returns a new batch writer for the table.

Overrides:

getWriter in class AccumuloBlobStore

Returns:

Throws:

org.apache.accumulo.core.client.TableNotFoundException