org.calrissian.accumulorecipes.blobstore.impl

Class AccumuloBlobStore

java.lang.Object

org.calrissian.accumulorecipes.blobstore.impl.AccumuloBlobStore

All Implemented Interfaces:

BlobStore

Direct Known Subclasses:

ExtendedAccumuloBlobStore

public class AccumuloBlobStore
extends Object
implements BlobStore

An accumulo representation of the blob store. For purposes of simplicity, current implementation only stores data that can be loaded into a byte array in memory- the interface uses standard Streams to allow future implementations to partition large blobs over several different rows that can be streamed from Accumulo. Row format is as follows: RowId: keytype Column Family: DATA Column Qualifier: sequence# Value: byte[]

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.accumulo.core.client.Connector	connector
protected String	tableName

Constructor Summary

Constructors

Constructor and Description
AccumuloBlobStore(org.apache.accumulo.core.client.Connector connector)
AccumuloBlobStore(org.apache.accumulo.core.client.Connector connector, int bufferSize)
AccumuloBlobStore(org.apache.accumulo.core.client.Connector connector, String tableName, StoreConfig config)
AccumuloBlobStore(org.apache.accumulo.core.client.Connector connector, String tableName, StoreConfig config, int bufferSize)

Method Summary

Methods

Modifier and Type	Method and Description
protected void	configureTable(org.apache.accumulo.core.client.Connector connector, String tableName) Utility method to update the correct iterators to the table.
protected org.apache.accumulo.core.data.Mutation	generateMutation(String key, String type, byte[] data, int sequenceNum, long timestamp, org.apache.accumulo.core.security.ColumnVisibility visibility) Helper method to generate a mutation for each chunk of data that is being stored.
protected static String	generateRowId(String key, String type) Helper method to generate the rowID for the data mutations.
protected OutputStream	generateWriteStream(org.apache.accumulo.core.client.BatchWriter writer, String key, String type, long timestamp, String visibility) Helper method to generate an OutputStream for storing data into Accumulo.
InputStream	get(String key, String type, Auths auths) Provides an InputStream to retrieve the data from the store.
protected org.apache.accumulo.core.client.BatchWriter	getWriter() Returns a new batch writer for the table.
OutputStream	store(String key, String type, long timestamp, String visibility) Provides an OutputStream to allow storage of the data into the store.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

connector

protected final org.apache.accumulo.core.client.Connector connector

tableName

protected final String tableName

Constructor Detail

AccumuloBlobStore

public AccumuloBlobStore(org.apache.accumulo.core.client.Connector connector)
                  throws org.apache.accumulo.core.client.TableExistsException,
                         org.apache.accumulo.core.client.AccumuloSecurityException,
                         org.apache.accumulo.core.client.AccumuloException,
                         org.apache.accumulo.core.client.TableNotFoundException

Throws:

org.apache.accumulo.core.client.TableExistsException

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.TableNotFoundException

AccumuloBlobStore

public AccumuloBlobStore(org.apache.accumulo.core.client.Connector connector,
                 String tableName,
                 StoreConfig config)
                  throws org.apache.accumulo.core.client.TableExistsException,
                         org.apache.accumulo.core.client.AccumuloSecurityException,
                         org.apache.accumulo.core.client.AccumuloException,
                         org.apache.accumulo.core.client.TableNotFoundException

Throws:

org.apache.accumulo.core.client.TableExistsException

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.TableNotFoundException

AccumuloBlobStore

public AccumuloBlobStore(org.apache.accumulo.core.client.Connector connector,
                 int bufferSize)
                  throws org.apache.accumulo.core.client.TableExistsException,
                         org.apache.accumulo.core.client.AccumuloSecurityException,
                         org.apache.accumulo.core.client.AccumuloException,
                         org.apache.accumulo.core.client.TableNotFoundException

Throws:

org.apache.accumulo.core.client.TableExistsException

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.TableNotFoundException

AccumuloBlobStore

public AccumuloBlobStore(org.apache.accumulo.core.client.Connector connector,
                 String tableName,
                 StoreConfig config,
                 int bufferSize)
                  throws org.apache.accumulo.core.client.TableExistsException,
                         org.apache.accumulo.core.client.AccumuloSecurityException,
                         org.apache.accumulo.core.client.AccumuloException,
                         org.apache.accumulo.core.client.TableNotFoundException

Throws:

org.apache.accumulo.core.client.TableExistsException

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.TableNotFoundException

Method Detail

configureTable

protected void configureTable(org.apache.accumulo.core.client.Connector connector,
                  String tableName)
                       throws org.apache.accumulo.core.client.AccumuloSecurityException,
                              org.apache.accumulo.core.client.AccumuloException,
                              org.apache.accumulo.core.client.TableNotFoundException

Utility method to update the correct iterators to the table.

Parameters:

connector -

Throws:

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.TableNotFoundException

getWriter

protected org.apache.accumulo.core.client.BatchWriter getWriter()
                                                         throws org.apache.accumulo.core.client.TableNotFoundException

Returns a new batch writer for the table.

Returns:

Throws:

org.apache.accumulo.core.client.TableNotFoundException

generateRowId

protected static String generateRowId(String key,
                   String type)

Helper method to generate the rowID for the data mutations.

Parameters:

key -

type -

Returns:

generateMutation

protected org.apache.accumulo.core.data.Mutation generateMutation(String key,
                                                      String type,
                                                      byte[] data,
                                                      int sequenceNum,
                                                      long timestamp,
                                                      org.apache.accumulo.core.security.ColumnVisibility visibility)
                                                           throws org.calrissian.mango.types.exception.TypeEncodingException

Helper method to generate a mutation for each chunk of data that is being stored.

Parameters:

key -

type -

data -

sequenceNum -

timestamp -

visibility -

Returns:

Throws:

org.calrissian.mango.types.exception.TypeEncodingException

generateWriteStream

protected OutputStream generateWriteStream(org.apache.accumulo.core.client.BatchWriter writer,
                               String key,
                               String type,
                               long timestamp,
                               String visibility)

Helper method to generate an OutputStream for storing data into Accumulo.

Parameters:

writer -

key -

type -

timestamp -

visibility -

Returns:

store

public OutputStream store(String key,
                 String type,
                 long timestamp,
                 String visibility)

Provides an OutputStream to allow storage of the data into the store.

Specified by:

store in interface BlobStore

get

public InputStream get(String key,
              String type,
              Auths auths)

Provides an InputStream to retrieve the data from the store.

Specified by:

get in interface BlobStore