org.calrissian.accumulorecipes.blobstore.ext.impl

Class ExtendedAccumuloBlobStore

java.lang.Object

org.calrissian.accumulorecipes.blobstore.impl.AccumuloBlobStore

org.calrissian.accumulorecipes.blobstore.ext.impl.ExtendedAccumuloBlobStore

All Implemented Interfaces:

BlobStore, ExtendedBlobStore

Direct Known Subclasses:

HighSpeedIngestBlobStore

public class ExtendedAccumuloBlobStore
extends AccumuloBlobStore
implements ExtendedBlobStore

This implementation is an extension of the AccumuloBlobStore which stores additional data including the storage size (in bytes) and the properties for the data.

Data Row format is as follows:

RowId: keytype Column Family: DATA Column Qualifier: sequence# Value: byte[]

Row format is as follows:

RowId: keytype Column Family: SIZE Column Qualifier: Value: chunksize

Property format is as follows:

RowId: keytype Column Family: PROP Column Qualifier: propKeypropValue Value:

Field Summary

Fields inherited from class org.calrissian.accumulorecipes.blobstore.impl.AccumuloBlobStore

connector, tableName

Constructor Summary

Constructors

Constructor and Description
ExtendedAccumuloBlobStore(org.apache.accumulo.core.client.Connector connector)
ExtendedAccumuloBlobStore(org.apache.accumulo.core.client.Connector connector, int bufferSize)
ExtendedAccumuloBlobStore(org.apache.accumulo.core.client.Connector connector, String tableName, StoreConfig config)
ExtendedAccumuloBlobStore(org.apache.accumulo.core.client.Connector connector, String tableName, StoreConfig config, int bufferSize)

Method Summary

Methods

Modifier and Type	Method and Description
int	blobSize(String key, String type, Auths auths) Returns the size of the data stored with the given key and type.
protected void	configureTable(org.apache.accumulo.core.client.Connector connector, String tableName) Utility method to update the correct iterators to the table.
protected org.apache.accumulo.core.data.Mutation	generateMutation(String key, String type, byte[] data, int sequenceNum, long timestamp, org.apache.accumulo.core.security.ColumnVisibility visibility) Helper method to generate a mutation for each chunk of data that is being stored.
Map<String,String>	getProperties(String key, String type, Auths auths) Returns the properties stored with the data for the given key and type.
OutputStream	store(String key, String type, Map<String,String> properties, long timestamp, String visibility) Provides an OutputStream to allow storage of the data into the store along with some properties.

Methods inherited from class org.calrissian.accumulorecipes.blobstore.impl.AccumuloBlobStore

generateRowId, generateWriteStream, get, getWriter, store

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.calrissian.accumulorecipes.blobstore.BlobStore

get, store

Constructor Detail

ExtendedAccumuloBlobStore

public ExtendedAccumuloBlobStore(org.apache.accumulo.core.client.Connector connector)
                          throws org.apache.accumulo.core.client.TableExistsException,
                                 org.apache.accumulo.core.client.AccumuloSecurityException,
                                 org.apache.accumulo.core.client.AccumuloException,
                                 org.apache.accumulo.core.client.TableNotFoundException

Throws:

org.apache.accumulo.core.client.TableExistsException

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.TableNotFoundException

ExtendedAccumuloBlobStore

public ExtendedAccumuloBlobStore(org.apache.accumulo.core.client.Connector connector,
                         String tableName,
                         StoreConfig config)
                          throws org.apache.accumulo.core.client.TableExistsException,
                                 org.apache.accumulo.core.client.AccumuloSecurityException,
                                 org.apache.accumulo.core.client.AccumuloException,
                                 org.apache.accumulo.core.client.TableNotFoundException

Throws:

org.apache.accumulo.core.client.TableExistsException

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.TableNotFoundException

ExtendedAccumuloBlobStore

public ExtendedAccumuloBlobStore(org.apache.accumulo.core.client.Connector connector,
                         int bufferSize)
                          throws org.apache.accumulo.core.client.TableExistsException,
                                 org.apache.accumulo.core.client.AccumuloSecurityException,
                                 org.apache.accumulo.core.client.AccumuloException,
                                 org.apache.accumulo.core.client.TableNotFoundException

Throws:

org.apache.accumulo.core.client.TableExistsException

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.TableNotFoundException

ExtendedAccumuloBlobStore

public ExtendedAccumuloBlobStore(org.apache.accumulo.core.client.Connector connector,
                         String tableName,
                         StoreConfig config,
                         int bufferSize)
                          throws org.apache.accumulo.core.client.TableExistsException,
                                 org.apache.accumulo.core.client.AccumuloSecurityException,
                                 org.apache.accumulo.core.client.AccumuloException,
                                 org.apache.accumulo.core.client.TableNotFoundException

Throws:

org.apache.accumulo.core.client.TableExistsException

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.TableNotFoundException

Method Detail

configureTable

protected void configureTable(org.apache.accumulo.core.client.Connector connector,
                  String tableName)
                       throws org.apache.accumulo.core.client.AccumuloSecurityException,
                              org.apache.accumulo.core.client.AccumuloException,
                              org.apache.accumulo.core.client.TableNotFoundException

Utility method to update the correct iterators to the table.

Overrides:

configureTable in class AccumuloBlobStore

Throws:

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.TableNotFoundException

generateMutation

protected org.apache.accumulo.core.data.Mutation generateMutation(String key,
                                                      String type,
                                                      byte[] data,
                                                      int sequenceNum,
                                                      long timestamp,
                                                      org.apache.accumulo.core.security.ColumnVisibility visibility)

Helper method to generate a mutation for each chunk of data that is being stored.

Overrides:

generateMutation in class AccumuloBlobStore

Returns:

blobSize

public int blobSize(String key,
           String type,
           Auths auths)

Returns the size of the data stored with the given key and type.

Specified by:

blobSize in interface ExtendedBlobStore

Returns:

getProperties

public Map<String,String> getProperties(String key,
                               String type,
                               Auths auths)

Returns the properties stored with the data for the given key and type.

Specified by:

getProperties in interface ExtendedBlobStore

Returns:

store

public OutputStream store(String key,
                 String type,
                 Map<String,String> properties,
                 long timestamp,
                 String visibility)

Provides an OutputStream to allow storage of the data into the store along with some properties.

Specified by:

store in interface ExtendedBlobStore

Returns: