org.calrissian.accumlorecipes.changelog.impl

Class AccumuloChangelogStore

java.lang.Object

org.calrissian.accumlorecipes.changelog.impl.AccumuloChangelogStore

All Implemented Interfaces:

ChangelogStore

public class AccumuloChangelogStore
extends Object
implements ChangelogStore

An Accumulo implementation of a bucketed merkle tree-based changelog store providing tools to keep data consistent between different connected multicloud environments.

Constructor Summary

Constructors

Constructor and Description
AccumuloChangelogStore(org.apache.accumulo.core.client.Connector connector)
AccumuloChangelogStore(org.apache.accumulo.core.client.Connector connector, BucketSize bucketSize)
AccumuloChangelogStore(org.apache.accumulo.core.client.Connector connector, String tableName, StoreConfig config)
AccumuloChangelogStore(org.apache.accumulo.core.client.Connector connector, String tableName, StoreConfig config, BucketSize bucketSize)

Method Summary

Methods

Modifier and Type	Method and Description
protected void	configureTable(org.apache.accumulo.core.client.Connector connector, String tableName) Utility method to update the correct iterators to the table.
void	flush()
org.calrissian.mango.collect.CloseableIterable<org.calrissian.mango.domain.event.Event>	getChanges(Iterable<Date> buckets, Auths auths) Gets the actual change objects that live inside of the specified buckets
org.calrissian.mango.hash.tree.MerkleTree	getChangeTree(Date start, Date stop, Auths auths) Get a Merkle tree containing hashes of each of the buckets
org.calrissian.mango.hash.tree.MerkleTree	getChangeTree(Date start, Date stop, int dimensions, Auths auths) Get a Merkle tree containing hashes of each of the buckets with the given dimensions
void	put(Iterable<org.calrissian.mango.domain.event.Event> changes) Puts a set of changes into buckets of the store.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AccumuloChangelogStore

public AccumuloChangelogStore(org.apache.accumulo.core.client.Connector connector)
                       throws org.apache.accumulo.core.client.AccumuloException,
                              org.apache.accumulo.core.client.AccumuloSecurityException,
                              org.apache.accumulo.core.client.TableNotFoundException,
                              org.apache.accumulo.core.client.TableExistsException

Throws:

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.TableNotFoundException

org.apache.accumulo.core.client.TableExistsException

AccumuloChangelogStore

public AccumuloChangelogStore(org.apache.accumulo.core.client.Connector connector,
                      String tableName,
                      StoreConfig config)
                       throws org.apache.accumulo.core.client.AccumuloException,
                              org.apache.accumulo.core.client.AccumuloSecurityException,
                              org.apache.accumulo.core.client.TableNotFoundException,
                              org.apache.accumulo.core.client.TableExistsException

Throws:

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.TableNotFoundException

org.apache.accumulo.core.client.TableExistsException

AccumuloChangelogStore

public AccumuloChangelogStore(org.apache.accumulo.core.client.Connector connector,
                      BucketSize bucketSize)
                       throws org.apache.accumulo.core.client.AccumuloException,
                              org.apache.accumulo.core.client.AccumuloSecurityException,
                              org.apache.accumulo.core.client.TableNotFoundException,
                              org.apache.accumulo.core.client.TableExistsException

Throws:

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.TableNotFoundException

org.apache.accumulo.core.client.TableExistsException

AccumuloChangelogStore

public AccumuloChangelogStore(org.apache.accumulo.core.client.Connector connector,
                      String tableName,
                      StoreConfig config,
                      BucketSize bucketSize)
                       throws org.apache.accumulo.core.client.TableExistsException,
                              org.apache.accumulo.core.client.AccumuloSecurityException,
                              org.apache.accumulo.core.client.AccumuloException,
                              org.apache.accumulo.core.client.TableNotFoundException

Throws:

org.apache.accumulo.core.client.TableExistsException

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.TableNotFoundException

Method Detail

configureTable

protected void configureTable(org.apache.accumulo.core.client.Connector connector,
                  String tableName)
                       throws org.apache.accumulo.core.client.AccumuloSecurityException,
                              org.apache.accumulo.core.client.AccumuloException,
                              org.apache.accumulo.core.client.TableNotFoundException

Utility method to update the correct iterators to the table.

Parameters:

connector -

Throws:

org.apache.accumulo.core.client.AccumuloSecurityException

org.apache.accumulo.core.client.AccumuloException

org.apache.accumulo.core.client.TableNotFoundException

put

public void put(Iterable<org.calrissian.mango.domain.event.Event> changes)

Puts a set of changes into buckets of the store.

Specified by:

put in interface ChangelogStore

Parameters:

changes -

flush

public void flush()
           throws Exception

Specified by:

flush in interface ChangelogStore

Throws:

Exception

getChangeTree

public org.calrissian.mango.hash.tree.MerkleTree getChangeTree(Date start,
                                                      Date stop,
                                                      Auths auths)

Description copied from interface: ChangelogStore

Get a Merkle tree containing hashes of each of the buckets

Specified by:

getChangeTree in interface ChangelogStore

Returns:

getChangeTree

public org.calrissian.mango.hash.tree.MerkleTree getChangeTree(Date start,
                                                      Date stop,
                                                      int dimensions,
                                                      Auths auths)

Get a Merkle tree containing hashes of each of the buckets with the given dimensions

Specified by:

getChangeTree in interface ChangelogStore

Returns:

getChanges

public org.calrissian.mango.collect.CloseableIterable<org.calrissian.mango.domain.event.Event> getChanges(Iterable<Date> buckets,
                                                                                                 Auths auths)

Gets the actual change objects that live inside of the specified buckets

Specified by:

getChanges in interface ChangelogStore

Parameters:

buckets - dates representing time increments (i.e. 15 minutes)

Returns: