org.calrissian.mango.accumulo.pool

Class ThreadPoolConnector

java.lang.Object

org.apache.accumulo.core.client.Connector

org.calrissian.mango.accumulo.pool.ThreadPoolConnector

public class ThreadPoolConnector
extends org.apache.accumulo.core.client.Connector

Return BatchScanners and writers based on the number of max threads available. After a limit is hit, return only Scanners and writers with 1 thread.

TODO: Implement pooling with the BatchWriter

Constructor Summary

Constructors

Constructor and Description
ThreadPoolConnector(org.apache.accumulo.core.client.Connector wrapped, int maxThreads)

Method Summary

Methods

Modifier and Type	Method and Description
protected int	allocateNumThreads(int numQueryThreads) Allocate the number of threads from the pool.
org.apache.accumulo.core.client.BatchDeleter	createBatchDeleter(String tableName, org.apache.accumulo.core.security.Authorizations authorizations, int numQueryThreads, long maxMemory, long maxLatency, int maxWriteThreads)
org.apache.accumulo.core.client.BatchScanner	createBatchScanner(String tableName, org.apache.accumulo.core.security.Authorizations authorizations, int numQueryThreads) On creation of a batchscanner, if there are > 0 threads available in the pool, return a BatchScanner.
org.apache.accumulo.core.client.BatchWriter	createBatchWriter(String tableName, long maxMemory, long maxLatency, int maxWriteThreads)
org.apache.accumulo.core.client.MultiTableBatchWriter	createMultiTableBatchWriter(long maxMemory, long maxLatency, int maxWriteThreads)
org.apache.accumulo.core.client.Scanner	createScanner(String tableName, org.apache.accumulo.core.security.Authorizations authorizations)
org.apache.accumulo.core.client.Instance	getInstance()
int	getMaxThreads() Get the maximum number of threads allowed
int	getNumAvailable() Get the number of threads left in the pool
int	getUsedThreads() Get the current number of threads being used
org.apache.accumulo.core.client.admin.InstanceOperations	instanceOperations()
protected void	releaseResources(ThreadedResource tr) Release the number of threads.
org.apache.accumulo.core.client.admin.SecurityOperations	securityOperations()
org.apache.accumulo.core.client.admin.TableOperations	tableOperations()
String	whoami()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ThreadPoolConnector

public ThreadPoolConnector(org.apache.accumulo.core.client.Connector wrapped,
                   int maxThreads)

Parameters:

wrapped - Accumulo Connector to wrap

maxThreads - Maximum Threads allowed to create. Must be > 0

Method Detail

allocateNumThreads

protected int allocateNumThreads(int numQueryThreads)

Allocate the number of threads from the pool. If none are available, return 0. Otherwise return the maximum allowed, up to the numQueryThreads supplied.

Parameters:

numQueryThreads - Number of threads to allocate. Must be > 0

Returns:

Allocated amount of threads

releaseResources

protected void releaseResources(ThreadedResource tr)

Release the number of threads.

Parameters:

tr - The threaded resource to release

createBatchScanner

public org.apache.accumulo.core.client.BatchScanner createBatchScanner(String tableName,
                                                              org.apache.accumulo.core.security.Authorizations authorizations,
                                                              int numQueryThreads)
                                                                throws org.apache.accumulo.core.client.TableNotFoundException

On creation of a batchscanner, if there are > 0 threads available in the pool, return a BatchScanner. Otherwise, return the BatchScannerWithScanners, a BatchScanner backed by Scanners.

Overrides:

createBatchScanner in class org.apache.accumulo.core.client.Connector

Throws:

org.apache.accumulo.core.client.TableNotFoundException

createBatchDeleter

public org.apache.accumulo.core.client.BatchDeleter createBatchDeleter(String tableName,
                                                              org.apache.accumulo.core.security.Authorizations authorizations,
                                                              int numQueryThreads,
                                                              long maxMemory,
                                                              long maxLatency,
                                                              int maxWriteThreads)
                                                                throws org.apache.accumulo.core.client.TableNotFoundException

Overrides:

createBatchDeleter in class org.apache.accumulo.core.client.Connector

Throws:

org.apache.accumulo.core.client.TableNotFoundException

createBatchWriter

public org.apache.accumulo.core.client.BatchWriter createBatchWriter(String tableName,
                                                            long maxMemory,
                                                            long maxLatency,
                                                            int maxWriteThreads)
                                                              throws org.apache.accumulo.core.client.TableNotFoundException

Overrides:

createBatchWriter in class org.apache.accumulo.core.client.Connector

Throws:

org.apache.accumulo.core.client.TableNotFoundException

createMultiTableBatchWriter

public org.apache.accumulo.core.client.MultiTableBatchWriter createMultiTableBatchWriter(long maxMemory,
                                                                                long maxLatency,
                                                                                int maxWriteThreads)

Overrides:

createMultiTableBatchWriter in class org.apache.accumulo.core.client.Connector

createScanner

public org.apache.accumulo.core.client.Scanner createScanner(String tableName,
                                                    org.apache.accumulo.core.security.Authorizations authorizations)
                                                      throws org.apache.accumulo.core.client.TableNotFoundException

Overrides:

createScanner in class org.apache.accumulo.core.client.Connector

Throws:

org.apache.accumulo.core.client.TableNotFoundException

getInstance

public org.apache.accumulo.core.client.Instance getInstance()

Overrides:

getInstance in class org.apache.accumulo.core.client.Connector

whoami

public String whoami()

Overrides:

whoami in class org.apache.accumulo.core.client.Connector

tableOperations

public org.apache.accumulo.core.client.admin.TableOperations tableOperations()

Overrides:

tableOperations in class org.apache.accumulo.core.client.Connector

securityOperations

public org.apache.accumulo.core.client.admin.SecurityOperations securityOperations()

Overrides:

securityOperations in class org.apache.accumulo.core.client.Connector

instanceOperations

public org.apache.accumulo.core.client.admin.InstanceOperations instanceOperations()

Overrides:

instanceOperations in class org.apache.accumulo.core.client.Connector

getMaxThreads

public int getMaxThreads()

Get the maximum number of threads allowed

Returns:

getUsedThreads

public int getUsedThreads()

Get the current number of threads being used

Returns:

getNumAvailable

public int getNumAvailable()

Get the number of threads left in the pool

Returns: