ai.grakn.engine.loader.client

Class LoaderClient

java.lang.Object

ai.grakn.engine.loader.client.LoaderClient

All Implemented Interfaces:

Loader

public class LoaderClient
extends Object
implements Loader

Constructor Summary

Constructors

Constructor and Description
LoaderClient(String keyspace, Collection<String> hosts)

Method Summary

Modifier and Type	Method and Description
void	add(InsertQuery query) Add an insert query to the queue
void	checkForStatusLoop() Loop checking the status of the hosts every 30 seconds.
void	flush() Load any remaining batches in the queue.
int	getBatchSize()
void	printLoaderState() Method that logs the current state of loading transactions
void	printLoaderState(int created, int scheduled, int completed, int running, int failed, int stopped) Method that logs the current state of loading transactions
void	sendQueriesToLoader(Collection<InsertQuery> queries)
Loader	setBatchSize(int size) Set the size of the each transaction in terms of number of vars.
void	setPollingFrequency(long number) Amount of time to wait before checking number completed jobs with slaves
Loader	setQueueSize(int size) Set the size of the queue- this is equivalent to the size of the semaphore.
void	waitToFinish() Block the main thread until all of the transactions have finished loading
void	waitToFinish(int time) Wait for all tasks to finish.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LoaderClient

public LoaderClient(String keyspace,
                    Collection<String> hosts)

Method Detail

getBatchSize

public int getBatchSize()

Specified by:

getBatchSize in interface Loader

Returns:

the current batch size - minimum number of vars to be loaded in a transaction

setBatchSize

public Loader setBatchSize(int size)

Set the size of the each transaction in terms of number of vars.

Specified by:

setBatchSize in interface Loader

Parameters:

size - number of vars in each transaction

setQueueSize

public Loader setQueueSize(int size)

Set the size of the queue- this is equivalent to the size of the semaphore.

Specified by:

setQueueSize in interface Loader

Parameters:

size - the size of the queue

add

public void add(InsertQuery query)

Add an insert query to the queue

Specified by:

add in interface Loader

Parameters:

query - insert query to be executed

setPollingFrequency

public void setPollingFrequency(long number)

Amount of time to wait before checking number completed jobs with slaves

flush

public void flush()

Load any remaining batches in the queue.

Specified by:

flush in interface Loader

waitToFinish

public void waitToFinish()

Block the main thread until all of the transactions have finished loading

Specified by:

waitToFinish in interface Loader

waitToFinish

public void waitToFinish(int time)

Description copied from interface: Loader

Wait for all tasks to finish.

Specified by:

waitToFinish in interface Loader

Parameters:

time - amount of time (in ms) to wait.

sendQueriesToLoader

public void sendQueriesToLoader(Collection<InsertQuery> queries)

checkForStatusLoop

public void checkForStatusLoop()

Loop checking the status of the hosts every 30 seconds. This method updates the semaphore availability.

printLoaderState

public void printLoaderState()

Method that logs the current state of loading transactions

Specified by:

printLoaderState in interface Loader

printLoaderState

public void printLoaderState(int created,
                             int scheduled,
                             int completed,
                             int running,
                             int failed,
                             int stopped)

Method that logs the current state of loading transactions