alluxio.master

Class AbstractLocalAlluxioCluster

java.lang.Object

alluxio.master.AbstractLocalAlluxioCluster

Direct Known Subclasses:

LocalAlluxioCluster, MultiMasterLocalAlluxioCluster

@NotThreadSafe
public abstract class AbstractLocalAlluxioCluster
extends Object

Local Alluxio cluster.

Field Summary

Fields

Modifier and Type	Field and Description
protected static org.slf4j.Logger	LOG
protected String	mHome
protected String	mHostname
protected Configuration	mMasterConf
protected UnderFileSystemCluster	mUfsCluster
protected int	mUserBlockSize
protected AlluxioWorker	mWorker
protected long	mWorkerCapacityBytes
protected Configuration	mWorkerConf
protected Thread	mWorkerThread

Constructor Summary

Constructors

Constructor and Description
AbstractLocalAlluxioCluster(long workerCapacityBytes, int userBlockSize)

Method Summary

Methods

Modifier and Type	Method and Description
abstract FileSystem	getClient() Returns a FileSystem client.
protected abstract LocalAlluxioMaster	getMaster() Gets the master which should be listening for RPC and Web requests.
Configuration	getMasterConf()
Configuration	newTestConf() Creates a default Configuration for testing.
protected void	resetContext() Resets contexts.
protected void	runWorker() Runs a worker.
protected void	setAlluxioHome() Sets alluxio home.
protected void	setHostname() Sets hostname.
protected void	setupTest(Configuration conf) Sets up corresponding directories for tests.
void	start() Starts both a master and a worker using the default test configurations.
void	start(Configuration conf) Starts both master and a worker using the configurations in test conf respectively.
protected abstract void	startMaster(Configuration conf) Configures and starts a master.
protected abstract void	startWorker(Configuration conf) Configures and starts a worker.
void	stop() Stops both the alluxio and underfs service threads.
abstract void	stopTFS() Stops the alluxio filesystem's service thread only.
protected void	stopUFS() Cleans up the underfs cluster test folder only.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

protected static final org.slf4j.Logger LOG

mWorkerCapacityBytes

protected long mWorkerCapacityBytes

mUserBlockSize

protected int mUserBlockSize

mMasterConf

protected Configuration mMasterConf

mWorkerConf

protected Configuration mWorkerConf

mWorker

protected AlluxioWorker mWorker

mUfsCluster

protected UnderFileSystemCluster mUfsCluster

mHome

protected String mHome

mHostname

protected String mHostname

mWorkerThread

protected Thread mWorkerThread

Constructor Detail

AbstractLocalAlluxioCluster

public AbstractLocalAlluxioCluster(long workerCapacityBytes,
                           int userBlockSize)

Parameters:

workerCapacityBytes - the capacity of the worker in bytes

userBlockSize - the block size for a user

Method Detail

start

public void start()
           throws IOException,
                  ConnectionFailedException

Starts both a master and a worker using the default test configurations.

Throws:

IOException - if an I/O error occurs

ConnectionFailedException - if network connection failed

start

public void start(Configuration conf)
           throws IOException,
                  ConnectionFailedException

Starts both master and a worker using the configurations in test conf respectively.

Parameters:

conf - the configuration for Alluxio

Throws:

IOException - if an I/O error occurs

ConnectionFailedException - if network connection failed

startMaster

protected abstract void startMaster(Configuration conf)
                             throws IOException

Configures and starts a master.

Parameters:

conf - configuration of this test

Throws:

IOException - when the operation fails

startWorker

protected abstract void startWorker(Configuration conf)
                             throws IOException,
                                    ConnectionFailedException

Configures and starts a worker.

Parameters:

conf - configuration of this test

Throws:

IOException - if an I/O error occurs

ConnectionFailedException - if network connection failed

setupTest

protected void setupTest(Configuration conf)
                  throws IOException

Sets up corresponding directories for tests.

Parameters:

conf - configuration of this test

Throws:

IOException - when creating or deleting dirs failed

stop

public void stop()
          throws Exception

Stops both the alluxio and underfs service threads.

Throws:

Exception - when the operation fails

stopTFS

public abstract void stopTFS()
                      throws Exception

Stops the alluxio filesystem's service thread only.

Throws:

Exception - when the operation fails

stopUFS

protected void stopUFS()
                throws Exception

Cleans up the underfs cluster test folder only.

Throws:

Exception - when the operation fails

newTestConf

public Configuration newTestConf()
                          throws IOException

Creates a default Configuration for testing.

Returns:

a test configuration

Throws:

IOException - when the operation fails

runWorker

protected void runWorker()
                  throws IOException,
                         ConnectionFailedException

Runs a worker.

Throws:

IOException - if an I/O error occurs

ConnectionFailedException - if network connection failed

getClient

public abstract FileSystem getClient()
                              throws IOException

Returns a FileSystem client.

Returns:

a FileSystem client

Throws:

IOException - when the operation fails

getMaster

protected abstract LocalAlluxioMaster getMaster()

Gets the master which should be listening for RPC and Web requests.

getMasterConf

public Configuration getMasterConf()

Returns:

the master's Configuration

resetContext

protected void resetContext()

Resets contexts. This is called when the cluster is stopped.

setHostname

protected void setHostname()

Sets hostname.

setAlluxioHome

protected void setAlluxioHome()
                       throws IOException

Sets alluxio home.

Throws:

IOException - when the operation fails