alluxio.multi.process

Class MultiProcessCluster

java.lang.Object

alluxio.multi.process.MultiProcessCluster

All Implemented Interfaces:

org.junit.rules.TestRule

@ThreadSafe
public final class MultiProcessCluster
extends java.lang.Object
implements org.junit.rules.TestRule

Class for starting, stopping, and interacting with an Alluxio cluster where each master and worker runs in its own process. Compared to LocalAlluxioCluster, MultiProcessCluster is - Slower - Black box testing only (No access to master/worker internals) - Destructible (You can kill -9 masters/workers) - More realistic of real deployments Due to the slower speed, [@link LocalAlluxioCluster} should generally be preferred. MultiProcessCluster is primarily for tests which want to stop or restart servers. The synchronization strategy for this class is to synchronize all public methods.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	MultiProcessCluster.Builder Builder for MultiProcessCluster.
static class	MultiProcessCluster.DeployMode Deploy mode for the cluster.

Method Summary

Modifier and Type	Method and Description
org.junit.runners.model.Statement	apply(org.junit.runners.model.Statement base, org.junit.runner.Description description)
void	destroy() Destroys the cluster.
void	formatJournal() Formats the cluster journal.
FileSystem	getFileSystemClient()
java.util.List<MasterNetAddress>	getMasterAddresses()
MasterInquireClient	getMasterInquireClient()
MetaMasterClient	getMetaMasterClient()
static MultiProcessCluster.Builder	newBuilder()
void	notifySuccess() Informs the cluster that the test succeeded.
void	restartZk() Restarts the Zookeeper cluster.
void	saveWorkdir() Copies the work directory to the artifacts folder.
void	start() Starts the cluster, launching all server processes.
void	startMaster(int i) Starts the specified master.
void	startMasters() Starts all masters.
void	startWorker(int i) Starts the specified worker.
void	stopMaster(int i)
void	stopMasters() Stops all masters.
void	stopWorker(int i)
void	stopZk() Stops the Zookeeper cluster.
void	updateDeployMode(MultiProcessCluster.DeployMode mode) Updates the cluster's deploy mode.
void	updateMasterConf(PropertyKey key, java.lang.String value) Updates master configuration for all masters.
void	waitForAllNodesRegistered(int timeoutMs) Waits for the number of live nodes in server configuration store reached the number of nodes in this cluster and gets meta master client.
int	waitForAndKillPrimaryMaster(int timeoutMs) Kills the primary master.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

start

public void start()
           throws java.lang.Exception

Starts the cluster, launching all server processes.

Throws:

java.lang.Exception

waitForAndKillPrimaryMaster

public int waitForAndKillPrimaryMaster(int timeoutMs)

Kills the primary master. If no master is currently primary, this method blocks until a primary has been elected, then kills it.

Parameters:

timeoutMs - maximum amount of time to wait, in milliseconds

Returns:

the ID of the killed master

waitForAllNodesRegistered

public void waitForAllNodesRegistered(int timeoutMs)

Waits for the number of live nodes in server configuration store reached the number of nodes in this cluster and gets meta master client.

Parameters:

timeoutMs - maximum amount of time to wait, in milliseconds

getFileSystemClient

public FileSystem getFileSystemClient()

Returns:

a client for interacting with the cluster

getMetaMasterClient

public MetaMasterClient getMetaMasterClient()

Returns:

a meta master client

notifySuccess

public void notifySuccess()

Informs the cluster that the test succeeded. If this method is never called, the cluster will save a copy of its state during teardown.

saveWorkdir

public void saveWorkdir()
                 throws java.io.IOException

Copies the work directory to the artifacts folder.

Throws:

java.io.IOException

destroy

public void destroy()
             throws java.io.IOException

Destroys the cluster. It may not be re-started after being destroyed.

Throws:

java.io.IOException

startMasters

public void startMasters()

Starts all masters.

startMaster

public void startMaster(int i)
                 throws java.io.IOException

Starts the specified master.

Parameters:

i - the index of the master to start

Throws:

java.io.IOException

startWorker

public void startWorker(int i)
                 throws java.io.IOException

Starts the specified worker.

Parameters:

i - the index of the worker to start

Throws:

java.io.IOException

stopMasters

public void stopMasters()

Stops all masters.

stopMaster

public void stopMaster(int i)
                throws java.io.IOException

Parameters:

i - the index of the master to stop

Throws:

java.io.IOException

updateMasterConf

public void updateMasterConf(PropertyKey key,
                             @Nullable
                             java.lang.String value)

Updates master configuration for all masters. This will take effect on a master the next time the master is started.

Parameters:

key - the key to update

value - the value to set, or null to unset the key

updateDeployMode

public void updateDeployMode(MultiProcessCluster.DeployMode mode)

Updates the cluster's deploy mode.

Parameters:

mode - the mode to set

stopWorker

public void stopWorker(int i)
                throws java.io.IOException

Parameters:

i - the index of the worker to stop

Throws:

java.io.IOException

getMasterAddresses

public java.util.List<MasterNetAddress> getMasterAddresses()

Returns:

return the list of master addresses

stopZk

public void stopZk()
            throws java.io.IOException

Stops the Zookeeper cluster.

Throws:

java.io.IOException

restartZk

public void restartZk()
               throws java.lang.Exception

Restarts the Zookeeper cluster.

Throws:

java.lang.Exception

formatJournal

public void formatJournal()
                   throws java.io.IOException

Formats the cluster journal.

Throws:

java.io.IOException

getMasterInquireClient

public MasterInquireClient getMasterInquireClient()

Returns:

a client for determining the serving master

apply

public org.junit.runners.model.Statement apply(org.junit.runners.model.Statement base,
                                               org.junit.runner.Description description)

Specified by:

apply in interface org.junit.rules.TestRule

newBuilder

public static MultiProcessCluster.Builder newBuilder()

Returns:

a new builder for an MultiProcessCluster