alluxio.master

Class MultiMasterEmbeddedJournalLocalAlluxioCluster

java.lang.Object

alluxio.master.AbstractLocalAlluxioCluster

alluxio.master.MultiMasterEmbeddedJournalLocalAlluxioCluster

@NotThreadSafe
public final class MultiMasterEmbeddedJournalLocalAlluxioCluster
extends AbstractLocalAlluxioCluster

A local Alluxio cluster with multiple masters using embedded journal. Because the cluster run in a single process, a single configuration instance is shared across masters and workers. If this causes issues, considering switching to MultiProcessCluster

Field Summary

Fields inherited from class alluxio.master.AbstractLocalAlluxioCluster

mHostname, mProxyProcess, mProxyThread, mWorkDirectory, mWorkers, mWorkerThreads

Constructor Summary

Constructors

Constructor and Description
MultiMasterEmbeddedJournalLocalAlluxioCluster(int numMasters, int numWorkers, java.util.List<PortCoordination.ReservedPort> reservedPorts)

Method Summary

Modifier and Type	Method and Description
protected void	formatJournal()
FileSystem	getClient() Returns a FileSystem client.
FileSystem	getClient(FileSystemContext context)
int	getLeaderIndex()
LocalAlluxioMaster	getLocalAlluxioMaster()
LocalAlluxioMaster	getLocalAlluxioMasterByIndex(int index)
java.util.List<java.net.InetSocketAddress>	getMasterAddresses()
WorkerProcess	getWorkerProcess(int index)
void	initConfiguration(java.lang.String name) Creates a default Configuration for testing.
protected void	startMasters() Configures and starts the master(s).
void	startWorkers() Configures and starts the worker(s).
void	stopFS() Stops the alluxio filesystem's service thread only.
boolean	stopLeader() Iterates over the masters in the order of master creation, stops the leader master.
void	stopMasters() Stops the masters.
boolean	stopStandby() Iterates over the masters in the order of master creation, stops the first standby master.
void	waitForPrimaryMasterServing(int timeoutMs) Waits for the primary master to start until a timeout occurs.

Methods inherited from class alluxio.master.AbstractLocalAlluxioCluster

formatAndRestartMasters, getProxyProcess, isStartedWorkers, killWorkerProcesses, reset, resetClientPools, restartMasters, restartWorkers, setAlluxioWorkDirectory, setHostname, setupTest, start, startProxy, stop, stopProxy, stopWorkers, waitForMasterServing, waitForWorkersRegistered

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MultiMasterEmbeddedJournalLocalAlluxioCluster

public MultiMasterEmbeddedJournalLocalAlluxioCluster(int numMasters,
                                                     int numWorkers,
                                                     java.util.List<PortCoordination.ReservedPort> reservedPorts)
                                              throws java.io.IOException

Parameters:

numMasters - the number of masters to run

numWorkers - the number of workers to run

reservedPorts - reserved ports

Throws:

java.io.IOException

Method Detail

initConfiguration

public void initConfiguration(java.lang.String name)
                       throws java.io.IOException

Description copied from class: AbstractLocalAlluxioCluster

Creates a default Configuration for testing.

Specified by:

initConfiguration in class AbstractLocalAlluxioCluster

Parameters:

name - the name of the test/cluster

Throws:

java.io.IOException

getClient

public FileSystem getClient()
                     throws java.io.IOException

Description copied from class: AbstractLocalAlluxioCluster

Returns a FileSystem client.

Specified by:

getClient in class AbstractLocalAlluxioCluster

Returns:

a FileSystem client

Throws:

java.io.IOException

getClient

public FileSystem getClient(FileSystemContext context)
                     throws java.io.IOException

Specified by:

getClient in class AbstractLocalAlluxioCluster

Parameters:

context - the FileSystemContext to use

Returns:

a FileSystem client, using a specific context

Throws:

java.io.IOException

getLocalAlluxioMaster

public LocalAlluxioMaster getLocalAlluxioMaster()

Specified by:

getLocalAlluxioMaster in class AbstractLocalAlluxioCluster

Returns:

the local Alluxio master

getLocalAlluxioMasterByIndex

public LocalAlluxioMaster getLocalAlluxioMasterByIndex(int index)

Parameters:

index - the index

Returns:

the local alluxio master

getWorkerProcess

public WorkerProcess getWorkerProcess(int index)

Parameters:

index - the index

Returns:

the worker process by index

getLeaderIndex

public int getLeaderIndex()

Returns:

index of leader master in mMasters, or -1 if there is no leader temporarily

getMasterAddresses

public java.util.List<java.net.InetSocketAddress> getMasterAddresses()

Returns:

the master addresses

stopStandby

public boolean stopStandby()

Iterates over the masters in the order of master creation, stops the first standby master.

Returns:

true if a standby master is successfully stopped, otherwise, false

stopLeader

public boolean stopLeader()

Iterates over the masters in the order of master creation, stops the leader master.

Returns:

true if the leader master is successfully stopped, false otherwise

waitForPrimaryMasterServing

public void waitForPrimaryMasterServing(int timeoutMs)
                                 throws java.util.concurrent.TimeoutException,
                                        java.lang.InterruptedException

Waits for the primary master to start until a timeout occurs.

Parameters:

timeoutMs - the number of milliseconds to wait before giving up and throwing an exception

Throws:

java.util.concurrent.TimeoutException

java.lang.InterruptedException

startMasters

protected void startMasters()
                     throws java.io.IOException

Description copied from class: AbstractLocalAlluxioCluster

Configures and starts the master(s).

Specified by:

startMasters in class AbstractLocalAlluxioCluster

Throws:

java.io.IOException

startWorkers

public void startWorkers()
                  throws java.lang.Exception

Description copied from class: AbstractLocalAlluxioCluster

Configures and starts the worker(s).

Overrides:

startWorkers in class AbstractLocalAlluxioCluster

Throws:

java.lang.Exception

stopFS

public void stopFS()
            throws java.lang.Exception

Description copied from class: AbstractLocalAlluxioCluster

Stops the alluxio filesystem's service thread only.

Overrides:

stopFS in class AbstractLocalAlluxioCluster

Throws:

java.lang.Exception

stopMasters

public void stopMasters()
                 throws java.lang.Exception

Description copied from class: AbstractLocalAlluxioCluster

Stops the masters.

Specified by:

stopMasters in class AbstractLocalAlluxioCluster

Throws:

java.lang.Exception

formatJournal

protected void formatJournal()

Overrides:

formatJournal in class AbstractLocalAlluxioCluster