alluxio.stress

Class CachingBlockMasterClient

java.lang.Object

alluxio.AbstractClient

alluxio.AbstractMasterClient

alluxio.worker.block.BlockMasterClient

alluxio.stress.CachingBlockMasterClient

All Implemented Interfaces:

Client, java.io.Closeable, java.lang.AutoCloseable

public class CachingBlockMasterClient
extends BlockMasterClient

Use this class to avoid the map-list conversion at the client side. This reduces the client side work so the time measurement for the whole RPC better reflects the time taken at the master side. Also reducing the workload on the client side will avoid the test becoming CPU-bound on the client side, when the concurrency is high.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CachingBlockMasterClient.CachingBlockMapIterator Pre-generate the list so the RPC execution time does not include the conversion time.

Nested classes/interfaces inherited from class alluxio.AbstractClient

AbstractClient.RpcCallable<V>

Field Summary

Fields

Modifier and Type	Field and Description
CachingBlockMasterClient.CachingBlockMapIterator	mBlockBatchIterator

Fields inherited from class alluxio.worker.block.BlockMasterClient

mAsyncClient, mClient

Fields inherited from class alluxio.AbstractClient

mAddress, mChannel, mClosed, mConnected, mContext, mServiceVersion, mVersionService

Constructor Summary

Constructors

Constructor and Description
CachingBlockMasterClient(MasterClientContext conf, java.util.List<LocationBlockIdListEntry> locationBlockIdList) Creates a new instance and caches the converted proto.
CachingBlockMasterClient(MasterClientContext conf, java.util.Map<BlockStoreLocation,java.util.List<java.lang.Long>> blockMap) Creates a new instance and caches the converted proto.

Method Summary

Modifier and Type	Method and Description
java.util.List<LocationBlockIdListEntry>	convertBlockListMapToProto(java.util.Map<BlockStoreLocation,java.util.List<java.lang.Long>> blockListOnLocation)
void	registerWithStream(long workerId, java.util.List<java.lang.String> storageTierAliases, java.util.Map<java.lang.String,java.lang.Long> totalBytesOnTiers, java.util.Map<java.lang.String,java.lang.Long> usedBytesOnTiers, java.util.Map<BlockStoreLocation,java.util.List<java.lang.Long>> currentBlocksOnLocation, java.util.Map<java.lang.String,java.util.List<java.lang.String>> lostStorage, java.util.List<ConfigProperty> configList)

Methods inherited from class alluxio.worker.block.BlockMasterClient

acquireRegisterLeaseWithBackoff, afterConnect, commitBlock, commitBlockInUfs, getId, getRemoteServiceType, getServiceName, getServiceVersion, heartbeat, register

Methods inherited from class alluxio.AbstractMasterClient

getAddress, getConfAddress

Methods inherited from class alluxio.AbstractClient

afterDisconnect, beforeConnect, beforeDisconnect, checkVersion, close, connect, disconnect, getRemoteServiceVersion, isClosed, isConnected, retryRPC, retryRPC

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

mBlockBatchIterator

public CachingBlockMasterClient.CachingBlockMapIterator mBlockBatchIterator

Constructor Detail

CachingBlockMasterClient

public CachingBlockMasterClient(MasterClientContext conf,
                                java.util.List<LocationBlockIdListEntry> locationBlockIdList)

Creates a new instance and caches the converted proto.

Parameters:

conf - master client configuration

locationBlockIdList - location block id list

CachingBlockMasterClient

public CachingBlockMasterClient(MasterClientContext conf,
                                java.util.Map<BlockStoreLocation,java.util.List<java.lang.Long>> blockMap)

Creates a new instance and caches the converted proto.

Parameters:

conf - master client configuration

blockMap - block lists of each location

Method Detail

convertBlockListMapToProto

public java.util.List<LocationBlockIdListEntry> convertBlockListMapToProto(java.util.Map<BlockStoreLocation,java.util.List<java.lang.Long>> blockListOnLocation)

Overrides:

convertBlockListMapToProto in class BlockMasterClient

registerWithStream

public void registerWithStream(long workerId,
                               java.util.List<java.lang.String> storageTierAliases,
                               java.util.Map<java.lang.String,java.lang.Long> totalBytesOnTiers,
                               java.util.Map<java.lang.String,java.lang.Long> usedBytesOnTiers,
                               java.util.Map<BlockStoreLocation,java.util.List<java.lang.Long>> currentBlocksOnLocation,
                               java.util.Map<java.lang.String,java.util.List<java.lang.String>> lostStorage,
                               java.util.List<ConfigProperty> configList)
                        throws java.io.IOException

Overrides:

registerWithStream in class BlockMasterClient

Throws:

java.io.IOException