org.apache.hadoop.hbase.favored

Class FavoredNodeAssignmentHelper

java.lang.Object

org.apache.hadoop.hbase.favored.FavoredNodeAssignmentHelper

@InterfaceAudience.Private
public class FavoredNodeAssignmentHelper
extends Object

Helper class for FavoredNodeLoadBalancer that has all the intelligence for racks, meta scans, etc. Instantiated by the FavoredNodeLoadBalancer when needed (from within calls like FavoredNodeLoadBalancer.randomAssignment(RegionInfo, List)). All updates to favored nodes should only be done from FavoredNodesManager and not through this helper class (except for tests).

Field Summary

Fields

Modifier and Type	Field and Description
static short	FAVORED_NODES_NUM
static byte[]	FAVOREDNODES_QUALIFIER
static short	MAX_ATTEMPTS_FN_GENERATION

Constructor Summary

Constructors

Constructor and Description
FavoredNodeAssignmentHelper(List<org.apache.hadoop.hbase.ServerName> servers, org.apache.hadoop.conf.Configuration conf)
FavoredNodeAssignmentHelper(List<org.apache.hadoop.hbase.ServerName> servers, RackManager rackManager)

Method Summary

Modifier and Type	Method and Description
boolean	canPlaceFavoredNodes()
List<org.apache.hadoop.hbase.ServerName>	generateFavoredNodes(org.apache.hadoop.hbase.client.RegionInfo hri)
Map<org.apache.hadoop.hbase.client.RegionInfo,List<org.apache.hadoop.hbase.ServerName>>	generateFavoredNodesRoundRobin(Map<org.apache.hadoop.hbase.ServerName,List<org.apache.hadoop.hbase.client.RegionInfo>> assignmentMap, List<org.apache.hadoop.hbase.client.RegionInfo> regions)
org.apache.hadoop.hbase.ServerName	generateMissingFavoredNode(List<org.apache.hadoop.hbase.ServerName> favoredNodes)
org.apache.hadoop.hbase.ServerName	generateMissingFavoredNode(List<org.apache.hadoop.hbase.ServerName> favoredNodes, List<org.apache.hadoop.hbase.ServerName> excludeNodes)
static byte[]	getFavoredNodes(List<org.apache.hadoop.hbase.ServerName> serverAddrList)
static String	getFavoredNodesAsString(List<org.apache.hadoop.hbase.ServerName> nodes)
static org.apache.hadoop.hbase.ServerName[]	getFavoredNodesList(byte[] favoredNodes)
protected String	getOneRandomRack(Set<String> skipRackSet)
protected org.apache.hadoop.hbase.ServerName	getOneRandomServer(String rack, Set<org.apache.hadoop.hbase.ServerName> skipServerSet) Gets a random server from the specified rack and skips anything specified.
org.apache.hadoop.hbase.ServerName[]	getSecondaryAndTertiary(org.apache.hadoop.hbase.client.RegionInfo regionInfo, org.apache.hadoop.hbase.ServerName primaryRS)
void	initialize()
void	placePrimaryRSAsRoundRobin(Map<org.apache.hadoop.hbase.ServerName,List<org.apache.hadoop.hbase.client.RegionInfo>> assignmentMap, Map<org.apache.hadoop.hbase.client.RegionInfo,org.apache.hadoop.hbase.ServerName> primaryRSMap, List<org.apache.hadoop.hbase.client.RegionInfo> regions)
Map<org.apache.hadoop.hbase.client.RegionInfo,org.apache.hadoop.hbase.ServerName[]>	placeSecondaryAndTertiaryRS(Map<org.apache.hadoop.hbase.client.RegionInfo,org.apache.hadoop.hbase.ServerName> primaryRSMap)
Map<org.apache.hadoop.hbase.client.RegionInfo,org.apache.hadoop.hbase.ServerName[]>	placeSecondaryAndTertiaryWithRestrictions(Map<org.apache.hadoop.hbase.client.RegionInfo,org.apache.hadoop.hbase.ServerName> primaryRSMap) For regions that share the primary, avoid placing the secondary and tertiary on a same RS.
static void	updateMetaWithFavoredNodesInfo(Map<org.apache.hadoop.hbase.client.RegionInfo,List<org.apache.hadoop.hbase.ServerName>> regionToFavoredNodes, org.apache.hadoop.conf.Configuration conf) Update meta table with favored nodes info
static void	updateMetaWithFavoredNodesInfo(Map<org.apache.hadoop.hbase.client.RegionInfo,List<org.apache.hadoop.hbase.ServerName>> regionToFavoredNodes, org.apache.hadoop.hbase.client.Connection connection) Update meta table with favored nodes info

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

FAVOREDNODES_QUALIFIER

public static final byte[] FAVOREDNODES_QUALIFIER

FAVORED_NODES_NUM

public static final short FAVORED_NODES_NUM

See Also:

Constant Field Values

MAX_ATTEMPTS_FN_GENERATION

public static final short MAX_ATTEMPTS_FN_GENERATION

See Also:

Constant Field Values

Constructor Detail

FavoredNodeAssignmentHelper

public FavoredNodeAssignmentHelper(List<org.apache.hadoop.hbase.ServerName> servers,
                                   org.apache.hadoop.conf.Configuration conf)

FavoredNodeAssignmentHelper

public FavoredNodeAssignmentHelper(List<org.apache.hadoop.hbase.ServerName> servers,
                                   RackManager rackManager)

Method Detail

initialize

public void initialize()

updateMetaWithFavoredNodesInfo

public static void updateMetaWithFavoredNodesInfo(Map<org.apache.hadoop.hbase.client.RegionInfo,List<org.apache.hadoop.hbase.ServerName>> regionToFavoredNodes,
                                                  org.apache.hadoop.hbase.client.Connection connection)
                                           throws IOException

Update meta table with favored nodes info

Parameters:

regionToFavoredNodes - map of RegionInfo's to their favored nodes

connection - connection to be used

Throws:

IOException

updateMetaWithFavoredNodesInfo

public static void updateMetaWithFavoredNodesInfo(Map<org.apache.hadoop.hbase.client.RegionInfo,List<org.apache.hadoop.hbase.ServerName>> regionToFavoredNodes,
                                                  org.apache.hadoop.conf.Configuration conf)
                                           throws IOException

Update meta table with favored nodes info

Parameters:

regionToFavoredNodes -

conf -

Throws:

IOException

getFavoredNodesList

public static org.apache.hadoop.hbase.ServerName[] getFavoredNodesList(byte[] favoredNodes)
                                                                throws IOException

Parameters:

favoredNodes - The PB'ed bytes of favored nodes

Returns:

the array of ServerName for the byte array of favored nodes.

Throws:

IOException

getFavoredNodes

public static byte[] getFavoredNodes(List<org.apache.hadoop.hbase.ServerName> serverAddrList)

Parameters:

serverAddrList -

Returns:

PB'ed bytes of HBaseProtos.FavoredNodes generated by the server list.

placePrimaryRSAsRoundRobin

public void placePrimaryRSAsRoundRobin(Map<org.apache.hadoop.hbase.ServerName,List<org.apache.hadoop.hbase.client.RegionInfo>> assignmentMap,
                                       Map<org.apache.hadoop.hbase.client.RegionInfo,org.apache.hadoop.hbase.ServerName> primaryRSMap,
                                       List<org.apache.hadoop.hbase.client.RegionInfo> regions)

placeSecondaryAndTertiaryRS

public Map<org.apache.hadoop.hbase.client.RegionInfo,org.apache.hadoop.hbase.ServerName[]> placeSecondaryAndTertiaryRS(Map<org.apache.hadoop.hbase.client.RegionInfo,org.apache.hadoop.hbase.ServerName> primaryRSMap)

getSecondaryAndTertiary

public org.apache.hadoop.hbase.ServerName[] getSecondaryAndTertiary(org.apache.hadoop.hbase.client.RegionInfo regionInfo,
                                                                    org.apache.hadoop.hbase.ServerName primaryRS)
                                                             throws IOException

Throws:

IOException

placeSecondaryAndTertiaryWithRestrictions

public Map<org.apache.hadoop.hbase.client.RegionInfo,org.apache.hadoop.hbase.ServerName[]> placeSecondaryAndTertiaryWithRestrictions(Map<org.apache.hadoop.hbase.client.RegionInfo,org.apache.hadoop.hbase.ServerName> primaryRSMap)

For regions that share the primary, avoid placing the secondary and tertiary on a same RS. Used for generating new assignments for the primary/secondary/tertiary RegionServers

Parameters:

primaryRSMap -

Returns:

the map of regions to the servers the region-files should be hosted on

canPlaceFavoredNodes

public boolean canPlaceFavoredNodes()

getOneRandomServer

protected org.apache.hadoop.hbase.ServerName getOneRandomServer(String rack,
                                                                Set<org.apache.hadoop.hbase.ServerName> skipServerSet)

Gets a random server from the specified rack and skips anything specified.

Parameters:

rack - rack from a server is needed

skipServerSet - the server shouldn't belong to this set

getOneRandomRack

protected String getOneRandomRack(Set<String> skipRackSet)
                           throws IOException

Throws:

IOException

getFavoredNodesAsString

public static String getFavoredNodesAsString(List<org.apache.hadoop.hbase.ServerName> nodes)

generateMissingFavoredNode

public org.apache.hadoop.hbase.ServerName generateMissingFavoredNode(List<org.apache.hadoop.hbase.ServerName> favoredNodes)
                                                              throws IOException

Throws:

IOException

generateMissingFavoredNode

public org.apache.hadoop.hbase.ServerName generateMissingFavoredNode(List<org.apache.hadoop.hbase.ServerName> favoredNodes,
                                                                     List<org.apache.hadoop.hbase.ServerName> excludeNodes)
                                                              throws IOException

Throws:

IOException

generateFavoredNodes

public List<org.apache.hadoop.hbase.ServerName> generateFavoredNodes(org.apache.hadoop.hbase.client.RegionInfo hri)
                                                              throws IOException

Throws:

IOException

generateFavoredNodesRoundRobin

public Map<org.apache.hadoop.hbase.client.RegionInfo,List<org.apache.hadoop.hbase.ServerName>> generateFavoredNodesRoundRobin(Map<org.apache.hadoop.hbase.ServerName,List<org.apache.hadoop.hbase.client.RegionInfo>> assignmentMap,
                                                                                                                              List<org.apache.hadoop.hbase.client.RegionInfo> regions)
                                                                                                                       throws IOException

Throws:

IOException